The fleshy part of rambutan is literally developed from seed's outer layer, called sarcotesta. Similar to mangosteen and pomegranate, you simply cant 100% remove fruit and seed apart.
did the seed skin get removed when you cut the seed out like that? I like rambutan, but the skin irritates my gums..... and the flesh isn`t easy to slice through to just remove the seed skin.