@@drecoracing if you're talking about the Arrive and Drive league, I did that for a few years. It was great but IMO the karts are not maintained that great, and races are only 4 to 5 laps which is nowhere near worth it. You wait hours to drive 5 minute races.
A seat that doesn't fit you so your torso was flopping back and forth. That makes you try to hold yourself upright with your hands/arms and that makes the steering go everywhere. The guys passing you looked like they were bolted in the seat - no movement. Their head tilts a little going into the corners but that's it. It's partly the seat fit but also how they let themselves sit in the seat. They don't fight the seat, they let it do the work. It's not like seat belts and harness in a car. Especially with low powered machines, every loose/tight/loose movement takes a little of your momentum. The fast guys do all their changes of direction with one movement, turn in the right amount and track out perfectly. No wasted energy. It can be a big adjustment from street based vehicles. Karts also don't like trail braking the same as cars (with differentials) do. Brake mostly in a straight line and pick back up on the gas just about right after you turn in. As a kart turns in, the geometry lifts the inside rear wheel for the differential action. The kart goes from a four wheel vehicle to a three wheel vehicle. Upsets the machine and makes you flop around in the seat more.