Superhuman Trackmania AI Demo | map5 

Haha. Believe it or not, but since publishing this video it has improved three times already 😂

I'm pretty sure one day you'll be in a Wirtual video with the Ai because this is pretty interesting 😮 But I doubt an Ai will beat difficult tracks or even use tricks like bugslide 😅

@@Patrik2166 he is already no? Wirtual made a WirtualTV video about beating it I thought

@@travisallan4637 it was someone else's Ai I believe

@@Patrik2166 no same one, same map just the previous version of this one

crizpy :D

The AI is coming for your job man

@@D0Z3RGAMING fr

Glad you enjoyed it!

it's actually scary

How would you combine this with other TAS techniques ?

you just do! duh..

@@linesight-rl Maybe as an alternative to bruteforcing a segment? Rather than random brue force, you would make the ai take over for the segment, +give it some noise so it will have variation. In theory it could result in an improvement faster than a purely random brute force.

Probably try various improvements on this same map, then move onto other tyoes of maps. Is there an interesting map you could suggest for future tests ?

@@linesight-rl It would be fun to see what it could do on the campaign maps. Going further classics like Hakkalicious and if we are dreaming really big 128 Deep Fear and Oachkatzlschwoaf :D but I guess it has a lot to learn until then. Anyways, awesome work on this already, curious to see how far it can go!

Campaign maps would be incredible to watch. This could potentially unveil new strategies, reviving competition on these maps.

@@linesight-rl Should try it with some tech maps

@@kv-5 They've done Hokalicious now! (in case you weren't aware already) I agree deep fear would be really cool to see, but maybe start with a shorter FS map? I feel like that would take weeks to train. But I could be completely wrong.

a good step forward for cheaters.

@@FOWST Oh no, anyways.

Thanks a lot :)

The neural network is indeed deterministic, but there is some intrinsic variability due to frame generation. We might take a screenshot 1ms before or 1ms after. The different frame sometimes results in a different action. Also I have not tested whether clouds and flags in the decor are deterministic. If not, they might cause minimal perturbation that would also explain why runs are not fully repeatable.

@@linesight-rl Isn't image recognition with AI not only good at picking up queues, but also ignoring them? I'd love to see a heatmap. Don't think shadows or flag veawing should have any effect on an AI, but I'm no AI expert. Surfaces is "just" an extra node i.e. what surface am I on? Checks color/shape of the blocc, adjusts the inputs. What I really wonder is how would it fare with obstacles and scenery blocking the view and profile of the next corner. Leather meatbags have memory for that. But once you give AI that sort of memory it becomes TAS, maybe a selective memory based on bonks? The problem I see with leaving it to learn the hidden track, is that it may end up thinking all hidden corners are the same and it will fail miserably as soon as you change what you hide.

It's open source now ! github.com/linesight-rl/linesight

ML bots are much more human-like than you'd think. I don't think they'd be able to reliably pull off TAS only strats.

What's that strategy ?

@@linesight-rl If you search up TASes of E05, you'll find it. There's an uberbug and some chained noseboosts in there iirc.

Oh yeah right, no chance it finds this strategy unless we HEAVILY guide it.

The way top level humans in any field play is by developing a large muscle memory base from which they only need to make slight changes when encountering something new to have their internal mind state line up with the stimulus they are getting to play better. Developing that muscle memory bank is the hard part at least for humans thanks to how slow muscle memory develops, just making slight changes to play a new yet highly similar scenario to those you developed muscle memory for is easy, at least for humans.

that's not how it will happen. AI will not "take over" TAS because as soon as it becomes even equivalent, it will be used as the base runs of TAS, which will in turn be optimized further than the AI could drive

​@@Skycrafter_ theres a reason high quality tases require years of new community experience to be improved, because you cannot simply "improve" times. it requires hard trial and error and a lot of time. Ai is perfect for that. Why assume that the AI hasnt already tried the millions other of possibilites that a human would suggest to try out. ai wouldnt have any reason to ever stop optimizing times further, where as a human would (and will) have stopped far before any ai will. this is especially true for games, where the sole way of finding a "best time" is through trial and error, for example many 2d and 3d momentum based games. If you could just take a tas run and simply optimize it further, we would be seeing new tas runs every week or so. theres a reason high quality tases only take longer and longer the better the runs get, because you cant simply optimize a previous tas run. so why do you imagine a human would then have any shot at optimizing a time that was previously optimized thousands of times by ai already

@@TimeattackGD ​First of all i'd like to point out that I really well know what trackmania TAS is about, having tons of experience with it. Then, I agree with you on the fact that AI may beat TAS in some games which either requires strategy or is simple enough to not have many possibilities, for example a 2d game with only left right up down inputs. Trackmania is very different from all of that. It's a deterministic game, sure, but it's so complex in fact that during every second of every run, there is a total of 524292^100 different inputs combinations. I can ensure you that no matter how good AI gets, there will always be a way to optimize its run further. The only no-return point I can think of, is when AI starts making TAS runs by combining its driving ability and different methods such as bruteforcing inputs, in which case it would be far more efficient than a human making the TAS, but that is far different from the kind of AI you are describing.

@@Skycrafter_ my idea is an ai that uses tas tools, as in more an ai for creating tases, rather than an ai for playing the game, if that makes sense. Also, the current ai for games are nowhere near what im imagining. They lack any sort of smart way of approaching improvement to times. My feeling is that that problem will be solved fairly soon with how ai in general is developing at the moment. (like it could look at current speedrun footage and interpret it or try other similar strats) like if we dont see an ai tying the tas super mario bros record within the next decade, I would honestly be surprised.

No idea :) But probably not : see how it is the only on in the 40 AIs run at the end that does it.

Do you think it helps ? I'm not sure it's intentional.

​@@linesight-rl this can definitely help getting the turn more quickly. it does look like it gained a bit of time there. i dont think it intentionally did that though, its a very lucky trick. it has reacted to it perfectly

in the old trackmania, the green rumblestrip is like a curb so when you go over it, there's a chance the car bumps into the air.

Ramm bug your talking about? Yeah its one of the many stupid bugs in the game

No you haven't, at least not on the map this AI was trained to play well in otherwise the AI would not be beating the world record holder.

i don't think ai will seriously impact trackmania play, as it's not very generally applicable (yet). i think you're overreacting

@@astrovation3281 I don't think people will use cheat engine. It's such an overused tool. Ubisoft will surely be able to detect it.

Who cares, trackmania might be a game with leaderboards you could falsify but you as a player are not being directly aimbotted or otherwise having your fun practicing and playing better disrupted unless you're some leaderboard sweat.

Fingers crossed, but I don't think there's that much tile left on the table 😅

Or ice

This is not something we've discussed yet.

We're playing at 20 FPS, with low-res grayscale screenshots (160x120 pixels).

@@linesight-rl ah wow! didn't expect it to be so "slow" and low-res, and it still manages to easily beat humans :D Would more FPS and higher res improve the AI?

Higher res: that would definitely help, but we're facing hardware limitations here. We need to store these screenshots in RAM. So there's a compromise to be made between "better screenshots" and "more diverse screenshots". It also drastically impacts training speed. More FPS: There's a similar compromise to be made. If you can control at a higher frequency, you CAN reach better precision. But it also means that the impact of any action becomes smaller. At some point it would become too difficult for the AI to differentiate between good and bad actions.

@@linesight-rl Okay, I see :) Thanks for the replies!

It doesn't, it just gives screen data as an image