A.I. teaches itself to drive in Trackmania 

Could you in the later generations select the ones that traveled the shortest distance at the last checkpoint? This would make them use the racing line more closely wouldn’t it? And then you could pick out the ones that don’t hit the walls. Not sure if that’s at all possible but it would make sense to me

in this vid i saw fast ai that started bouncing of the walls at a later point getting over taken by a slower ai. to create fast ai i needs map knowledge and learn that racing that keeps as much speed as possible and a bump on the wall slows you down. So basically all ai need to know what is faster in much smaller sections than a few checkpoints and then combine them to fastest to checkpoint. it's not going to be easy to create fast driving self learn ai.

@@theracerdude also if the cars are punished for hitting a wall they will make corners without hitting the walls while also taking the shortest route

neat optimizes the topology of the model, if i remember it correctly you don't train the weights of the model. ai.googleblog.com/2019/08/exploring-weight-agnostic-neural.html github.com/google/brain-tokyo-workshop/tree/master/WANNRelease/prettyNEAT

neat

13:32 best part

@@verrtex7837 thats trippy

Totally not kidding. I bet if you layered more hough level runs at increasingly delayed start times it would appear even more accurate

Fluid simulation*

You should watch the trackmania 20k project from l4bomba

AI

Well drifting will be cool but in these types of races like Formula, drifting will be totally useless. But yea will look cool

@@evgeny8578 In sharp some sharp corners drifting is faster than releasing acceleration.

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-lNPKKQywzEQ.html

@@evgeny8578 this is trackmania not a simulator so basically there’s a technique called speed drift by holding brake from about half a second while turning the car enters a drift where it gains speed, I was weird game physics but it’s a part the games identity now

Or just kill them off if stopped. A little nudge can even be better than taking a turn slower to not hit the wall.

Wrong. The GA will converge to *NOT ACCELERATE AT ALL* because you would maximise your points.

@@khantatat If it doesn't accelerate, remove a point, problem solved. Acceleration - +1 increment Hits a wall - -1 Doesn't accelerate - -1

@@thedoctor0892 this would be better, it has an incentive to accelerate. Please note that, if feasible, it might converge to a circular path, which would represent a very appealing local maximum

@@khantatat Then in this scenario, there should be a limited time for the AI to reach the finish line, this would then force the AI to find the fastest way, without hitting a wall to get to the finish line. Going in a circular pattern, ziz zag motion or going as slow as possible would mean failure for the AI.

Ah a man of culture I see

I am mad that because he did such a reckless thing now his name will forever be tainted, he's no longer "one of the best players of the game", he's now stuck as "the guy who cheated". You ruined yourself and for what ?

@@sephikong8323 For the worldrecord.

@@Seraphim262 A record that he should have known he would have gotten caught for at some point, it's not like he played a rng heavy game and he just cheated by creating the exact odds he wanted, Trackmania is like Doom, it's very easy to access your run and replay it for scrutiny and any discrepancies can be found very easily. The only reason it took so long was because people didn't think it was necessary since he was excellent and had a good reputation and grinded so they trusted him. He himself destroyed that trust, it was certain that it would get found out someday somehow, he could have obtained the record the legit way if he kept grinding instead of taking the easy way out, now he pays the price

That’s a oof moment

Also, human player sees much more further down the track (curves on the horizont), this AI is limited in its visual field.

Yeah thats exactly the point. His AI stops to progressing because it lacks of Input. He need to let the AI see further to let it predict curves and such better. Also the current speed, acceleration and other factors need to be inputs to the learning algorithm.

Each car needs its own camera for vision to see far

And the ai should take the longest visible straight-shot instead of just zig-zagging through the entire track.

@@sethmath2778I think that is happening because it isn't anticipate what comes next, so even if it zigs when it is supposed to zag half the time the selection function will just take the ones that got lucky that time and put them into the next generation.

There is science that does imply, that quantum mechanics follows evolution in the form of something you've all heard before : Path of Least resistance...that this path is actually an evolution process formed by the arrangement of molecules shifting around to settle into the most efficient configuration. There is a famous experiment with the optimal configuration of bubbles...how "most" of the time they settle into the most optimal configuration...but sometimes they don't...and so it's been the study of how evolutionary processes is how nature optimizes all problems not just biology :)

looks like some breakcore typa visualizer

Was looking for a comment on Trabadia lol

Yeah trabadia is really good for real trabadia is amazing

Genetic mutations. As we evolve ressesive traits can sprout causing the mutation. It's based of survival of the fittest but has bad traits. Over time there will be less and less until it's no more. It's literally evolving and changing it's (DNA)

@@dfdempire8912 what? I'm aware of how this is structured. I was making a joke.

@@Tollerah93 lol

@@dfdempire8912 Jokes. You know what jokes are, do you?

Yes

Popular boy.

This is not like water flow at all. Doing a water simulation is completely different of this ai

So. We actually already do. Electrical and audible waves are used in many purification/production processes.

@@hugoantunesartwithblender I mean. It kind of is though

That's why you usually only cull the worst 50% instead of the 99% that didn't win.

The term for what youre describing is a local minima/maxima - the algorithm effectively gets 'stuck' within the search space. Its why, as the other commenter says, you dont kill all but the winner, but its also the reason for random mutations being introduced!

@@TheSmiddy Oh, is he culling the worst 99%?

@@diabl2master One assumes not as that's basically never done.

Nah, we live in a world of mathematical patterns so reality is basically just a very advanced AI.

Agreed ... it's a little bit hypnotizing as well :)

it's strange how despite his awefull pronounciation you can still make out what he says

Or like insect

which means water is AI, therefore universe is AI

I was thinking the same thing, if you use a combination of factors for the fitness function it can learn better behavior.

Exactly what I was thinking. A sort of ‘punishment’ for the AI for either hitting the wall or not reaching a specific checkpoint by a certain time

I was about to suggest this myself. It seems to me that the AI is held back by the fact that it thinks that hitting the wall is a valid strategy to make a turn, whereas we humans know that this is not the case.

A really straightforward solution is just to add a time penalty if it hits the wall, so total time is duration + penalties and optimise total time.

I would rather add a penalty after 1 second of wall contact, depending on the vehicle it might be easier to implement a course correction via controlled crash

If a high pressure water source was blasted into a tube that was well constructed for minimum resistance, it would follow an f1 drivers route wouldn't it?

Thank you so much !! I loved your video series on genetic algorithms, it helped me a lot in the beginning ! Very happy you came across this video :D

@@yoshtm the

@@brad3262 th

@@gamefun2525 ok

@@yoshtm This is a lame video ai has been able to do this since the 1970s

The first bit of the track looks like a sink trap/u-bend 😂

I thought the same

Enough idiots banging their heads will finally get through.

@@sulosky brute force method

@@sulosky thats deep

It's more people born without legs

Oh and the handbrake of course, for drifting really sharp turns with style and speed.

I prefer the bang bang bang => wasted strategy =D

@@xcruell it wouldn't be as efficient so it'd probably cut all the nonsense out

@@manz7860 have you played trackmania before?

You can get rid of one of those inputs in Nascar. Makes it simpler... Lol

This reminds me of how they let supercomputer play a Civilisation game against normal AI. You know, the game that you can win by many possibilites - Space race, Culture race, Political race, Technology race, use diplomacy etc.... or go tryhard and conquer most of the world. The supercomputer was learned those rules, possibilites of win, conditions of technologies ... and after some calculations he entered an absolute warmonger scenario, flooded the map with his units and crushed every opposition he ever faced. It was ... disturbing to say at least and worrying to see a "normal AI" thinking of such a result and then to execute it brilliantly. Don´t know the algoritm used or any details, it just stays in my mind as a memory of an article i once read

_WarGames_ the 1983 movie. To a computer, reality is a simulation.

​@@siriusczech you may want to account for the artificially created environment and the limits it provides the AI to deal with, introducing a general bias towards warmongerism as the best strategy in this context. This might be a general bias in the game system (war is always stronger than any other type of progress towards victory) OR the lack of collaboration benefits. Which are always there as long as the ultimate goal is a "winner takes it all" mentality. The winning conditions of Civ are that you need to be the guy on top. The first one. So collaborating is only worth if you are still the one getting out of it on top which deminishes the whole purpose of collaboration in the long run. The game's system and winning conditions would need to be adjusted if you want the "true" AI (not the algorithms just called "AI") to come out on top without killing everyone :D

@@alexejfrohlich5869 it strongly depends on the nationality of AI - some civs have significant bonuses there to be able fo fulfill other types of victories (tech race or cultural race is one of them) and this thing doesn´t require too much giving up of any other strategy gameplay - like that you couldn´t build a strong or high tech army in the first place. The issue there was that no matter the nation, no matter those conditions, it ALWAYS flooded the map with tons of cheap units, somehow achieving the victory despite it pissed of every nation one after another and it didn´t care for diplomacy or other things neither as much as you would think it will be - just a brutal 1000 turns raid on barbarians, trading only something and with strentgh in counts it defeated even those that it (based on numbers) shouldn´t defeat. And that was interesting on it whole - that perfectly "thought-through" assault is probably the easiest and most viable strategies even in this world, no matter other facts. That the problem with humans is that even dictators cannot wage war against such computing force.

@@siriusczech might be that there are bonuses, but it still looks like waging war is just the "best" strategy in this game system. also it is most likely the easiest accessable. if the AI is beating everything by spamming units also exposes a general flaw in the game system that was there the whole time. the AI is just taking advantage of it. so it looks like "killing" is the best strategy for the AI but actually, it is the best strategy within this artificial system. the AI just makes it clearly visible.

La mm mdr 😂

Pareil

+1

Mais tellement 😂

C'est marrant parce qu'aucun coms anglais mentionne son accent, les seuls qui en parlent c'est nous même x)

plus in a track you may have to tackle a corner differently based on what corner immediately follows it, not sure how to do that here though

@@Obi-WanKannabis I'm sure that with bigger network AI could simply learn the map. Or learn how to learn the map.

I think an easy way to provide "memory" of track layout would be to give it list of vectors from the center vector towards the way track is going. For some tracks, the best curve through a corner depends on two following corners. If you don't provide even a rough info about those corners, the AI can never excel. With the current input, the best that AI can ever do in theory is to play at roughly level of human driving any map for the first time.

Wouldn't it be easier if you could somehow say "The AI driver hit the wall, eliminate this AI driver." And then just measure time at the checkpoints? Base your fitness level on the checkpoint times. That way the AI would have to find the fastest way to a checkpoint without hitting a wall.

​@@harmenoosterhof9604 I think there might be evolutionary peaks and valleys. As in: AI have to do something unproductive for couple of generation before it can improve. As in AI has to drive close to the wall without hitting the wall, I bet that most would hit the wall and get lower score thus those genes not surviving at all. And even if you manage to train AI to hug the wall. It still needs to know what wall to hug. So you need deeper network to learn and predict corners and hug walls at the optimal time.

Algorizzum

It's funny, coming from a language where the 'h' is silent, he puts in so mich effort to pronounce words like "how" right that he even does it with words like "hour" - where it's actually silent in english as well! :-D (no offense, just something I noticed)

He sounds like he had 1 hour to learn english pronounciation and then had to read the script

Oui oui

@@Brabldibrablmann trust me, even after years of speaking english, my prononciation isn't much better

I don't know. AI who learn to follow the wall will progress, a contrario of AI doing circles.

@@whatelsula Could have also made 'backwards progress' on the track an elimination category too. This way they AI would have learned to not hit walls and/or go the wrong way on the track.

@@ziero1986 Yes, but maybe not for the first generations, I think.

Yep, even the fastest in generation 100 still slammed into that wall before the chicane

Didn't you wonder wether or not it was a good strategy? Maybe it makes you faster overall even if you lose some speed the moment you hit the wall.

This is where better features would help. You can see in the long straight sections the car seems to travel at a weird angle, this is because the distances to the wall aren't relevant for the straight, the next corner information is. Is there a GitHub repository for this code?

seems like the the measured input parameters (wall dists and speed) are reaching its limit regardless of the number of future iterations. Certain curves or curve combinations look "same" to the AI whilst in fact the AI should understand that they are not the same ahead of time (by measuring other/additional parameters). Because there is a limited number of curve types and thus combinations of them in TM one could try to make the AI "see" which ones they have at hand and learn accordingly. Imo this way the record of the reference driver may be broken. Also does the AI steer inputs between 0-100% or always 100%? Maybe this adds extra friction and therefore slowdown?

@AE Templates Rather than making it map specific, a better solution would be to give a line of sight that correspond to different track pieces. For instance if you use circles and curves as LoS, the AI will be able to see past the bends into the turns. The good thing is that with this kind of learning algortihm, you shouldn't need to do complicated stuff, the AI should figure it out on its own.

@AE Templates Well actually it is we can see over the walls, even without know the turns ahead of time you can see the track ahead of you. If you want the test to be fair... you'd need to recreate the track with walls a human couldn't see over... in which case you'd see humans advance similar to the AI. Slamming into the walls or going too slow... while we'd learn "faster" we'd learn basically the gap between generations. In other words, comparing AI to humans here is completely unfair as we have two different tracks.

hi taco.

je me disais aussi que yavais un ptit goût de brioche 😅

@@Daneri42 Ah la c'est la gâche carrément :v

Mdr x)

@@ShiroGojo miam

Plutôt bocage où littoral ?

I thought the same thing. And the ones that turn around always make me laugh. 🙂

Would make for an intense game, especially if you had a mini turret on the back.

It almost looks like he's playing it in slow motion.

It's like his car is outrunning a zombie horde.

I wonder if a directive to simply have the maximum amount of space between the front of the car and the wall directly in front would give the best result.

@@TheRealMeatwad That would be very inefficient....it isn't how apex of a corner works

Yeah, part of thinks it would have been better if the simulation was stopped as soon as the car hit the wall; although I know nothing about A.I learning. That's just a hunch.

@@TheRealMeatwad Congratulations, the car will now stay still and not move!

@@sciencemanguy, obviously you also use other parameters for accelerating while the distance part is used to to determine facing, not speed. But I didn't clarify that in the original post so I guess I deserve that.

Acceleration means the rate of change of speed which also includes slowing down

@@abrightguy508 there is much more than that into obtaining the best track time, you need to be able to slow at a faster rate than the one given to you by the game wich is basically lack of acceleration and how fast the game brakes on its own, because the doesnt use physics, it uses numbers, so its a given break strenght number, you are able to increase that number, thats an action, so yeah, if AI cant even do that its missing quite a lot already. This assuming this is all real and not just show, but hey, its fun to watch regardless.

Long enough 😂

I was about to say this as well. As it is now, I feel like it's handicapped compared to a human.

yes, AI resolution of data is to weak. But at 11:45 of the video, the AI makes a corrective movement to the left, because he wants to be in the center of the track, not on the fast lane. You could prioritize the ahead distance so AI dont make to much of an anticipate move.

@@camilohurtadoacero7233 That's because the AI was trained to just finish the track, not get the fastest time.

I wonder if it remembers the next turns. If not, it will never improve as much. It just learn to drive in a track as if it is the first time it drives it. I think Trabadia drove the map some times before realizing the best time. Is it true? How many times did he try?

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-yZFY5ZJtgyM.html

Interesting comment ! I know my accent isn't very good. If I make another video with voice-over, maybe I'll try to make it in French with English subtitles, I'll have to think about it. If any of you have a constructive opinion on this, please let me know :)

@@yoshtm The whole point of the comment is to say that your accent is fine and there is nothing wrong with it. You're a perfectly understandable and should keep doing what you do.

@@yoshtm no, keep voice ovet with english language, not only it will improve your english (im assuming english isnt your 1st language), and that way you can train your english speaking ability, and can attract more viewers.

@....... Tu feras gaffe, ton anglais est plus propre que ton français...

Conclusion: everybody hates french people

you have to be deaf not to hear that

@@metalvideos1961 Im a Brit Naniiii I hate france

@@JakSpate bonjour

this guy is not an indian?

@@Antiork lol no, listen at his pronunciation of r and you'll see

Lol

229 likes but 1 reply ! How

@@koo9ol Actually three

@@tvojejidlo8143 you're wrong it's four

@@knoert7977 no its actually five

Watch the videos of code Bullet

Is it a mod for TrackMania ? How can he control so many cars in TrackMania?

corona be like...

He speaks french and we don't have H in our pronunciation. So in english class we learn to pronounce the H. We do it every time we see a H in english now

I stand with your wife.

AI: Jelle's Simulated Marble Runs Martin: I'm still making the Wintergatan MMX physical

Thanks ! and thank you also for your help with Openplanet :)

cause it use a NN instead of a LSTM

Thanks !! You don't need brake on this specific map, Trabadia didn't use brake in his run for example. And the AI is still able to stop accelerating. But brake would be useful in more complex maps. It's easy to sort replays in folders, and to select and edit specific replays ingame. And there are tools to edit camera shots ingame.

Thanks ! I'm glad you like this, I've been watching your videos for years :D Yeah time is by far the biggest problem, 100 generations already takes so much time.. I think Supervised learning is pretty cool too : it would be awesome to have an AI that can play any map, and let it discover the campaign and collect the medals for example !

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-U9hq2keQgY0.html

ahaha nice comment

Reality has not to be a simulation, this simulation is based on reality.

running from zombies in real life? whaa

@@mebe6474 you what

The red one is Neo. The blue ones are agents Smith.

Yes, like Satan