AI Learns to DESTROY old CPUs | Mario Kart Wii 

Perhaps in my next video your wish will be granted ;)

@@aitango if you are ready, so am I

​@@aitangomake it learn mushroom peaks

​@@aitangoYou know the rules, and so we are

@@KaishidowNice try but those aren’t the lyrics

Yeah true, it helps the AI as if it does something wrong (like hit a wall or fall off), the feedback is pretty instant, making it clear what the AI needs to avoid!

@@aitango have you though about how it might deal with items and if it could learn how to use them as well?

@@aitango Can you not program it to detect the dif maps roads and whats off road?

@@CaptainBuggyTheClown ​​⁠ He *could* give the AI a preconceived idea of what the tracks are is, but that defeats the purpose of having the AI Learn Mario Kart. Not just how to play Mario Kart, but learning how to recognize what bottomless pits are, optimize driving, and hell, even learn what driving *is* based on the 2 goals given to it. He’s not teaching the AI what Mario Kart is, the AI is learning by itself to win by wanting to maintain speed, and Strive for first place. If I understood him right, the AI might not even know what a race is, as much as it’s just trying to keep 2 numbers up very high, and is determining what actions will allow it to do that with the best possible advantage.

What is a reward so far as its concerned?

I gave it a big reward for finishing, so it really makes the reward spike which I guess for an AI counts as arousal haha

how do i delete someone else's comment

@@LilacMonarch says the (admittedly adorable) furry

​@@LilacMonarchsays the (creepy) furry

@@LilacMonarchsays the (neutral as the furry is a stranger) furry

Coding again Mario Kart Wii wouldn’t be easier

@@GunnerSiIva yes but a lot of these "AI learns game" channels code a simplified version of the game that they can integrate their AI with easier

Truuue, lowkey annoying when they do that

​​@@manelneedsaname1773yeah, cause its not really beating mariokart if its not even the real mariokart, is it?

@@IrishAnonymous01 That's because you need a programming interface to interact with the game. In some cases, coding the game from scratch is just way easier !

In most of the Mario Kart stuff I've done with AI, it always seemed to do low tricks surprisingly well which always baffled me, as I have no idea why I learned that so fast

@@aitango Yeah, it does hop a lot at the start so maybe it's just something it does on accident then realises it can get the most amount of points there by lowtricking. It's so cool how your reward system makes it unintentionally learn it though lol

With the right rewards it might figure out the instant finish glitch.

The fact it pulled the shortcut lff at 12 hours of training is still very impressive

Whats so crazy about it?

That would be so hard for it to learn. Using a shroom would give the AI huge reward (Thats a lot of speed), so it would most likely just use the 3 shrooms one after the other every time.

Chess... Average human after 80 hours - "wait, en passant is actually a rule?" Engine after 80 hours - *able to beat the best human in the world*

​@@bobkreme2175"Send me your god, I must consume their ELO"

Of course it heavily depends on the task and the model architecture, but humans will generally learn MUCH faster. The AI however has the much higher ceiling. For real-time usecases that is. If the AI can play millions of games in the same time a human plays one it's obviously different

​@@bobkreme2175yea 80 hours is such a large sample size for the AI to body us. I have I feeling we win first hour or two, then the AI starts beating us with the tricks we showed it

It wouldn't be a fair comparison at all. If we are talking about a regular game (let's say mario cart), the human player (even if this person has never seen mario cart before) would start with prior knowledge, since the game is designed to be easily understood by humans. The AI on the other hand would not understand anything, and play like a human when the screen is disconnected, but maybe quicker on changes in state. If a human player played as if this was a full time job for 2 weeks (80 hrs), there would be an improvement, but the progress would probably look fairly linear (or would maybe flatten a bit if completely new to the game), while the AI would have a much larger rise in the first few hours, which would flatten quite much after just a few hours. The change in the AIs curve would most likely make the human curve look constant in comparison. If we would do this in a more fair manner, the "game" should have a few buttons that could be pressed, and randomized pixel graphics that change depending on the inputs and timings, with a scoring system that gives points based on some determined criteria, which in the start is seemingly random to both the player and the AI. In this case the AI would win consistently over the player almost certainly all the time with a scoring gap that would increase with every single run.

I didn't even notice that haha

As the editor I can tell you this is a beautiful coincidence

@@aitango do you watch the videos though or when they are done they are done

The what

That's sadly improbable fue to how the rewards are set up

With this manually set up reward system, it would be impossible because it wouldn't even be optimal for the AI. It technically isn't learning how to beat the track in the fastest way possible, it is learning how to maximize the handcrafted reward function.

@@myithspa25 look up history of unltrashortcuts by Summoning Salt

Yeah its pretty amazing, it feels like new AI research is coming out constantly and it just keeps getting better and better so fast. Thank you so much, I really appreciate the kind words!

Depends. This is hardly different from MarI/O, an AI that happened years ago.

Simply: a electric powered programmable calculator, calculating how to get the most reward numbers by trying every possible input. It's not really much more than a algorythm that saves it's inputs and at what time it has to do said inputs to get the highest reward number possible.

nah this stuff was definitely possible when I took an AI class over 10 years ago

This is just factually wrong. Here's a MUCH more advanced mario kart AI by Sethbling (actually learning the *game* not just a track) from 4 years ago. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Tnu4O_xEmVk.html and 3 years before that he did the same thing but with Super Mario World. This stuff (and much more advanced) has been available for over a decade easily.

The second to last clip was slightly faster, managing to get 1:05. There's definitely still room for improvement though, mainly missing the odd mini-turbo and missing the boost panel at the end

Thank you so much, always great to hear! Will look to keep making more content

Me too man

I’ll check the other videos

Thanks, will really help me out!

I'm really glad you liked the video! I remember years ago something similar happened to me! Back around 2019 I was really into StarCraft 2, so when Google released an AI to play it just as I was getting into AI it absolutely blew my mind!

Really glad you like it! I'll make sure to make the next part as good as possible!

Next video should be out on Friday 1st September

+1

When looking at 0:40 , I assume they've used the package dolphin-memory-engine and has access to read the memory.

It would have to be using some kind of memory hooks. Whole screen processing is very slow and probably couldn't handle processing a race in real-time. It also wouldn't know what speed it was going just by screen alone.

I'm curious too. It'd be very underwhelming if the AI is essentially blind and doing this by trial and error. It seems like sometimes it just runs into a wall.

+1

I was wondering exactly the same. It feels as though the AI is just reverse-engineering the reward algorithm, where the algorithm needs to be known in advance in order to determine "successful driving". I think I've missed something in the explanation here.

I kind of just want to know what difficulty they were set to

I wanted to know that too, how are rewards calculated?

Yeah that final lap finish is like a drug to the AI haha

Thanks! I'll have to give it a try at some point

Really glad you like it! I'm hoping it gets lots more haha

It seems like you are on the way there already! 😄 @@aitango

Congrats on 100k!!

I agree, it is sick. Utterly disgusting. Videos like this should be outlawed!

Thanks! Yeah Moonview would definitely be a great track to try as the AI would have to try so hard to learn to avoid cars haha

Having it use an outside drift kart on moonview highway would be sick

Thanks! Glad you saw the livestream, I wasn't sure how it would go! Yeah I'm not sure, I think the AI would definitely get banned for cheating since it would probably set off any bot detection that exists. Would be really cool to try though, would love to get in touch with some of the Wiimmfi Devs and try and make it happen though

@@aitango Hi AI Tango, Wiimmfi dev here. RU-vid seems to remove my comments for some reason (spam filter) - feel free to contact me through the info on my youtube profile.

@@aitango you can set up a private room and livestream the bot racing to encourage people to join to try and race the ai

Really glad to hear, I'm grateful to RU-vid for reminding you of the channel!

There's a good chance that was on purpose, as getting wheelie bumped causes a massive drop in speed and therefore reward. I actually trained other mario kart AIs which avoided wheelieing for a really long time because of this

Yeah I would love to see, I could imagine Mario Kart RU-vidrs doing vs AI challenges and stuff like that

​@@aitangoYou might want to reach out to the MKW modding community to see if its feasible. That idea is overflowing with potential.

You can already race ghosts of other fast players through CTGPR

So glad you enjoyed it, great to hear such kind comments!

I'm glad you find them helpful!

Glad they are helpful!

I've always thought that would be such a cool idea, infact I would love to do this for job if it becomes popular! Really glad you liked it!

@@aitango Honestly most artificial intelligence in games use random number generation but never actually learn themselves they just use outcomes defined by numbers not outcomes defined by what it actually knows and what it doesn't. I feel like learning itself is a much better way of it to become overly powerful over current methods used to day with artificial intelligence in video games. it's a hard prospect to grasp but if you ever decide to reach out for some company or get a job for this specifically, please let us know about it, As I would definitely like to follow you on that journey!

Will do! I think it could lead to so much more interesting gameplay so would love to be apart of it

Well said

@@aitango Some companies are already working on that like Sony AI, Unreal Engine Learning Agents... But please keep in mind we don't necessarily want our butts kicked as players 😂 Sometimes, predictible AIs are funnier to play against !

Thanks a ton!

Thanks you so much, it really means a lot to hear such kind words!

Thanks, will do! Really glad you're enjoying it!

Glad you enjoy it, and good to hear you’re looking forward to more!

Thanks! So this AI was only trained for Ghost Valley 2, so would likely struggle if I put it down on another track. If however it was trained on many different tracks at once, the AI would likely start to understand how tracks really work, rather than a specific track, so could probably try tracks its never seen before! This is definitely something I'm looking to do in the future!

@@aitango not sure how hard it would be to do, but love this idea and we should make it happen.

​@@aitangoOooh, you could have one version of this AI (Player 1) learn every track in sequence, and each race put it up against a fresh AI in the Player 2 slot to see how much P1's previous training helps or hinders learning new tracks.

Yeah I was really happy with how it turned out, I might consider running others for a while longer!

Thank you so much!! Will try my best to keep new videos coming!

Really glad you like it! I always wonder that too! Many AIs usually hit a plateau after a while, but this one looks like it was still improving from the graph, so would've been really cool! Perhaps in my next video you might see some items :)

We are gonna try and post a video every 2 weeks on Fridays, thank you for the support. Takes a while to train the AI, create voice overs and edit. We really appreciate the love. 🙏

Glad you liked it, hope it was fun and engaging.🙂

Next video should be out in the 1st September, we try and post every other Friday.

Really glad you like it! Yes, the AI is learning from looking at the screen, the same information people use to play the game. It only knows the position of the other racers from its current placement (1st, 2nd etc), and the minimap. The AI actually only uses rewards when training, not in the actual decision making process. This means that once the AI is trained, no rewards are needed for it to drive, just the screen!

@@aitango incredible! Thanks for letting me know and keep up the great work!

That's definitely coming at some point in the future! I'll have to get some suggestions for tracks I should do! It is possible, and while training this AI the game was actually sped up! The AI also plays multiple games at once (4 games in parallel) to further increase the speed!

@@aitango nice! I'd suggest doing Mario raceway (N64), Mario circuit (DD), Peach gardens (DS) and Luigi circuit (Wii) since they're kinda visually similar

Yeah those are some good ideas, you would hope the AI should be able to use its learnt knowledge on all of those tracks since they're similar. I think Peach Gardens could be interesting though, at the start the AI might end up going around the round about at the start haha

then just learn how to code AI :P

It makes sense that it would be able to use what it learned here on certain tracks that have no obstacles on them. It has basic driving skills, understands the benefits to drifting, popping wheelies, tricks, and shortcuts, and actively avoids falling off. I feel like when things like Toad's Factory's stampers or Moonview Highway's cars come into play, it would need a lot more training before it wouldbe ready.

Yeah this reply is pretty accurate; it might be able to drive a little on other tracks since it understands the basics, but would definitely struggle with anything too different to what its seen before during training. If the AI was trained on multiple different tracks though, there's a decent chance it would be able to play new tracks straight away since it would start to have a good general knowledge of the game

By the time it reached the end it learned to stick to the middle so it had no chance to encounter it.

I don't think so, the WR has some insane strategies, I don't the current reward system would be able to do it. Even with a more advanced reward system, the AI can get stuck and not evolve or take higher risks because that would drastically affect the reward it receives, so it is very unlikely a AI like this could beat the WR.

@@tdiogo_gamer very unlikely or impossible?

@@billz8934 I don't exactly know, but if it isn't impossible, it is EXTREMELY unlikely.

I can verify this is pretty accurate. Most AIs do sadly hit a plateau at some point, rather than just continuing to improve forever. There are however other AI models out there designed to use much more data which probably could beat world records, but running these models is only really possible for big companies with huge amounts of compute like google and openai

We all have to learn somehow!

There is actually an algorithm that attempts to do something similar this, called Advantage Learning which looks to increase the gaps between the predictions, forcing it to change its choice less. I really like the idea though, as for games like Mario Kart where the constant action swapping is really detrimental, it would definitely help!

In theory the game already does it since you lose speed.

@@renakunisaki Well, the issue is that while it loses speed to what we know to be faster, there's almost a sort of, what's it called, a local optima or something? While the ai COULD commit more to turns, committing even slightly more would have little improvement but increase the chances of a crash. It's entirely possible that the ai is stuck trying to optimize this tradeoff, and without shifting reward/punishment values, it may never get out of that rut. In order to improve without that, it must intentionally take actions which it knows will cause more crashes. It doesn't want to crash, so it doesn't try to improve.

Thanks, I'm really glad you like it!

Thanks! That sounds like quite the challenge, might have to work up to that one haha

Don't worry, there's definitely more coming!

Yeah you really never know haha. Even with advanced variants of Q-Learning like this one, things can still be a bit unpredictable

Glad you enjoyed the music! And of course the AI too haha

Thanks, will do!

Thank you 🙌

Thanks, glad you liked the music!

glad you appreciated my music choices :) maybe some hardstyle for the next video😂

It actually wouldn't, at least not without a substantially larger and more complex model, and that would take much more computation to deal with. Rewards work better the more frequent, immediate, and relevant they are (this is actually true of human learning too.) You could say beating a previous time is the most relevant thing possible, but it's also the least frequent, least immediate thing possible, because it happens once at the end of the race. How does the AI relate beating a previous time to all it's previous work? It has to "think", "OK. I did something better this time, but what was it?" How does it figure out which thing or things it did that lead to beating a previous time?

Lots of passion and hard work are going into these videos, glad to see you enjoying them.

Thank you so much, glad you enjoyed!

I'm really glad to hear that!

Really glad you enjoyed the video, and I hope to do lots more with the AI too! My dream as that the AI will be able to surpass my own skill level in any game I play!

That's a dream I'm gonna watch you reach. You earned a subscriber today, my friend.