Training AI to Play Pokemon with Reinforcement Learning 

Haven't you seen twitch plays pokemon? PCs are a death sentence!

I didn't even make that connection 😂

@@mcstrategistI remember that. People were spamming. To get rid of pokemon. They had to ban people and make rules. That was pretty hilarious though.

@@nimi-naesame. But yeah that’s pretty funny

Sudden excessive punishment against a curiosity traumatizes first time experiencer Seems all too legit 😅

Stalling to avoid the outcome confirmation. Reminds me of young children, actually. Haha

@@MP-lv5vk Sometimes the sound of a door slamming because of a gust of wind can remind me of children slamming their hands on a table. There is ZERO connection/homology between anything in the bot produced behavior, and the realm of human motivation or other emotions. It is logically impossible to learn anything about humans from literally everything about this showcase except by observing the actual human who decided to create this mathematical formula of instructions (algorithm) to a low level brute force bot.

@@JohnnyNatrium Yeah but it reminds me of children's stubbornness lmao

Children can be the sorest losers, refusing to keep playing is hilarious 😂

The only winning move is not to play.

holy shit ai are the ants. or are ants the ai?

Bots

Like my team mates in LoL

Lvl 1 lukes in star wars battlefront 2 hvv

Npcs playing npcs 😢😮

@@jeffwooten6888"bot" sounds so negative. Maybe we should start calling them "reinforcemenrt learners" instead.

Seconded

The AI is cute

Based AI knows true happiness.

Ok but did you see the little dance after beating the bug catcher on the first try?

Yeessss I envision it talking everything in with a solemn smile, knowing that it’s about to leave this quaint town on a grand adventure of trials and learning. ‘Just one more moment at the banks of this familiar lake, then I’ll be off…’

Everybody likes Robert Frost

I’ve done this many times in my play throughs with Pokémon, it’s actually scary how much the AI “mimics” human behavior.

​@@piciperkuadrik4636not True I actually HATE Robert Frost

Broke yt 😂

If you like Pokemon and AI, you'll love this: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-KWwJDyBH8ig.html&ab_channel=Spawnvilley

I'm honestly baffled by how this was animated. How did you get the scenes with the thousands of character sprites moving about, all overlapping one another?

@@tytonus-burman1183 all is revealed at 26:27

200% this. Not only taking on the entire workload of the project, but taking the time making such an enjoyable and informative visual aid is stellar!

​@@tytonus-burman1183 Yeah that's what's wild, the AI stuff is sick, but the editing to show the iterations had me fucking floored.

I just thought the same, the presentation is amazing 👏

They already do!

Dude it clicked as he was explaining it "wasn't optimal" but also repeating and I was like "NOOOOOOO!!!"

Why bother?

@@user-kt6ne3fx6u simple, ai thinks and tries things different to a human, it could discover stuff the devs wouldn't even imagine it was possible

This is an elaborate version of fuzz testing, which is the act of feeding random data to a program to see how it react.

It did nothing whatsoever of anything that you said there. You are falling into logical fallacies by attributing human experiences to the outward behavior of a completely braindead brute force bot which was fed explicit formulaic instructions.

Well ​@@JohnnyNatrium, it's incredibly common for humans to attribute human qualities and personify things that are clearly dead/braindead. It's common human behavior. The same reason many people believe plants feel pain when being cut or bugs can feel love.

@@halfpace1462 Of course. Did I say I am surprised that humans anthropomorphize things? I'm taking issue with the fact that people are mistaking this poetry for actual scientific homology and coming to almost scarily fallacious conclusions and claims based on this bias, including the narration in this video.

@@JohnnyNatrium Well said. You can't blame the narrator for this as this increases engagement in the viewers by a significant margin as seen by the comments, I agree that people are acting like this is actual poetry when it's not, but there is a certain comforting feeling about the process of the AI learning even if it's just a brute force robot. It's hard to take issue with the things people interpret as because it is simply human nature, even if taking issue with them is understandable.

@@JohnnyNatriumand I think you’re misinterpreting people’s comments. Of course the AI wasn’t actually traumatized by the computer. But that’s the best way to describe it using common and brief language. And someone saying “the AI reminds me of this human behavior” is probably not someone who thinks that the AI is developing sentience, but rather pointing the hilarity of similar actions by two wildly different things.

Holy cannoli it's science boi Kyle "Thor" Hill with his locks in the wild.

I see we spend our sunday nights similarly. Lmfao.

This is honestly one of the best endorsements this video could have

I’m certain the algorithm recommended me this video because of your comment

Its the goat 🐐

Omg Dolan you fucking legend where you been

rN6media does the edits

Have you forgotten your password?

​@@anouaressanoussiobviously not

​@@MrGoodeatsyeah most youtubers dont edit their own content anymore

Genuinely blown away by the many high level skills this takes. On top of that, you have an incredible ability to teach high level concepts to a lay audience. Very rare!

@@kaComposer Agree. This level of technical ability plus storytelling ability is magnificent.

My heart dropped when it was revealed he never went back to the Pokémon center afterwards, I felt so bad for the guy.

@@istumbyright? Just imagine how rewarding it would’ve been to gain those total levels back! Probably would’ve broken the reward system, as there’s nothing keeping the AI from depositing the Pokémon just to get rewards for pulling it back out.

@@hunterwylie6969 Deposit, withdraw, deposit, withdraw like a junkie.

"The Pokémon center stole my only squirtle!"

Don't feel bad, they learn as they go!

The poor AI aww 😢❤

It triggered my Twitch Plays Pokemon PTSD

the analogies between human behavior and AI behavior were quite interesting in general, though the trauma sticks out. also kinda makes you think about ourselves, doesn't it? after all, this is ultimately just a statistic algorithm with a simple reward system, but it manages to show some rather lifelike emergent behaviors, which weren't inherently programmed it. then again, pretty much all of life is not that different, the model and algorithm are just much bigger and more granular and complex.

Indeed it happened to me when i was young, i didnt know how to withow pkmn bc the storage system was a mess so i didnt use the pc anymore xd

Reminds me of the trauma triggered whenever Twitch plays pokemon went near the computer after they accidentally released all those pokemon haha!

No one since you get it for free as a gift in one of the rooftops lol 😂

You're right! This feels like an in depth, academic essay

I want to see the AI beating the game

The digital world is more rewarding than the real world

Very relatable outcome!

Me too, why bother capturing and fighting when you can just chill and enjoy the motion of leaves and waves? Quite poetic

wtf does you being a physicist have to do with anything? guess you just wanted attention.

Obviously it'd have to relearn how to navigate the map, but it'd probably do well in battles since it already knows how

It wouldn't be able to catch the farfetchd or use cut This game would fail too with the hm's

I'm going to do this as a project for my machine learning class, and I am planning on trying the same algo on Gen 2.

do make a video@@geekygecko1849

​@@geekygecko1849how can I follow along?

yeah i thought the same, its gone up to 400 now but still nuts

tbf, it's his first video.

@@androsp9105 yeah I only realised that after I left this comment, even more nuts lmao

He’s gained nearly 5,000 in a few days. Very good going.

Misuse of commas.

shit was boring asf, felt like a lecture lol

A Happy Way to Live The servants who are ready and waiting for his return will be rewarded. -Luke 12:37 All around us we can see fulfilled Bible prophecies, signs indicating that the return of Jesus Christ is drawing near. As followers of Christ, we should be watching for Him. We need to be ready to go. Jesus, speaking about His return, said, “Be dressed for service and keep your lamps burning, as though you were waiting for your master to return from the wedding feast. . . . The servants who are ready and waiting for his return will be rewarded” (Luke 12:35-37) Are you ready for His return? To be ready means to be engaged in activities that you wouldn’t be ashamed to be doing if Jesus were to return. It’s a good idea to periodically ask ourselves this question: This place that I am about to go, this thing that I am about to do, would I be embarrassed if I were doing it when Jesus came back?” Think about your plans. Is there anything you will be doing today, tonight, or tomorrow that you would be ashamed to do if Christ were to return? If so, then change your plans. You want to be ready for His return. Not only should we be ready, but we should anxiously await the return of Christ. We used to have a German Shepherd who slept outside the bedroom, leaning against our door. We didn’t let him sleep in our room because he often had nightmares and would wake us up. Every morning when we opened the door, he rolled into the room. Then he’d jump up and start running in circles. He was genuinely happy to see us. That is how we should be waiting for Christ’s return. And anything that might prevent us from saying “Come quickly, Lord Jesus” is out of place in our lives. In addition to waiting, we should be working. Every now and then, someone predicts that Jesus will return on a specific date. People believe these predictions and start quitting their jobs or divorcing their spouses. But that is not what we should be doing as we wait for the return of Christ. Instead, we should be working for Him. The Bible says, “Just as the body is dead without breath, so also faith is dead without good works” (James 2:26) If watching is the evidence of faith, then working is the evidence of faith in action. Watching for the Lord’s return will help us prepare our own lives. But working will ensure that we bring others with us to Heaven. The great British preacher C. H. Spurgeon said, “It is a very blessed thing to be on the watch for Christ. . . . You can be poor without murmuring; you can be rich without worldliness; you can be sick without sorrowing; you can be healthy without presumption. If you are always waiting for Christ’s Coming, untold blessings are wrapped up in that glorious hope” When you live in the anticipation of Christ’s return, it’s a happy way to live.

I am looking forward to see what else you will create.

He is an employee of Amazon Headquarters in Seattle 👏🏽👌🏽 He is smart af

I was looking for this comment because I thought the same!!! It was like watching ants!! Just amazing!! This video exploded my mind... Imagine a Pokemon game were you can compete against a real "rival" (blue) in real time just to see who wins the league first... And every run the rival gets different pokemons with different moves... This guy is just insane, this is like a Pandora box!!!! New sub for sure!!!! And thank you for this video Peter!!!!!

I've got some good news for you, that's how I found this video

The algorithm brought me here

Guess I'll throw on a comment too then. This is great!

yesss this was so cool

Thanks then

1 video, 55k subs, 5.7M views. This is historic

AI picked the Squirtle in Pokemon Red lol what a contrarian

i was hoping someone else had mentioned this

@@RevanBC that was its only option...

@@Tyler-qh7bf No you can pick 2 other pokemon! idiot.

Pigeoto was ‐-----------

It's the only video on bro's account lmfao wdym

@@napoleonbonerfarte6739lol was about to write this too

Good things take time

And people who over react to low sub channels being high quality doesn't surprise me. Lots and lots of dumdums out there

Agreed! This video is insane!

I can't believe it's done by individual. Super high quality.

They tell me I’m crazy here 🤪

​@@MasteringSilenceCrazy? I was crazy once

@@norabarlow17 you only lose your mind once… They put me in a rubber room with rubber rats…

@@norabarlow17they locked me in a room. A rubber room with rats.

As a psych professor can you explain the appeal to these people repeating the copy paste comments? Also just to be clear I'm also asking out of genuine curiosity if there may be psychological reasons past the basic wanting to be a part of something, and not just trying to hate on them or anything ✌

I think that's more like curriculum learning. In the purest form of reinforcement learning you don't encode your knowledge on how to solve a problem in the reward function.

Pokémaniac Bryce Huston wants to battle!

​@@sanjaywilson8232LMAO!

*Pokemon Trainer Battle Theme starts playing*

Edit : Go Lucario ! Fight Pokemon Bag Run away

Tbh I didn’t know youtube algorithm allowed channel with 1 video to pop off like this. Over 1 million views in 7 days?? If this video was posted in a sizable channel, it might have been even 10 times more.

he paid for the view XD@@clickpwn

@@bilibangbanghow you know that?

It gets better when u go into the git-hub project and find out that he has been working on this for the last 2 years...

@@bilibangbangmald

thank you for the kind words :) no production team, but my friend @torinblankensmith made the thumbnail

I second this. I'm super interested in the content, but at the same time I'm like.... However did he make this look so good.

It’s not that deep dude holy shit

@@glupshitto1977 its deep.. learning.

@@Tom-yg7mi get out

Yes!!

downloaded it and train the ai more

And then i'd like to see it completing the game as fast as possible. An AI speedrun competition: winner gets 100,000 arbitrary points

The Red swarm wasn't enough?

me too sad when he stop at moon mt.

The AI doesn't experience anything because it's not a conscious entity. It experiences as much as Microsoft Word when you open it.

@@Elintasokas😅😂😂

@@Elintasokas Based on my PCs heavy breathing when I open Word I assume its orgasming.

Where are the uploads

This is no understatement . This takes a level of focus and problem solving that is just not normal. Savage!

I’m not even an engineer, and my jaw is on the ground. I genuinely would love to learn how to become a part of this world. I wish there were more people in my circle with hobbies and fascinations like this. I used to help write xml codes for world of Warcraft bots when I was a kid. Now laying in bed with an alarm set for five hours from now. I’ve got a sales job… is 33 years old too old to learn how to work in this scene? This video drips with knowledge, and a wisdom and understanding of something that I have no idea how to even begin to approach. Kudos!!

I wouldnt say those results are impressive theory wise ? The impressiveness of the work comes from a technical point of view, how great he managed to link the RL model with the game and the fine-tuning he put in it. By the way, AI engineer doesnt really mean anything, what is your job title ? Out of curiosity

​@bricegardner7815 no age is too high. With enough determination and curiosity you can definitely pivot. Look into videos explaining the skills required to get a job in game development/ AI.

@@alr9447 I am officially a data scientist, but within the team I'm the guy responsible of the training of the ML models, therefore I make this distinction because nowadays "data scientist" is too broad. In most big tech companies, AI engineer is a common notation to distinguish between the data science folks

We humans also have reward systems. Everything "living" does. It's different to an AI model. But who's to say that we're not just an AI model with different base rewards?

@@NikhilAutar The term "artificial" is meaningless unless it's being used to mean "made by humans". Since we didn't design ourselves, we aren't AI by any useful meaning of the term. But at the core, this way of designing AI is designed to mimic how humans learn, so you're not far off.

Not only the pokemon gains EXP points, the AI gains EXP too

@@plasmakitten4261 We'd be artificial to whoever designed us/this haha

I think completely opposite :D This (video) was prime example of how phenomenons that happens with humans can be put into numbers used by AI learning. Our learning = pattern recognitions based on the rewards we've gotten. They aren't as vivid with "Getting 3 points on catching pokemon", but rather intuitive that happens automatically.

Yes it's limited but imagine what it could become in a few more years 🤖

Isn’t it just! I’m currently half way through my final project for my MSc, with a relatively shit regression model predicting energy usage. 😂

Wah is that a thing?

@@seveneyes77 Yep! They are an online publication that uses geek culture as a way to popularize science. They had a bunch of articles from the biology if final fantasy monsters to the effectiveness of super man disguise.

I wanted to be a Data Scientist then I realized I couldn't code😂

adding ai to Pokémon added absuloutely nothing to the game. same idea as staring out a window and twiddling your thumbs worthless NPC behavhiour

damn bro that is deep.

Me with Spanish at 3 years old and English at 2 ahah Pokemon Azul and Pokemon Red 😅

When I first played Pokemon, just like yourself I was still a kid didn't know any English so I couldn't even save. The first few months was just like the AI, start from that little room and trial and error.

Hello fellow ESL player, i was like 5 when I got my first hand on pokemon. I was EXTREMELY upset when I accidentally start over the game (the copy was second hand and the saved file is from my older brother who already completed the game.) that I cried. I lost my brother's charizard, even the moltres he caught with an ultra ball because i couldnt understand a lick of English back then - overwriting his save accidentally, and I just love exploring the pokemon world more than battling them. Only then 3 whole years later when I did restart and beat pokemon on my own, around 12 I became competently aiming to "gotta catch em all".

Never thought about it like that. Do you think that's why games are so unoptimized when first released, and even if they stay unoptimized later in the game's lifespan?

Or how it’s behavior might exist because of its creator

I was feeling sad for the AI who must have thought it accidentally killed its Pokémon 🥲😂

The only flaw in the fast food analogy is we'd need to learn that in the future eating fast food will make you live longer (or something else awesome) given what Magikarp evolves into!

i thought the traumatic experience was super interesting too and funny lol

I was kinda disappointed that it didn’t conclude with the AI defeating the Elite 4 😢