DESTROYING Donkey Kong with AI (Deep Reinforcement Learning) 

I have never heard so much wisdom in a single sentence.

Truly inspiring

And you probably won't until you start testing the thing you needed it for 3 phases down the line, so it'll take you extra long to find where it is. Also with the collective luck of all people involved, it's a single misplaced negative

As a wise man once said: we don't talk about the last video

I once coded for 2 weeks without access to testing it, and had it working perfectly in 5 minutes. In my entire career this was my proudest moment.

this 100%

No fucking way 345+ game devs are watching this...

Very relatable to my experience with "gamemaker5&6" in the early 00s. And that program should've made that whole process way easier.... 🤣

Collision in general is stupid hard to do from scratch. Unity? Kinda hard. Unreal? Less hard, I guess. Game maker? Still kinda hard. Even in my own custom made game engine, its way easier but…. still kinda hard :| Or maybe Im just really bad as a programmer, who knows

@@syntex3664 Because that's the thing with programming, if you somehow made something work the first time, you should probably visit an exorcist.

But that was the first version of Donkey Kong he made, it threw infinity barrels.

​@@dreemurrdelm7865 just give the ai a reload time so it can't spam

Now let's make it do it coinless.

why did you put a -

@@sketchystreet1 Force of habit.

@@Dmobley9901 ok

​@@Dmobley9901 youtube commentor moment

"The code works flawlessly first try" is what happens to programmers when the world turns upside down.

Spoken like a true unit-test averse programmer!

Learn test-driven development. Then you will be surprised if it doesn't work immediately.

@@jimmyhirr5773 believe it or not. Tests are also written with code. Which can also have bugs!

It happened once to me, I tested it like 10 times and it seemed to just work, it was for an assignment and honestly I just took that gift from the gods and it only had to work once more for the tutor to grade me and it did :). Honestly I don't know if I was just lucky it work 11 times in a row or it really actually just really worked first try.

Calling it a NEAT detail is a little confusing but yeah, I also noticed that

probably neat how they realized it @@barni_7762

I do not know. I love codebullet, but this video feels over the top, for me hard to watch, almost cringy, and weaker than usual in the technical part.

Well, we did design them to mimic humans

Well, he is training a neural net...

Its called learning over time

now he just needs to code in some better jokes

This is hilarious 😂

No ML engineer would call himself AI engineer.

@@pw7225 correct, but the name of my university department is "Artificial Intelligence Engineering". i live with people who call themselves prompt engineers, soo who gives a fuck XD

​@@pw7225 so no ML engineer understands set theory? :p

@Repent and believe in Jesus Christ i am just thinkin, that there is a religious programmer out there who uses all the resources he can to influence people on youtube comments without making a youtube video. He releases all these bots here expecting people to let go of their beliefs and follow Christianity. If he could give all this effort into philosophy and science, he would become an atheist

@@fizipcfx or an 'alternative scientist'

Evan is such a nice guy, always keeps his promises, especially Enigma Machine Part 2

​@@nubbyboi6523 Yeah, he'll probably make it in the next...millennia.

@@GooberInternet Better than his normal upload schedule 💀

@@nubbyboi6523Wait until it’s 2068

he already made it, but you need to decrypt his message to get the url

Which is why none existed in 2021.

I can't be the only one getting blackout drunk for these?

this guy gets it

best of code bullet 2021

best youtuber in 2023

As a software developer by profession, Yes. This is precisely how it sounds

The swearing is especially accurate. I curse every single entity imaginable, mostly my computer and myself and anyone who dares to message me at the time.

esp the little part of him that goes 'hey let's use someone else's code for this'

@@sjs9698 “I’ll ask chatGPT” has also become a voice for me

code bullet is the devil on my shoulder

he takes your understanding of it seriously.

it's the dick jokes, they help

@@aidanb7782dick jokes explain more than any PowerPoint slide could

@@aidanb7782 Like 22:02 lol

Well he is paid to so makes sense. Oh wait…

Well have seen same yt creator's that show failures more regularly and everyone is doing good but CB is the master of this discipline and his very loyal sub show us that

There’s a Russian anecdote which, in translated form, goes something like this: « Dad, why does the sun go from east to west every day? » « East to west? » « Yes » « Every day? » « Yes » « I don’t know son, but better leave it alone » It’s a stupid anecdote, but one of my favourites when it comes to programming

There's test-driven development, where you write a test for everything that should and should not happen, e.g. jumpman jumps at least once per game, and over time more tests pass. It's a lot of work, but the benefit is it will catch regressions; as we see here when Jumpman sometimes flies into the air after Code Bullet thought he'd fixed gravity issues.

@@skierpage I'd love to be able to apply TDD to game development, but the number of states and the non-deterministic means of reaching those states most games have means that you end up with very, very low coverage of the code base and/or end up pointlessly testing third party code. I've seen fat too many "tutorials" where the speaker just tests engine code

and then it suddenly doesnt

I couldn't believe a coding channel with nearly 3M subscribers has to deal with the exact same shit as I did when I was really into Game Maker in my free teenager time

@@kelleroid are you new to this channel?

@@sebastianredden7577 Nope, just finally saw a moment I could very strongly relate to

Subscriber place #selimtune

@@HRIDOYKHAN-he7ss What? Can you do English?

@@jebclang9403 hey so what if they can't? don't be mean - this is one of the few chanels on yt where the comments aren't lethally toxic.

This

@@gabribotha2403 Subscriber place #selimtune

ah, I see that you have done that... Ima kick you in the balls

Who needs a princess when god gives you testi-tickles

It's fare to say he got these subs when he was more regular

​@@heavenstone3503was he ever really regular though? Even when he was posting more often the upload schedule was still pretty erratic

Subscriber place #selimtune

​@Heavenstone long time subscriber, he's never been consistent. He's always had the charm though!

@@heavenstone3503 cough enigma machine part 2

WHOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO

Correct spelling of mum 👍

@@hmm_-. anti lgbtq? Just asking bc your name

I thought you said "noo" lmao

@@Potatoking1 always and always

I agree, I leanred more from code bullet than high school

Is it exploiting or failure to limit parameters? I mean the Ai just does what you asked it to do, it has no concept of cheating or exploitation.

@@missionpupaexploiting.

@@missionpupaI mean the overwatch 2 AIs will walk through walls sometimes because they have found pixel wide gaps and can spam input movement commands every tick so they can just kinda clip through the walls then shoot you from under the map it’s not really a failure of parameters as much as a failure to block exploits

@@Grebogoborp wait what

@@NonsensicalSpudz flats has a video on it you should look it up it’s hilarious

Imagine a Code Bullet Bingo with those stuff lol

@@hayond656 dear God that would be hilarious

13:54 it was short lived

That's just gradient descent mostly, not really specific to PPO

I love 150 dimensional sleds on 150 dimensional hills, but it seems like a pretty good anecdote

@@MaxLennon but the gradient descent is used to find the most optimal values for a neutral netwerk

@@maartenbeute6742 yes but PPO is a specific algorithm describing how to leverage a neural network (actually two neural networks), so just describing how to fit the parameters of any model doesn't tell people very much. The method above could also be given as a description for how to do linear regression, for example. Or image classification. Or basically any machine learning task.

@@maartenbeute6742 If you want to see how an explanation of the actual algorithm would look, this link should take you to my other comment where I explained it: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-ovIykchkW5I.html&lc=UgxFRqioM8iaM4rJvs54AaABAg

Also would have been interesting to see how the AI would coupe with a four way joystick. You can't turn and travel on ladders. But that's beyond the scope CB is at ... For now.

​@@trim7911 the AI can use an 8 way joystick if it's Billy Mitchell.

@@alaeriia01 lmao

I didn't expect him to make a donkey kong AI tbh.

I too lost my mind for a bit

@@WingMaster562 same tbh, I was just sitting here thinking "Wouldn't just a simple AABB collision algorithm be better?" but hey, he makes games on youtube for a living so he probably knows whats best

​@@MythicTF2 trust him, he doesn't

@@treeck3724 such an unwieldy way to code, it's fun to watch though

What’s wrong with Ray casting?

Hilarious 😂

That's genius, I need to try it now

Was that a cameo or some text to speech generator we should all be aware of? 😄

​@@zorglub667 just what I was thinking.... HonestGPT

Took me a second to notice it was AI generated.

@@DanieleGiorgino but how? If there's an epic voice guy AI generator, I must know 😄

@@zorglub667 there are ais where you feed it a few minutes of voice and it can recreate it pretty well

Yeah, NEAT is pretty neat... (*groan*) One problem with it is that it often throws away good solutions because the mutation can often be quite aggressive and throw out long-term positive traits for short-term gains. That said: This is literally how real-world genetic evolution works too. So for this algorithm, it pays #1 to have bigger population sizes, #2 to be careful about your mutation rate, and #3 to give it enough time to run. In all experiments I did with it, it often reaches a plateau where not much happens for many generations, but after a long time, it suddenly starts improving again. I'm pretty sure it has to do with the "species" system it uses: Often, one species is so good at what it does, that even "geniuses" in other species don't have enough impact to lift their otherwise mediocre species above the king of the hill species. This can lead to situations, where species with the potential to become the new best species die out before ever getting the chance to reach their full potential. So, like I said: It works just like natural genetic evolution... A species doesn't automatically survive just because it is fitter. There also have to be the right set of random circumstances to allow them to succeed. P.S.: One interesting experiment you can do with NEAT is to have to mutation rate ALSO me a trait that can be mutated. That leads to some low-mutation species that keep SLOWLY improving their positive traits and several high-mutation species that keep trying out random stuff. This stops a typical problem in machine learning: The algorithm settling in a "just-good-enough" plateau instead of keeping to improve in the hopes of finding an "even better" plateau further down the line.

@@LutzHerting this can be a video on its own. Or even a blog post series

@@LutzHerting 's also a interesting plan to use a shifting fitness function, or an array of 'em ^^

@beepbop that feels so much like how some gamers I watched approach the original Dark Souls. They get taught the mechanics, receive a shield and never do anything besides blocking and hitting back. It works, you can play the whole game with that strategy. But it is most of the time a very insufficient strategy.

we love code bullet

Code Bullet actually shoots the relevant knowledge into your brain. Hence the name.

"So as to how this thing works, -- your guess is as good as mine, I have no f*cking idea but at least it works"

"skip over a lot of crucial information" that precisely describes his explanation. No critique towards him, explaining that shit takes ages and I understand why he doesn't do it (it would also be boring af), but he doesn't explain it well.

@@EvykhaitsSchmurf-tg7gehe doesn’t explain it well or in depth to every kind of code… he explains to us neruron activation monkeys in a way we will understand and at a level deep enough to explain some nugget of inform without boring us.

Code bullet: *becomes game dev* Playerbase: *finds bug in game* Code bullet: “Where’s my ban hammer?”

E

Instead of paying money to fix the hole in the floor teach the baby not to fall in it

My favourite is the Tetris video

Yeah so funny ong

Even spiffing brit isn't safe from ai

@@Alucard-gt1zf The Genetic Algorithm is a perfectly balanced game with no exploits

it took me the same time it took him to upload 15 of his videos (provided he doesn't upload for two months... which is guaranteed) to get a cs deegree

@@thomask2133 provided you actually get the degree 😏

hamburger

It's nice to know that even simulated evolution suffers carcination.

hamburger

@@CalvinArt nft pfp lookin mf

you can implement speciation to fix the "aggressive" problem