Тёмный

AIs learn to WALK 

Pezzza's Work
Подписаться 139 тыс.
Просмотров 49 тыс.
50% 1

00:00 Introduction
07:20 Training
12:45 Other solutions
16:02 Race
Neural Networks learn to control a simple body to walk to targets.
The project has been made using C++ and SFML.
I will post the Github later
This is a reupload to fix sound issues

Наука

Опубликовано:

 

28 май 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 166   
@PezzzasWork
@PezzzasWork 9 месяцев назад
This is a reupload to fix sound issues
@Creep5432
@Creep5432 9 месяцев назад
Oh okay
@spacepotato2361
@spacepotato2361 9 месяцев назад
thanks
@thegarry7542
@thegarry7542 9 месяцев назад
Man I though part 2
@PezzzasWork
@PezzzasWork 9 месяцев назад
@thegarry7542 Yes sorry for that 😢
@goldestperson
@goldestperson 9 месяцев назад
Aww i thought part 2 too lol
@MutohMech
@MutohMech 3 месяца назад
Solution 2 is so satisfying to watch, definitely my favorite
@SemlerPDX
@SemlerPDX 8 месяцев назад
19:30 I love this part where Solution 2 seems to have a blip of consciousness like, "Hey! Wait a minute! These things just keep popping back up! What are we even doing here?!", before it bursts back into its programming. 🤣
@Alexandre_Kinkela_
@Alexandre_Kinkela_ Месяц назад
Perhaps a glimpse of concsiousness, who knows...lol
@user-bw7cb1bs6q
@user-bw7cb1bs6q 9 часов назад
Not at all These neural networks models cant even "think" all they do is based on reflexes and instincts ​@@Alexandre_Kinkela_
@d.l.7416
@d.l.7416 9 месяцев назад
Here's a simple reason why its more than 50% likely that two turns will be in the same direction: Consider a sequence of four points the agent travels between, A,B,C,D. Now draw the line through B and C. The turns will be in the same direction if A and D are on the same side of the line. (if you draw an example then this is clear) Say the probability a point is on one side of the line is p, so the other side is 1-p. To get the same side from A and D, you either get both left so p*p or both right so (1-p)*(1-p). So a total probability of p*p + (1-p)*(1-p) = 2p^2 - 2p + 1. This is always at least 1/2, and its only 1/2 when p=1/2 So its more than 50% likely that two turns will be in the same direction. (you can check with desmos) It's really just that if you flip a biased coin you are more likely to get the same direction twice. I have also tested it empirically and indeed if you choose 4 random points in a square then you have a 61% percent chance of the turns being the same. There might be some complications because its a sequence tho.
@PezzzasWork
@PezzzasWork 9 месяцев назад
Thank you for the effort!
@AlexanderWhillas
@AlexanderWhillas 9 месяцев назад
I wonder if this is an explanation for handedness?
@quantumgaming9180
@quantumgaming9180 4 месяца назад
@@AlexanderWhillasWhat do you mean?
@AlexanderWhillas
@AlexanderWhillas 4 месяца назад
@@quantumgaming9180 well, if a bias is developed it might be the explanation for handedness in humans i.e. right verses left handedness?
@quantumgaming9180
@quantumgaming9180 4 месяца назад
@@AlexanderWhillas i see
@Zappygunshot
@Zappygunshot 9 месяцев назад
An idea for expanding this experiment: - limb count & length variability - segmentation possibility (not just adding another set of limbs, but making the whole creature longer/wider as they do it) - limb joint count variability (instead of each limb being a rigid stick, allowing for extra joints & muscles along the length) It'd be cool to see what types of body plans the AI comes up with.
@joelyricsandskits6223
@joelyricsandskits6223 5 месяцев назад
Totally agree with you 💪
@BisexualPlagueDoctor
@BisexualPlagueDoctor 4 месяца назад
The code to make this is probably horrifying
@cerberusslavomiraarus1308
@cerberusslavomiraarus1308 4 месяца назад
3:45 "I also switched to a circle" Proceeds to use a square
@texasred8424
@texasred8424 2 месяца назад
he meant for the training not the demonstration
@AlexanderWhillas
@AlexanderWhillas 9 месяцев назад
Very cool! You have inspired me to start making my own experiments. Thank you!
@Wallee580
@Wallee580 9 месяцев назад
Orange needed a quick nap. xD
@felixmerz6229
@felixmerz6229 9 месяцев назад
Genius idea with the snow on the floor so they leave cute little traces.
@Bobman808
@Bobman808 9 месяцев назад
Love your work dude - thanks for putting in so much effort!
@PezzzasWork
@PezzzasWork 9 месяцев назад
Thank you!
@Snookers_
@Snookers_ 9 месяцев назад
Kind of interesting how the forward movement of each of the 4 solutions very closely mimics a different canine gait.
@Teegik
@Teegik 9 месяцев назад
The amount of work, and the quality ... incredible.
@hvanmegen
@hvanmegen 9 месяцев назад
Beautiful music, mesmerizing movement (love the sand addition and the particle 'explosion' effect on arrival, and the blinking of the targets.. you clearly have good taste in design and style, typically french eh ;)) and flawless presentation. (Good volume on the background information too, not too distracting).
@ryanpiotr1929
@ryanpiotr1929 8 месяцев назад
The grey sand particles are just for show, right? With low friction of the foot, it just passes through, as if it was lifted above the sand. It would be quite interesting to see what walking tricks would evolve if the creatures had to push the sand out of the way and how different sand densities would affect this. There would probably be distinctive swimming, wading and burrowing. The creatures might learn to use an already cleared path again, building a system of tunnels over time... Your videos are really inspiring, making me think of a hundred more ideas to add. Never stop making those beautification features! Love your channel!
@mariealba4158
@mariealba4158 7 месяцев назад
With every person doing these kinds of AIs I just want to watch 100 000 generations of it, with each getting a bit more complex through mutations or whatever. It's just so interesting
@PezzzasWork
@PezzzasWork 7 месяцев назад
I would also love to do so but it takes quite a lot of time and requires many watts :D
@mariealba4158
@mariealba4158 7 месяцев назад
@@PezzzasWork Yeah I thought so! It's a real shame! :D
@duckyblender
@duckyblender 9 месяцев назад
Very high quality stuff. Love it!
@emilfilipov169
@emilfilipov169 19 дней назад
This channnel is so chill, i love it.
@qwertyuiop2161
@qwertyuiop2161 9 месяцев назад
will an editor/source code for predator prey simulations ever be released? I really enjoyed the videos
@jeffpelevin
@jeffpelevin 3 месяца назад
I'm interested too
@neomorphosallomorphis7395
@neomorphosallomorphis7395 9 месяцев назад
that's so great can't wait for the more complex structures
@AHSEN.
@AHSEN. 9 месяцев назад
I loved the idea of placing sand to watch where they go :) It looks amazing!
@Wuuzzaaful
@Wuuzzaaful 9 месяцев назад
Love how the eyes are always tracking the targets 😍
@louge2223
@louge2223 17 дней назад
this is the best youtube accounts ive found recently
@Audey
@Audey 6 месяцев назад
Solution#2 is a legit walk that's so awesome. #3 was really interesting how it favored its right leg for power so heavily unlike the others which were a bit more symmetrical. Also I'm really surprised #1 plateaued where it did rather than refining things to something closer to #4. Really cool video thank you
@CelestialityRW
@CelestialityRW 9 месяцев назад
Lets goo i love this channel sm
@ldcgadzooks1901
@ldcgadzooks1901 9 месяцев назад
I would describe the types of movement for each solution like this: 1. Hop 2. crawl 3. Trot 4. Hop (But better able to turn)
@mariealba4158
@mariealba4158 7 месяцев назад
I think it's interesting with the 3rd one because it seems to strain one side way more than the other. I don't understand why and it bothers me!😂
@rats748
@rats748 Месяц назад
​@@mariealba4158 I noticed the same thing. If you look closely, Purple doesn't like to take a straight path towards the goal. It's usually turning slightly while moving, so one side is more strained than the other. Very peculiar.
@BeneathTheBrightSky
@BeneathTheBrightSky 6 месяцев назад
Hmm... You've made rocket AI, Drone AI, and walking AI. I can't help but notice that all of these would be very entertaining if you paired them with the predator/prey AI... *drone phalanx attack*
@MonsieurBro
@MonsieurBro 7 месяцев назад
Sorry for this being not related to this video, but later on whenever you feel like touching the Pred Vs Prey simulation again, I think I have some ideas that could produce interesting results: Prey remaining as-is in terms of directives, but with an added caveat that if a unit is surrounded too densely by other prey, they cannot gain nutrition. Tuning this would still allow for large groupings, but discourage simply sitting in the middle of a pile creating children that also do not move nor fight back. Other idea would be creating a middle tier creature (purple or something maybe?), that is able to eat prey, but can also be eaten by the old predator class. Possible food chain could be Large Predators (L) can eat Prey (P) in one bite, and can eat Small Predators (S) in two bites. From there, S can eat P in 2 bites, and can sometimes fight back and eat L in 3 or 4 bites. P can only fight back against S, losing to L in one bite, and do not gain food for a kill.
@zolorc2288
@zolorc2288 9 месяцев назад
Imma say it again but I want to see this on a slippery surface on a race track to see them control at different speeds as they accelerate
@RandoART2023
@RandoART2023 9 месяцев назад
Thought this was a sequel. I got exited😢
@ArnieMcStranglehold
@ArnieMcStranglehold 8 месяцев назад
These are fascinating to me.
@Tomfoolery1980
@Tomfoolery1980 4 месяца назад
Solution 2 was easily my favourite little derp, then he just stopped dead. Now i think its my spirit animal.
@AndrewAhlfield
@AndrewAhlfield 6 месяцев назад
So interesting that the networks had to develop a single pattern that worked well enough to control both distance traversal and turning. I'd love to see what would happen if neural networks were encouraged to develop two separate turning and distance traversal behaviors. Then to blend the two of them together using additional nodes. Sounds like another two videos!
@0991476937
@0991476937 6 месяцев назад
In the race, Solution 4 (that jumps like a frog) outpaced Solution 2 (that crawls like a lizard). In real life, jumps require more energy - it's the price you pay for moving with the least contact with ground surface. On the other hand, lizard movements are really simple - you just move your limbs one by one. Thus, if you plan to enhance this learning algo and shot part 2, I'd vote for introducing "step price" aka "energy per movement" parameter - not to drastically improve the speed but instead to make it look closer to a real life! 🐸🦎
@calsalitra4689
@calsalitra4689 5 месяцев назад
I would describe it as more of a crawl than a walk. Like how a caterpillar moves, but with less legs. What I found interesting about it is that solution 2 was actually faster in straight lines. Earlier on when all 4 solutions were close together it was noticeably faster, but when it came time to turn it always fell behind. The optimal solution would probably be solution 2s walking with solution 4s turning.
@DrHanes
@DrHanes 9 месяцев назад
Superb! Thank you!
@mrshotsmith
@mrshotsmith 9 месяцев назад
Liked and commented to boost algorithm as balance cos I don't intend to watch a second time so retention won't be as good. Great video tho.
@motbus3
@motbus3 8 месяцев назад
Hey 👋 In the fitness function Is common to define a penalty for not solving the problem. The penalty is hard to set, but usually what I do is to define a per step small penalty that is slightly worse than doing nothing. You can also set a penalty for doing nothing for too long or for not solving the problem. The latter is useful to remove stalled agents.
@kubstoff1418
@kubstoff1418 9 месяцев назад
the orange guy had to reconsider some life choices at the very end 😁
@Dysiode
@Dysiode 9 месяцев назад
10 minutes ago!! Will leave it up in the background to build engagement
@22119980ii
@22119980ii 4 месяца назад
The main problem in wheir motions is "turning", turns take up to 50% of all time while moving. Despite the fact, that Solution 2 is quicker than Solution 1 on straight distanse, S1 is better on turns, the same goes to S3, it is moving like injured, but it is very good on turns. S4 is good in both turns and moving, thats why it is winning. In my opinion the movement pattern of S4 is better on longer distanses or higher speeds, as we can see in IRL like Felidae family do. And movement pattern of S2 is more mobile and "flexible", the example in the wild we can see as stated in Felidae family.
@Yursa_Luna
@Yursa_Luna 6 месяцев назад
Its really cool to see how they resemble how real animals move even with such simple muscles. Orange is like a quadruped walking. Purple is like a quadruped running. And Green looks like a frog hopping along.
@mmmmm1438
@mmmmm1438 9 месяцев назад
very good ❤
@ZeraticVODOfficiel
@ZeraticVODOfficiel 9 месяцев назад
Salut l’ami ! J’adore ton travail
@seagie382
@seagie382 4 месяца назад
hoping for another pvp video soon!!! Very cool though
@StevenJAckerman
@StevenJAckerman 9 месяцев назад
Very nice. A lot of work to implement as well as to test and document. Is this written to SFML or BGFX ?
@PezzzasWork
@PezzzasWork 4 месяца назад
I wrote it using SFML
@RitterderRedlichkeit
@RitterderRedlichkeit 8 месяцев назад
I am more amazed by the way you did those smooth animated body thingy. the muscles and stuff like that. You are using SFML or SDL right... HOW do I do stuff like that?!
@Paulo_Dirac
@Paulo_Dirac 9 месяцев назад
so the "real" point of efficiency is in their capacity/strategy to turn.
@anonymousplayer315
@anonymousplayer315 9 месяцев назад
lets fucking go favorite channel out rn
@moonyl5341
@moonyl5341 9 месяцев назад
whats the difference between 1 and 4 and between 2 and 3
@c1ty-hunt3r
@c1ty-hunt3r 8 месяцев назад
Damn I feel pity to old generations who looks disabled and can't catch up young one. Reminds me my dog when he got back legs sick. Great videos man, very educational. Thank you.
@Pastel_Frito
@Pastel_Frito 6 месяцев назад
19:22 Solution 2 starts taking nap
@R.B.
@R.B. 3 месяца назад
I think you should have a couple more parameters for the fitness function. Penalize energy use. This can be seen as a product of muscle contraction strength and duration. Secondly, penalize node count. This may also be framed as energy conservation as more synapses firing require more support from the host. Efficiency should be a factor considered.
@SuitedNoob69420
@SuitedNoob69420 2 месяца назад
hey i was wondering if you could make downloading of the ant simulation easier, Thanks!
@DIMENSIONCODE
@DIMENSIONCODE 9 месяцев назад
Oh so it's not part 2... 😔
@kylemaven5956
@kylemaven5956 7 месяцев назад
Bro I know how much work it takes to make videos like this. You are doing great quality stuff but you gotta make it shorter and more engaging. Keep up the good work though don't give up
@ro-kg5vb
@ro-kg5vb 7 месяцев назад
This reminds me of the brandeis golem @ home project 🙂
@Doichin-cv7ge
@Doichin-cv7ge Месяц назад
Bro makes four-legged terminators
@GovenorGeneral299
@GovenorGeneral299 9 месяцев назад
What tools / software do you use to create these simulations?
@humanamlogicam2182
@humanamlogicam2182 8 месяцев назад
I have always asked myself this question, is it theoretically possible to have an overload of neurons and links by dint of making generations? having a network that is too large where certain “hidden neurons” come into conflict and therefore undermine the evolution of a network.
@hexdiqoreprime7974
@hexdiqoreprime7974 8 месяцев назад
They would be selected out.
@Space_Reptile
@Space_Reptile 9 месяцев назад
i like how solution 4 is green, as its very froglike in movement
@ChrisRyanWilliams
@ChrisRyanWilliams 5 месяцев назад
Favoring one direction over the other. Could this be seen in humans preferring right handedness...
@madman19931612
@madman19931612 9 месяцев назад
Late stage solution 1 seems really cool, but when you compare it to the others it just looks like its playing basically QWOP: madly flailing, which mostly works but its turning is just a mess XD
@fred_bauer
@fred_bauer 9 месяцев назад
Why are they turning at all tho? Do they somehow get points for facing the target or something? Does it have something to do with the first simulation? I don't quite understand, I thought they were symmetrical.
@Simon-wg9lw
@Simon-wg9lw 9 месяцев назад
How do you run these github projects? I don't know much at all about programming and so I was searching and searching for some hours now from my understanding I need to convert the main.cpp file into a .exe file? Is it possible that you could upload the exe file to github?
@ZT_M
@ZT_M 8 месяцев назад
What do you make these things in? I see that you usually make stuff from scratch so I'm wondering how you run the code.
@Glasmere
@Glasmere 9 месяцев назад
Reupload?
@ThighErda
@ThighErda 9 месяцев назад
yea
@gaem9625
@gaem9625 9 месяцев назад
good vid
@Urusi
@Urusi 9 месяцев назад
左右交互の方が早いと思わせて、結局4番が最速なの激熱
@unstablemystery4229
@unstablemystery4229 8 месяцев назад
Solution 1 reminds me of a puppy running 2 reminds me of like a lizard 3 reminds me of a horse and 4 reminds me of a dog at full sprint And just like a lizard 2's brain just randomly shuts off haha
@AlexanderWhillas
@AlexanderWhillas 9 месяцев назад
I don't understand how the fitness function is used to train the NN since none of the network outputs are part of the equation?
@AlexanderWhillas
@AlexanderWhillas 8 месяцев назад
Ah, your not running back prop! Your just evolving the network weights. So you can side step the need for a back prop. objective function. Good show!
@kashpyr
@kashpyr 9 месяцев назад
I clicked so fast
@ericscheit5540
@ericscheit5540 9 месяцев назад
I was hoping this would be a new video But its just a reupload ):
@e-motep876
@e-motep876 5 месяцев назад
Nice one gg
@termisher5676
@termisher5676 24 дня назад
Oh 1 and 4 doff is one is pulling and other is pushing itself
@0991476937
@0991476937 6 месяцев назад
Great video btw! Thank you!!
@shilohmagic7173
@shilohmagic7173 4 месяца назад
I'm curious, were they turning manually using the muscles and legs? or were the agents automatically rotating to face the goal?
@PezzzasWork
@PezzzasWork 4 месяца назад
All the controls are performed using muscles and friction
@shilohmagic7173
@shilohmagic7173 4 месяца назад
@@PezzzasWork Love it!
@higuy3482
@higuy3482 24 дня назад
connect the movement ai with the prey vs predator ai, i think that would look fun
@Longtimer49
@Longtimer49 4 месяца назад
so frogs are superior. i knew it. i will no longer walk and instead hop everywhere.
@miversen33
@miversen33 8 месяцев назад
I'd be interested in seeing the final race but with a completely different target set. Something to show more "learned behavior" as opposed to "memorized movements to complete a set course". Not to say this isn't really cool! Just that I'd be interested in seeing how the various solution NNs handle a completely different "race" as opposed to what they were trained against. I feel that would give a better representation of which NN learned to walk better
@PezzzasWork
@PezzzasWork 8 месяцев назад
The training was done using random targets sets, I use the same for the video to ease the perception of progress
@miversen33
@miversen33 8 месяцев назад
@@PezzzasWork oh that makes sense! Great work!
@jandar2827
@jandar2827 9 месяцев назад
I'm annoyed if music hasn't lower volume than the speach. Music should be in the background not dominate. That said, I can't remember anything special about the music in the first version of the video.
@Packtd
@Packtd 9 месяцев назад
Can you make a update on 2d budget teardown? I or atleast upload it
@KGello
@KGello 9 месяцев назад
Interesting how they never go backwards, instead they try to turn awkwardly every time. Aren't they symmetric?
@vis7139
@vis7139 4 месяца назад
Would be cool to see what would happen if you started a bunch of AIs off as omnivorous. Would they split into predators and prey? Would any omnivors remain? Or would they all stay omnivors? (Thinking about your previous vid on predators vs prey..!)
@zekejanczewski7275
@zekejanczewski7275 5 месяцев назад
Scrungley litl guy.
@Michael-yd9zc
@Michael-yd9zc 7 месяцев назад
Now we GAMBLE
@user-lp5ux8uw6x
@user-lp5ux8uw6x 4 месяца назад
do you remember all of the ant simulations? well i think they re missing one thing: the diging
@FaithGamer420
@FaithGamer420 2 месяца назад
this sand Kreygasm
@azathothsuzuki4434
@azathothsuzuki4434 9 месяцев назад
Do you have discord?
@m4h1_tww87
@m4h1_tww87 6 месяцев назад
Hello, I have a small question: Are you currently studying computer science or have you already graduated? please answer.
@Kartofeuleu
@Kartofeuleu 5 месяцев назад
Un need more subs
@SU76M
@SU76M 9 месяцев назад
I guess the details about solutions differences are kept in secret.
@PezzzasWork
@PezzzasWork 9 месяцев назад
There is not much to say actually, I just ran multiple trainings and got different results with different seeds for the pseudo random number generator
@ThighErda
@ThighErda 9 месяцев назад
THEY WALK.!
@ThighErda
@ThighErda 9 месяцев назад
Reuploaded?!
@zecksidd4102
@zecksidd4102 28 дней назад
Fais plus de vidéos !!!!!!
@timokreuzer1820
@timokreuzer1820 4 месяца назад
Le Frog clearly won.
@krovvl13
@krovvl13 2 месяца назад
Hey m8, I'm on a school project. Would want to know if we could talk about your and mine work. If you prefer we could talk about payments and those things. Let me know!!
@krovvl13
@krovvl13 2 месяца назад
Nice work by the way, gonna check your whole channel
@homerynopiajr8735
@homerynopiajr8735 4 месяца назад
Where part 3 of prey vs predator
@daniellaurent4976
@daniellaurent4976 8 месяцев назад
à chaque fois que je recherche des gens qui font des IA, je tombe sur des français qui parlent anglais
@goldestperson
@goldestperson 9 месяцев назад
Man I wish I knew C++
@DFPercush
@DFPercush 9 месяцев назад
No one knows everything about C++. It's not that hard to get started. Just pick a project and figure it out as you go. That's how you learn. You can do a lot just knowing how to write a for loop and an array. There's lots of open source code to help you. Here he's using SFML to draw the graphics. It starts with reading the documentation and tutorials. When you get to an intermediate level, I would recommend reading Scott Myers' book "Effective Modern C++" although it's dated to 2014, a lot of advanced features were added in 2020.
@AlexanderWhillas
@AlexanderWhillas 9 месяцев назад
Rust is better
@rnts08
@rnts08 8 месяцев назад
Tbf any language is better than none. Get at it OP don't worry what language to start with.
@PezzzasWork
@PezzzasWork 8 месяцев назад
Very good advice :)
@AlexanderWhillas
@AlexanderWhillas 8 месяцев назад
@@rnts08 weeeeeell, for this stor of stuff you need performance so a system programming language would be ideal.
@resamoc
@resamoc 9 месяцев назад
😊
@CarbonMatrixify
@CarbonMatrixify 9 месяцев назад
Hi Pezza, please consider doing an economics based video, would be interesting to see how agents learn to trade and how it affects value. I'm sure that would be one of the most informative videos yet! Love your work
@JordanShackelford
@JordanShackelford 8 месяцев назад
Instead of trying to make an improvement every single generation you should give it more time to make sure you're not getting stuck in a local optima
Далее
Watching Neural Networks Learn
25:28
Просмотров 1,1 млн
Much bigger simulation, AIs learn Phalanx
29:13
Просмотров 2,6 млн
Что-то пошло не так 😂
00:15
Просмотров 417 тыс.
AI Learns to Outrun Police Officers
11:44
Просмотров 571 тыс.
This AI Stuntman Just Keeps Getting Better! 🏃
6:23
Просмотров 244 тыс.
Turning bugs into Art
7:43
Просмотров 193 тыс.
Simple Fractal rendering
11:05
Просмотров 126 тыс.
How to train simple AIs
12:59
Просмотров 45 тыс.
AI Invents New Swimming Stroke
20:11
Просмотров 181 тыс.
AI Invents New Bowling Techniques
11:33
Просмотров 3,2 млн
😱НОУТБУК СОСЕДКИ😱
0:30
Просмотров 2,2 млн