Teach your AI! Imitation Learning with Unity ML-Agents!

Подписаться 529 тыс.

Просмотров 94 тыс.

50% 1

🌍 Teach your AI how to act through Imitation Learning!
📦 Unity Machine Learning Playlist: • Machine Learning AI in...
👇
🌍 Get my Complete Courses! ✅ unitycodemonkey.com/courses
👍 Learn to make awesome games step-by-step from start to finish.
00:00 Intro
00:23 ML-Agents Learning Methods
00:40 Reinforcement Learning Vs Imitation Learning
02:55 Scene Setup
07:16 Demonstration Recorder
10:16 Unity ML-Agents GAIL
11:48 Unity ML-Agents BC
13:02 Imitation Learning Training
14:40 Final Model trained with Imitation Learning
🌍 Get Code Monkey on Steam!
👍 Interactive Tutorials, Complete Games and More!
✅ store.steampowered.com/app/12...
If you have any questions post them in the comments and I'll do my best to answer them.
🔔 Subscribe for more Unity Tutorials / @codemonkeyunity
See you next time!
📍 Support on Patreon / unitycodemonkey
🤖 Join the Community Discord / discord
📦 Grab the Game Bundle at unitycodemonkey.com/gameBundl...
📝 Get the Code Monkey Utilities at unitycodemonkey.com/utils.php
#unitytutorial #unity3d #unity2d
--------------------------------------------------------------------
Hello and welcome, I am your Code Monkey and here you will learn everything about Game Development in Unity 2D using C#.
I've been developing games for several years with 7 published games on Steam and now I'm sharing my knowledge to help you on your own game development journey.
You can see my games at www.endlessloopstudios.com
--------------------------------------------------------------------
- Website: unitycodemonkey.com/
- Twitter: / unitycodemonkey
- Facebook: / unitycodemonkey

Опубликовано:

25 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 178

@CodeMonkeyUnity 3 года назад

🌐 Have you found the videos Helpful and Valuable? ❤️ Get my Courses unitycodemonkey.com/courses or Support on Patreon www.patreon.com/unitycodemonkey

@mirrorslav5803 3 года назад

could you add some way of one time donation? because I rly want to thank you for these tutorials, but my financial situation is not good. also could you please try to make agents fly?

@Bruh-ms4jh 3 года назад

Yes!

@BenVhekith Год назад

Hey, can you give us the link to this course? because you went over some things that you did off screen really fast, and the links you are including are to your website that has all of your courses, and I can't find this one on there.

@keyhaven8151 22 дня назад

@@BenVhekith I haven't found it either. Have you found it now?

@BenVhekith 22 дня назад

@@keyhaven8151 No, if I remember correctly. I had to sort of just find it out on my own. Its been a year, and I can't find anything on my computer on it. I am so sorry!

@devinweidinger3812 3 года назад

You've been killing it lately! Great work - thanks for making these and the simulation videos! You rock!

@AHSEN. 3 года назад

Incredible. Thanks for this great tutorial, you covered all the information I needed and more.

@beardordie5308 3 года назад

Absolutely legendary. I had no idea that Imitation Learning could be slapped on top of Reinforcement Learning so easily now. Your explanations are clear and concise not just to repeat exactly what you're doing, but also to comprehend enough to come up with novel ideas. Thank you so much.

@CodeMonkeyUnity 3 года назад

Thanks! Glad you liked the video!

@turtlemaster890 3 года назад

@@CodeMonkeyUnity can you show us the foodSpawner code? I can't figure out what to put in there.

@MasterofFire-sc3yn 3 года назад

Imitation learning seems to give a huge headstart!

@oxic3339 3 года назад

Amazing videos lately! Hope we see that Car AI with ML-Agents soon 😉

@CodeMonkeyUnity 3 года назад

💬 Here's how you can teach your agents how to complete more complex tasks. Stay tuned for more ML videos like Driving a Car and playing Flappy Bird! 📦 Complete Unity Machine Learning Playlist: ru-vid.com/group/PLzDRvYVwl53vehwiN_odYJkPBzcqFw110

@trueheu3becteh 3 года назад

Thank you for these ML-Agents videos. For me the topic of board game AI training would be interesting too. For example, teaching AI to play Go on unusual boards. It would probably be based on imitation learning and self play, I guess...

@badrballish9328 3 года назад

Great work, thank you very much.

@ArkyonVeil 3 года назад

Having watched your previous video, I've had an "ok, done that" with reinforcement learning. Sure it can be handy for some scenarios but the training time can be insane. But this...? THIS I CAN USE! THANKS! I had no idea this was a thing. :D

@TechnicalBurhan 3 года назад

I wanted to ask what is the ram you have in your pc. I have 4gb ram and as I downloaded pytorch my pc crashed due to immense lag. Any idea to reduce lag

@ArkyonVeil 3 года назад

@@TechnicalBurhan I'm running 16 gigs of RAM and running the Neural Network with an i7 9700k running at 4.5 ghz. Generally, with NN you want as beefy of a computer as possible, including a very generous amount of RAM so it can store the model in. 8 gigs is the minimum for NN I'd say. And if you're really serious you should get an NVidia GPU with 8 gigs+ of VRAM so it train the model much faster. Long story short: Neural Networks require a lot of horsepower to both run and train, if this one gives your computer an embolism, I'm afraid the only option is for you to find an alternative NN that requires less specs, somehow tweak this one to be smaller or code one that is lighter. (Though be warned that simpler NN's may be significantly dumber.) That or get a new computer. Up to you. I however suggest you look into other types of game development, I myself have trouble running them and doing so with your machine sounds like a miserable experience.

@TechnicalBurhan 3 года назад

@@ArkyonVeil thanks for a detailed explanation. I have 4gb Ram and it doesn't work with me np

@joshbishop 3 года назад

This is seriously awesome

@christopherlegg6200 3 года назад

I love your videos buddy. Thanks for uploading so much.

@CodeMonkeyUnity 3 года назад

Thanks!

@TYNEPUNK 2 года назад

LOVE your videos man!!!

@CodeMonkeyUnity 2 года назад

Thanks!

@orsimhon133 3 года назад

Yessss ! Keep like that !

@devansh_4u 9 месяцев назад

hey man did you get the foodspawner and foodspawnerenv files?

@daslolo 3 года назад

amazing video!!

@lucasmoreira3237 3 года назад

Ai is amazing ♥

@Wanfanel 3 года назад

Manual change of velocity can work randomly. Even you don't change code for velocity game can run different.

@arcday4281 3 года назад

Cool tool! It would be interesting to make very smart "enemies"for the game. Of course if I have enough brains and time to use it in a real project )))

@trashcaster 2 года назад

Yea, especially AI in platformers. It's the one AI that I never understood how to implement, and it would be neat to see how it's done.

@NoStupidItsManbearpig 3 года назад

Is there anywhere we can download the source code for this video? Or even clone the repo?

@israelRaizer 3 года назад

Awesome! Could you try replicating the hide-and-seek game from OpenAI? Or just any other adversarial multi-agent game?

@CodeMonkeyUnity 3 года назад

Yup, adversarial agents is one of the next topics I want to research. They have a functioning Soccer game in the examples which seems to work very well.

@israelRaizer 3 года назад

@@CodeMonkeyUnity nice, I'm looking forward to it

@user-ek1co6st7v Год назад

Hi! When does the bot get rewarded when using the gail? Is he trying to repeat the sequence and time between rewards or is he just repeating the recording?

@mr.whiskers6411 3 года назад

Yes

@laurodarsh 3 года назад

Great Work! I'm not realizing how the architecture of project is build :( I need check the prefabs and scripts to undestand all the picture so could you please provide a link to github to this project?

@haiderkamal1106 Год назад

Hey CodeMonkey. Is it possible for Imitating Agent to get observations from mlagent's raycast or grid sensors? My agent's navigation is based hugely on m baske's Spatial Grid Sensor. and its been quite a while now its not showing any improvement during learning.

@beamflies 5 месяцев назад

Great video, I have the reinforcement learning running but I am confused by the heuristic function, when does this get called is it any time RequestDecision is called when we run in Heuristic behaviour mode? I have it translating key presses into actions so I can record a demo for imitation learning but when I record my key presses aren't registered and consequently no actions spawned.

@ryaeon9793 2 года назад

hey code monkey.. can i ask something about learning method? can you add more difficulty to already trained onnx? let say you add wall in the middle after the agent push the button or when button pressed agent and ball will randomly placed

@pytchoun140 3 года назад

Do you think we can do everything with machine learning or some IA can only work with state machine ?

@TechnicalBurhan 3 года назад

I wish you get 2 million subs by the end of this year

@CodeMonkeyUnity 3 года назад

That would be quite the achievement!

@TechnicalBurhan 3 года назад

@@CodeMonkeyUnity indeed it is

@remithomas3346 Год назад

It's fun to see how the ia exploits bugs. Like at 15:02 it goes in diagonal because the input vector has not been normalized.

@CodeMonkeyUnity Год назад

Oh wow I never noticed that! Yup it apparently learned diagonals are faster, awesome!

@marushirudesu 3 года назад

Please make a video about inheritance

@newcalm6420 2 года назад

These tutorials are incredibly helpful, I fail to see how not including a link to a repo to clone is logical at all though

@CodeMonkeyUnity 2 года назад

I do provide the project files for videos where I can. For these complex machine learning videos there are too many dependencies to share the project.

@keyhaven8151 22 дня назад

Hello, I would like to ask which link is available for courses on reinforcement learning and imitation learning? I haven't found it yet

@SYBIOTE 3 года назад

saw the ad , proceeded to completely watch the ad

@thegamingprofile6797 3 года назад

How do you create machine learning for for a grid based movement with turns between the player and the AI? Can you make 3d tutorial based on turn based grid game with the player having turns against the AI

@kuponk8647 10 месяцев назад

is it possible to exclusively use GAIL? Im trying to compare RL vs IL and using GAIL as my representative for IL, but since it also uses extrinsic rewards it doesnt seem like a fair comparison.

@KyryloVesna Год назад

When I use Imitation Learning with behavioral_cloning parameter, Unity has like 0.001 fps. Any tips how to fix it? Should I left only GAIL parameter? With GAIL only, it works fine though, but learning process looks weird

@pixboi Год назад

Can these all be done, while having the curiosity model also?

@sahilsharma2867 3 года назад

Hello sir, huge fan Can I ask something Pls make "Journey of the Priarie king" with unity,pls pls pls

@dragonlord1935 3 года назад

I have a question, I'm not overly familiar with ML but after watching this video it seems very useful. Now I'm just wondering if something like this can be used on something much more complex (Ex: Training a platformer AI or a 2d shooter AI). What do you think? Do you think something like that would even be possible? or would it introduce too many unknown variables and cause the learning to fail?

@CodeMonkeyUnity 3 года назад

It can be used on anything. As long as you give it enough data and enough time to train it can learn to do anything. Check my latest video on using it to play Flappy Bird ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-fz8D0OZkQGQ.html Stay tuned for a video on driving a car and more complex examples

@Maukustus 3 года назад

Monke do thing

@Build_the_Future 2 года назад

Dose anybody know why my model stops learning no matter how long I let it run. in some cases, the Mean Reward goes all the way from something like 0 to 400 then back down to around 0. I was wondering if somehow it grows too big and runs out of something?

@drtonyburns7321 2 года назад

How could you handle a game that was difficult to play manually, such as a game of tennis where the bat angle had to be adjusted?

@user-sd7jm4eq6e 5 месяцев назад

Hello!Thank you very much for your video. Could you please show me the "foodSpawner" script and the foodSpawnEnvironment script?

@benr3293 2 года назад

Why did you change the script to use only discrete actions? Movement was a continuous action in the previous video. As far as I know you should be able to use both discrete and continuous actions in your ML agents.

@keyhaven8151 9 дней назад

I have always had a question about mlagents: they randomly select actions at the beginning of training. Can we incorporate human intervention into the training process of mlagents to make them train faster? Is there a corresponding method in mlagents? Looking forward to your answer.

@srivaibhav5359 3 года назад

Hi, I was watching your video and I saw till 4 rth section and had a thought that if the agent's position is reducing from the button then give the agent half (0.5f) reward, and after it pushes the button give it full reward (1f). So the training will be faster, here is the code for checking if the agent is moving closer to the button or the food: public float dist; float distTemp = Vector3.Distance(destination.position, transform.position); if (distTemp < dist) { dist = distTemp; AddReward(0.5f); } else if (distTemp > dist) { dist = distTemp; AddReward(-0.5f); } Might Be helpful :)

@CodeMonkeyUnity 3 года назад

Yup you can add a reward if the agent is moving closer to the goal. However it should be a much smaller reward than that. With that value the agent gets more of a reward by moving closer for 2 frames than by pressing the button. So over time it might learn to just move closer and further away and repeat that for infinity.

@Daniel_WR_Hart Месяц назад

@@CodeMonkeyUnity I learned this the hard way back when I made a similar project in the early beta version of AgentML. Something more like AddReward(10f/(distance + 10f)) is a lot safer

@krakenchan 2 года назад

Ohh what happens when it's a number like 21 and they either keep the cards or discard but the can't go over or be short

@ashdev 3 года назад

Sir easy road v3 pro has some bugs i think please make a tutorial on it 🙏🥺

@devanshusingh3887 11 месяцев назад

please make a video on "How to implement multiagent from scratch?" with mlagents toolkit.

@turtlemaster890 3 года назад

@Code Monkey Can you show us the foodSpawner code? I can't figure out what to put in it.

@CodeMonkeyUnity 3 года назад

Just Instantiate the prefab and make sure the Agent knows where it is

@unpredictablememory 3 года назад

Hi, how can I access project files?

@tommyholmberg Год назад

I don't get it, you never reset the foodbutton. Been stuck on this for over an hour. OnEpisodeBeginEvent will not trigger the OnResetButton.

@SyedSaadanKaleem 3 месяца назад

Hi, can i get the source code of this project to practice imitation learning?

@stevenschiff6454 3 года назад

After I adjust everything in the config file for the next run how do I "update" the brain? I'm not sure about the commands to use for Python etc and what to do in the inspector in Unity.

@CodeMonkeyUnity 3 года назад

You can use --initialize-from=RUN_ID or --resume I covered that in the getting started video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-zPFU30tbyKs.html

@nighthawk5331 3 года назад

pls put some video on Android Scripts and tools 😊

@CodeMonkeyUnity 3 года назад

Pretty much everything I cover in every video works the same for Mobile. The only difference is the input system.

@SecretRecipeSir Год назад

Where can I download the code in the video screen

@jz9991z 3 года назад

Hi, so to enable GAIL and Behavioural Cloning, we simply just change the Config file. Right? I heard you mentioned about the Discriminator for GAIL. Do we need to write the code for it?

@CodeMonkeyUnity 3 года назад

Yes you just change the config, all the Agent code is the same.

@jz9991z 3 года назад

@@CodeMonkeyUnity Thanks a lot!

@bhaveshmevada8424 3 года назад

Please create a big series on game development from scratch

@CodeMonkeyUnity 3 года назад

I've made Flappy Bird and Snake from scratch. And all my courses are also complete step by step guides from start to finish

@shrodingerscat8940 3 года назад

I have a question If I start with bolt and then slowly move to c# will it be better or to direct learn c# And if I pick bolt will I have to start over for c# ?

@CodeMonkeyUnity 3 года назад

Start with whichever one you feel most comfortable. Bolt is perfectly fine to start with, just choose programmer naming and later on it will be easy to transition into C# unitycodemonkey.com/courses.php?c=visualscripting

@shrodingerscat8940 3 года назад

Tnx bro

@shrodingerscat8940 3 года назад

@@CodeMonkeyUnity your course is very nice

@mickmickymick6927 3 года назад

After about 20 seconds into training my agent from behavioral_cloning/gail, pytorch crashes and I get the error 'Class values must be smaller than num_classes'. There's no error in Unity. This doesn't happen if I remove behavioral_cloning and gail from the config file. Anyone know what's happening? Edit: I have narrowed it down to behavioral cloning, not gail

@ollihavilehto5701 3 года назад

I am having the same issue

@srnayak9342 3 года назад

Can you make a game for play store and app store

@watercat1248 3 года назад

because i by need to make bots for my fps game i have my qustion is what method do you the better ? my other qustion is passable to use both of this methods

@CodeMonkeyUnity 3 года назад

Depends a lot on the game, sometimes classic AI is the better approach and sometimes ML is better. Also depends on your familiarity with the tools, how familiar are you with classic AI? What about ML? Yes you can use both methods at once, like for example using ML to decide what to do and using classic AI to do that action.

@watercat1248 3 года назад

@@CodeMonkeyUnity ok form i need to make the game play wean i make the game play and the multiple same time i will check haw to make i bot system with help or not

@Guessde 3 года назад

EDIT: I think I got it now the problem is that the food Prefab is Spawning like every second :( Hello, can anybody help, I'm having trouble with the following method GetLastFoodTransform(), it´s giving me the following error. I must say that I'm pretty new at coding so forgive me if I´m doing something pretty stupid . NullReferenceException: Object reference not set to an instance of an object FoodSpawner.GetLastFoodTransform () (at Assets/Scripts/Food Collect/FoodSpawner.cs:29) FoodAgent.CollectObservations (Unity.MLAgents.Sensors.VectorSensor sensor) (at Assets/Scripts/Food Collect/FoodAgent.cs:42) Unity.MLAgents.Agent.SendInfoToBrain () (at Library/PackageCache/com.unity.ml-agents@1.7.2-preview/Runtime/Agent.cs:1048) Unity.MLAgents.Agent.SendInfo () (at Library/PackageCache/com.unity.ml-agents@1.7.2-preview/Runtime/Agent.cs:1320) Unity.MLAgents.Academy.EnvironmentStep () (at Library/PackageCache/com.unity.ml-agents@1.7.2-preview/Runtime/Academy.cs:557) Unity.MLAgents.AcademyFixedUpdateStepper.FixedUpdate () (at Library/PackageCache/com.unity.ml-agents@1.7.2-preview/Runtime/Academy.cs:43). And this is the code I put in that method, public Transform GetLastFoodTransform() { lastFoodTransform.localPosition = food.transform.localPosition; if(lastFoodTransform) { return lastFoodTransform; } else { lastFoodTransform.localPosition = new Vector3(Random.Range(-2f, +2f), 0, Random.Range(-2f, +2f)); return lastFoodTransform; } }

@asdfbaseqsfawefbaef7738 3 года назад

Great videos man but please, for the love of god, use dark mode

@CodeMonkeyUnity 3 года назад

Sorry I can't, dark mode burns my eyes

@asdfbaseqsfawefbaef7738 3 года назад

@@CodeMonkeyUnity Funnily enough, I have strong photophobia (kind of the exact opposite to what you experience) and I get horrible eye strain (or just don't see at all) when the screen is too bright...

@abdurrahmankamarulariffin1720 2 года назад

may i know what kind of ML agents version your download , is it can be done with 1.0.2 version?

@abdurrahmankamarulariffin1720 2 года назад

ML agents version package manager at your Unity3d

@CodeMonkeyUnity 2 года назад

I think I used the same version I installed in the first ML Agents video unitycodemonkey.com/video.php?v=zPFU30tbyKs

@laurasofiapadillacabrera4912 2 года назад

where do i found the course for mlagents?

@CodeMonkeyUnity 2 года назад

I don't have any ML course, just a bunch of free tutorials ru-vid.com/group/PLzDRvYVwl53vehwiN_odYJkPBzcqFw110

@AllExistence 2 года назад

So... Why didn't you use the GPU?

@bfk9636 2 года назад

I follow your step to set yaml,but I find this error: 'behavioral_cloning' is not a valid RewardSignalType'

@revilorere Год назад

Gotta make sure its indented correctly. Right now you have it underRewardSignalType but it should be under file name

@TD-uk9by 2 месяца назад

@@revilorere i didnt notice it and it could have take hours to fix, thank you

@laurasofiapadillacabrera4912 2 года назад

I'm sorry im new in this but i wanted to see how you relation every item with the script or how do you do the button to function and i don't see it in this video so i don't really understand what is happening do you have a step by step or the project?

@CodeMonkeyUnity 2 года назад

It's just a simple physics OnTriggerEnter ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Bc9lmHjqLZc.html

@laurasofiapadillacabrera4912 2 года назад

@@CodeMonkeyUnity How do you relate the prefab ball to the button? I need it hidden in the unity environment and link it from there or how do you make that link?

@CodeMonkeyUnity 2 года назад

@@laurasofiapadillacabrera4912 Can be a simple SerializeField Sounds like you need to learn the basics of Unity and C# before attempting Machine Learning which is a pretty complex topic ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-E6A4WvsDeLE.html ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-IFayQioG71A.html

@YoyoIsMeXD 7 месяцев назад

Where to get these config yaml files for machine learning?

@CodeMonkeyUnity 7 месяцев назад

From their GitHub and then I modified them

@barskose796 Год назад

Hi, are there any source code ?

@matheotheplayer405 Год назад

Where did you get that character from?

@CodeMonkeyUnity Год назад

It's from the Unity MLAgents samples, or you can just build it yourself, it's really just a cube

@matheotheplayer405 Год назад

@@CodeMonkeyUnity still looks better than just a cube

@highonr6392 2 года назад

please provide the scripts, it would be of great help...Thanks

@TYNEPUNK 2 года назад

my game runs incredibly slow when i try using gail and bc, any ideas why?

@TYNEPUNK 2 года назад

actually suddenly out of no where all kinds of training make unity run at 3fps, was quick only an hour ago, whats going on lol now i have to give up since its so slow

@TYNEPUNK 2 года назад

and it didnt follow my demo AT ALL, i think ML is still a bit poor unfortunately, its now pausing unity editor every 10 seconds.

@CodeMonkeyUnity 2 года назад

It should be slow while training, should be fast while just running a trained model. Maybe look in the profiler to see exactly what is slow?

@TYNEPUNK 2 года назад

@@CodeMonkeyUnity yes thanks, it went quick again not sure what was happening :) I almost got a little guy playing my game thanks to you!

@postsbyleon 3 года назад

Would it be possible to make "fair" Ai. The job of the AI would be to be an NPC. Could i make it fair so it does not hit like every shot or uses some moves that are just unbeatable. I read about this in the unity forum and they said it would not be possible.

@CodeMonkeyUnity 3 года назад

You can train an AI to the point where its perfect, then instead of using the very last brain, you use one of the previous brains. So it will be good but not perfect.

@postsbyleon 3 года назад

@@CodeMonkeyUnity thank you

@orsimhon133 3 года назад

It is possible to download the project in the video ?

@CodeMonkeyUnity 3 года назад

It's pretty simple so I didn't make a package for this one. You can grab the visuals from the official Unity ML-Agents examples.

@orsimhon133 3 года назад

@@CodeMonkeyUnity Please share the FoodSpawner & FoodSpawnerEnvironment Scripts for let us learn

@TechnicalBurhan 3 года назад

Hey Mr. Code Monkey I have a request to you to make a video about some checkpoints system. To be clear I am making a game and for efficiency and lag compression I want to disable rooms. I have some rooms and I only want some room to be rendered. I had an idea of a box collider 2d set to trigger but I don't know how to find the way the player is moving. For eg if the player is moving to the right I want to disable te room in the left. I don't know how to check which part of a collider is hit. Apart from that it is a box so I have no idea how to find where the player is going and reduce the lag as possible. Hopefully you get my point. incase any doubts please reply me. Hopefully I see a video on it. Btw Love your videos. Love from India

@CodeMonkeyUnity 3 года назад

Wherever you are moving the player you have the new player position and the previous player position, with those two you can get the movement vector and see which direction the player is moving in. Then for disabling rooms that is highly dependent on your specific use case. It can be as simple as going through all the rooms and disabling/enabling them one by one.

@TechnicalBurhan 3 года назад

@@CodeMonkeyUnity yeah sir they are actually in some game objects so I will just do setactive(false);

@berkinpeliter28 3 года назад

Hello, can you please show us FoodSpawner script?

@CodeMonkeyUnity 3 года назад

It instantiates the prefab, that's pretty much it

@berkinpeliter28 3 года назад

@@CodeMonkeyUnity Thank you, you're amazing. Keep up the good work!

@adelAKAdude Год назад

I almost copied the same code form the video, my AI looks like it's learning at first, but when reaching around an average of 1 for the reward in the learning curve, the AI be like, you know what, I think dancing around the button seems more fun, and the curve gets worst from there on, anyone faced such a thing ?

@xmacelive 3 года назад

I'm having a lot of trouble with the food spawner. I love the course idea, but without the project files, you waste a lot of time in the environment, and end up losing focus on the central topic that is ml agents. Anyway, if you can guide better about the food spawner, I would be very grateful.

@xmacelive 3 года назад

My food prefab always instantiates in the same environment, like a clone, all food objects instantiate in the same environment simultaneously, I have 15 environments in massive training, but all foods instantiate only in the main one, I need help to solve this, could you help me?

@Chrisbrei2502 2 года назад

Every time my agent has to make a decision, unity just doen't respond. After 10 seconds it continues until it has to make the next decision. But when I'm not using a recording, it runs smoothly...

@Chrisbrei2502 2 года назад

I noticed that I have way less episodes in way more steps (several thousand steps but only like 30 episodes) in my recording. I had to put max steps to 0, or else I wouldn't be able to record a single good episode. 1000 Steps is less then a second for me. Does anyone know why?

@Chrisbrei2502 2 года назад

root.DecideAction takes 197289ms, that's why Unity is not responding. Then it runs smoothly. Then again... GPU and CPU are

@erikm9768 3 года назад

switch to dark theme code editor please!

@CodeMonkeyUnity 3 года назад

Sorry but my eyes can't handle the dark theme

@JakeThe_Dog 3 года назад

@@CodeMonkeyUnity Blasphemy!

@matheotheplayer405 Год назад

How many iterations did it take to model be trained?

@myelinsheathxd 3 года назад

Hello @Code Monkey! I know this field is pretty to new to gamedev, and, requires lots of experience. In up coming videos, Can y make some masterclass about creating "custom tools" for ML.? For instance, my interest is in "character joint physics tools" for ML. To be clear, I want to create custom Brain in future for my research. But y'know, the editor and environment interactions take too much time .In this time, I can easy forget about working with ML brain and pay close attention to automation Physics engine tools for the sake of future. So I think, we should also pay close attention to common logics that saves time to interaction between ML brain and environment logics. Then, it will be easier to make efficient ML technology to use everyday game development time.

@CodeMonkeyUnity 3 года назад

You dont need tools specific for ML, everything that Unity already has already works with ML. You can create a Physics Joint then connect it to ML Actions and Observations. Check out the official example project, they have a Crawler example that uses physics joints to move a spider-like creature.

@codebreaker2590 Год назад

where is foodspawner script

@codeshelldev Год назад

There isn’t any, he wants that we do that on our own

@90tom_ 3 года назад

@tranquilmagister8481 3 года назад

:O did you just assume my species? 1:44

@RealNekoGamer 3 года назад

Problem is, if I suck at my game, the AI would imitate that.

@CodeMonkeyUnity 3 года назад

It would, but then you would enable Reinforcement Learning and it would quickly surpass your own skills

@RealNekoGamer 3 года назад

@@CodeMonkeyUnity So it's okay to potentially fail at playing my own games?

@__Rizzler__ 3 года назад

U copied serial apeist monkey see monkey kill from bbt right lol

@aes0p895 2 года назад

this code doesn't even work, tons of errors after manually typing it all after pausing a million times since you didn't post code. other videos were helpful but man, how frustrating...

@CodeMonkeyUnity 2 года назад

What errors? What version are you using? ML-Agents is constantly being updated so if you're not using the same version as me you need to look in the changelog to see what changed.

@funlightfactory6031 2 года назад

@@CodeMonkeyUnity Posting a link to the code would be helpful though.

@Diego0wnz 3 года назад

did you just assume Im a human being?

@codeshelldev Год назад

Hello, I have currently problems with a bug. As I was finished with saving the new .yaml, I run the ml agents and it sais: yaml.scanner.ScannerError: while scanning for the next Token found Character „\t“ that cannot Start any Token in „config/MTG.yaml“, line 24, column. But there is nothing… behaviors: MoveTo: trainer_type: ppo hyperparameters: batch_size: 10 buffer_size: 100 learning_rate: 3.0e-4 beta: 5.0e-4 epsilon: 0.2 lambd: 0.99 num_epoch: 3 learning_rate_schedule: linear beta_schedule: constant epsilon_schedule: linear network_settings: normalize: false hidden_units: 128 num_layers: 2 reward_signals: extrinsic: gamma: 0.99 strength: 1.0 gail: strength: 0.5 demo_path: D:\Unity\Games\ML_AI\Demos behavioral_cloning: strength: 0.5 demo_path: D:\Unity\Games\ML_AI\Demos max_steps: 500000 time_horizon: 64 summary_freq: 10000

@codeshelldev Год назад

Column 7.