Hey, just noticed that there is an error in the illustration at 3:10 as the agent sends an action to the env and the arrow with observation should be the other way around (agent gets obs from the environment)
This is a great video on many levels. There is beauty of mind at each part. The hardware design is sensitive to shape and function. The assembly is clean and elegant. The software part is a relatable story, even though the technical aspects are miles above my knowledge. The left-right mirroring on the joysticks to start, then machine slowly taking over shows the power of your methods.
Fantastic work my friend! I hope you get to continue to build projects like this. The future can be bright thanks to creative people and technical people like you.
I don't really know how cheat detectors work but potencially it could be harder to detect . However the time that would be needed to build the device and train an AI to play a complex game well enough to beat a good human player would probably end up being greater than the time needed to learn how to play the game yourself in the first place!
Hi . I didn't anticipate getting so many request for code and stl files so I didn't bother updating my website but I go tones of them . I am doing it right now . I am hoping to get everything available in a few hours . It's going to be quite messy as I was never planning to release it and people willing to build it themselves will have a fair amount of messing around to do .
Hi! I just found your channel on Reddit. I'm working on a learning platform with videos like yours. Still some work to do until the production version is ready. Until then I invite you to share your videos on reddit.com/r/VisualEngineering. I have subscribed to your channel. I hope to see you breaking 2K subs by summertime! Kudos!
Just came here from your reddit post, this is really cool. I still don't fully understand how it works, i thought maybe there was a camera pointed at the screen, and then you can calculate the angles of the plane and where the marker is to act accordingly. How are you doing it? Is the arduino given the angles from the program directly, and then you taught it some skills using the other stick?
No camera . All the info the neural network needs is collected directly in game . This is possible since I made it . The neural network then feed its outputs to the arduino which then translate them into joystick position and move the servos accordingly . The neural network run on the PC the arduino is basically just a slave .
The way I did it was by feeding the neural network its previous output . And then giving more reward or punishment depending if its current output is close to the previous one . Basically I tried rewarding having minimum change from one output to another . It did take a lot of training to start getting results but it worked .
For the push button the easiest would probably to use some sort of solenoid to press them . If you want to use the other joystick The existing design could be duplicated and modified to fit . The trigger buttons would need to pressed using servos if you want to keep there pressure sensitivity . In any case the base/frame would need to be redesigned to be able to hold these extra actuators .
Next Gen - AI powered Robotic Soldiers. completely self-sustaining / self-replicating / self-evolving machines of war. they even come with their own Agenda inside. a very smart way to end the world Matrix style. I don't appreciate having to take a blue pill one day to wake up inside an AI human incubator. :) it always starts with a cute A.I. teaching itself how to perfectly play a cute cube balancing game. then before you know it you find yourself enslaved by "MasterBot 7000MX"
I started training as a mechanic and went onto doing something that would probably be an equivalent to an mechanical engineering degree (I went to school in France) .
I don't mind people reposting short clips of my videos on social media as long as they tag me or give me proper credit for it . Unfortunately it is not always the case and I have better things to do with my time than chasing people . Thanks for letting me know .
