Тёмный

Machine Learning Prosthetic Arm Concept 

James Bruton
Подписаться 1,2 млн
Просмотров 208 тыс.
50% 1

I've been wanting to try this project for some time. I'm attempting to use machine learning to control a prosthetic arm from my other body motions by training it through various postures while wearing a motion capture suit.
With thanks to:
Ogma Corp: ogma.ai/
Cool Components: coolcomponents.co.uk/
ROBOTIS: bit.ly/3Az11Wr
DYNAMIXEL XM540-W270-T: bit.ly/2TF97Mj
DYNAMIXEL Shield for Arduino MKR series: bit.ly/3yp0tQW
Filament from: www.3dfuel.com/
You can support me on Patreon or buy my Merchandise:
***************************
Patreon: / xrobots
Merchandise: teespring.com/stores/james-br...
***************************
Affiliate links - I will get some money of you use them to sign up or buy something:
***************************
Matterhackers 3D printing supplies: www.matterhackers.com?aff=7500
Music for your RU-vid videos: share.epidemicsound.com/xrobots
***************************
Other socials:
***************************
Instagram: / xrobotsuk
Facebook: / xrobotsuk
Twitter: / xrobotsuk
***************************
CAD and Code for my projects: github.com/XRobots
Huge thanks to my Patrons, without whom my standard of living would drastically decline. Like, inside out-Farm Foods bag decline. Plus a very special shoutout to Lulzbot, Inc who keep me in LulzBot 3D printers and support me via Patreon.
HARDWARE/SOFTWARE
Below you can also find a lot of the typical tools, equipment and supplies used in my projects:
Filament from: www.3dfuel.com/
Lulzbot 3D Printers: bit.ly/2Sj6nil
Lincoln Electric Welder: bit.ly/2Rqhqos
CNC Router: bit.ly/2QdsNjt
Ryobi Tools: bit.ly/2RhArcD
Axminster Micro Lathe: bit.ly/2Sj6eeN
3D Printer Filament: bit.ly/2PdcdUu
Soldering Iron: bit.ly/2DrNWDR
Vectric CNC Software: bit.ly/2zxpZqv
Why not join my community, who are mostly made up of actual geniuses. There’s a Facebook group and everything: / 287089964833488
XROBOTS
Former toy designer, current RU-vid maker and general robotics, electrical and mechanical engineer, I’m a fan of doing it yourself and innovation by trial and error. My channel is where I share some of my useful and not-so-useful inventions, designs and maker advice. Iron Man is my go-to cosplay, and 3D printing can solve most issues - broken bolts, missing parts, world hunger, you name it.
XRobots is the community around my content where you can get in touch, share tips and advice, and more build FAQs, schematics and designs are also available.

Наука

Опубликовано:

 

23 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 443   
@RonaldFinger
@RonaldFinger 3 года назад
Honestly this would be great for a Grievous or Goro cosplay!
@RobReynolds
@RobReynolds 3 года назад
Or a transformer based on a Fiero.......
@Matty.Hill_87
@Matty.Hill_87 3 года назад
If someone managed to use this successfully in a goro cos play that would be insane
@Avetho
@Avetho 3 года назад
_"A fine addition to my collection!"_
@fryreartechnology7611
@fryreartechnology7611 3 года назад
It has to have the spinning hands to make it just right lol.
@aleisterlavey9716
@aleisterlavey9716 2 года назад
I prefer something more Doctor Octopus style XD! But are you gonna stuff that arm with sensors, tools and gadgets? Please stuff it with Gadgets....Laserpointer, mini vacuum cleaner, Walkman, nerf gun, abacus, ...
@techmouse.
@techmouse. 3 года назад
**thump** **thump** "No, bend more in this direction." **whirring noises** **thump** **thump** "Stop jerking so much." **thump** **thump** **whirring noises** Imagine what his neighbors think when they hear that coming from his attic.
@jdmeesey
@jdmeesey 3 года назад
This is exactly the kind of thing I’ve wanted to do since I mistakenly choose to focus on computer engineering in Jr. High. 🙏 Thank you so much for letting me live the science vicariously through you 😂
@experimentalcyborg
@experimentalcyborg 3 года назад
Changing careers is hard but not impossible. Make sure you do hobby projects in your desired field and document them properly, it'll help you get a job later!
@ashwin372
@ashwin372 2 года назад
@@experimentalcyborg can you please explain more about the documentation part?
@experimentalcyborg
@experimentalcyborg 2 года назад
@@ashwin372 If you document your private projects with the same quality as you are expected to document a professional project, you can use them to impress employers. "Holy shit if this is how he documents is hobby code, his work must be amazing"
@kayakMike1000
@kayakMike1000 Год назад
Junior high has computer engineering focus? What?
@Scott_C
@Scott_C 3 года назад
Very cool! Using EEG (brain electric signals) combined with an AI is more or less what is being done by Neuralink. EMG (muscle electric signals) is also being used for moving prosthetics. Seeing these topics explored here is exciting! I can't wait for what's next.
@jamesbruton
@jamesbruton 3 года назад
Still planning my next move. I want to see what other suggestions there are on the video and have some time to think about what's practical.
@CLIFTON-qf3ng
@CLIFTON-qf3ng 3 года назад
@@jamesbruton Can this project be made into a much bigger project,(like the hacksmith industries' alien loader) with higher budget, crew and longer time. I would love to see something like this as opensource, cause we as humans are not that far.
@CLIFTON-qf3ng
@CLIFTON-qf3ng 3 года назад
This wouldn't just benefit people with disability, but also people working with heavy machinery. As they could use a much stronger and buffed version of this arm for lifting heavy stuff or working in un-survivable environments(such as deep sea and space).
@Taygetea
@Taygetea 3 года назад
I get what you're saying, but I want to nitpick: generally EEG as a term is restricted to noninvasive, through-the-skull electrical signal detection, not the more direct route Neuralink is taking.
@Scott_C
@Scott_C 3 года назад
@@Taygetea yeah that's why I tempered my statement with. "more or less" I just wanted brevity as this is just a RU-vid comment.
@theexo-engineer9603
@theexo-engineer9603 3 года назад
You’ve done it mate 1Mil Awesome job. Iv been watching you for years and you are continuously improving your content and builds. Keep it up. Love your work
@AshesWorkshop
@AshesWorkshop 3 года назад
We’re one step closer to getting a real Battle Droid. Roger roger.
@Zeithri
@Zeithri 3 года назад
Roger Roger
@demonite2473
@demonite2473 3 года назад
Roger Roger
@blizzard4025
@blizzard4025 3 года назад
Roger roger
@fryreartechnology7611
@fryreartechnology7611 3 года назад
Roger Roger
@irnoble6832
@irnoble6832 3 года назад
Roger Roger
@tboicelli
@tboicelli 3 года назад
Using Quaternions and spatial rotation will address your gimbal lock (where the axis rotations get confused when aligned with another axis when moved)
@paul_vantieghem
@paul_vantieghem 3 года назад
Rotation matrices can also avoid the numerical singularities which we experience as gimbal lock, and they are much easier to understand so maybe he could start with that. The only downside is that rotation matrices carry 9 numbers instead of 4 for quaternions.
@daveabittner
@daveabittner 3 года назад
The problem is, his arm is quite literally a physical gimbal. It's a limitation of the anatomy to an extent, and as a result (if you want something that is attached to your arms) you will have to duplicate sensors I believe in different orientations.
@robertmorby3694
@robertmorby3694 3 года назад
ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-hhDdfiRCQS4.html you might like this
@robertmorby3694
@robertmorby3694 3 года назад
@@paul_vantieghem ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-hhDdfiRCQS4.html
@JinKee
@JinKee 3 года назад
Geometric Algebra has a concept of bivector rotations which is also useful
@codingvio7383
@codingvio7383 3 года назад
James: *making an exoskeleton* CIA: "Interesting"
@deadlokIV
@deadlokIV 3 года назад
Thank you _so much_ for this - been working on a conceptually identical project for a few years now (but on the tensorflow/cuda level and non-public) and this honestly was a huge asset to those works. Really appreciate the upload - you may have just supercharged a bunch of efforts to make the concept closer to a deployable reality thanks to a lot of the ideas you have introduced here. All the best!
@iAmTheSquidThing
@iAmTheSquidThing 3 года назад
This is pretty impressive for a few minutes' training on a microcontroller with limited sensors. I wonder what it could do with something like an Xsens mocap suit worn for a few days and trained on a powerful GPU.
@lnz5660
@lnz5660 3 года назад
Dam he works quick I've been working on this exact same project for 2 years. Definitely gonna take some stuff from this video.
@reececrook7021
@reececrook7021 3 года назад
james i love you content, i'm 14 and i love build things rn i'm trying to learn how to code for aurdino and i hope that i can be as good as you one day
@Matty.Hill_87
@Matty.Hill_87 3 года назад
Stick with it and you'll get there dude
@aykutcoskun6092
@aykutcoskun6092 3 года назад
Go on champ! You will be even better than him one day
@endthefighting
@endthefighting 3 года назад
You can, and you will, mate :)
@ElevenElevenAus
@ElevenElevenAus 3 года назад
Great video again, please keep up the work as it's so interesting to watch the progression while you piece all the components together. Thank you.
@ClickItYT
@ClickItYT 3 года назад
It's amazing to see that 3D printing protheses at home becomes consistently easier.
@richardson100489
@richardson100489 3 года назад
I really hope you continue this project! It could end up helping a lot of people.
@Nobe_Oddy
@Nobe_Oddy 3 года назад
HAPPY 1 MILLION SUBS JAMES!!!! AND WHAT A GREAT PROJECT TO START HEADED FOR 5 MILLION!!!!
@magnusjagerstrom4388
@magnusjagerstrom4388 11 месяцев назад
This is really cool, can’t wait to watch what you are doing next.
@mikegruber7131
@mikegruber7131 3 года назад
WOW. simply amazing. Keep up the great work
@H34...
@H34... 3 года назад
Awesome! loving this project already. Also congrats on 1 Mil
@CletoFrost
@CletoFrost 2 года назад
phenomenal, hoping to see more!
@mvwouden
@mvwouden 3 года назад
You could consider Deep Reinforcement Learning with added imitation learning in the reward function. PPO and DDPG are some solid options if you are considering. For my thesis I'm working on the control of an active transfemoral prosthesis during normal walking using DRL.
@inventorbrothers7053
@inventorbrothers7053 2 года назад
Very cool. I'm really impressed with the results you got! You are a super skilled individual.
@4louisMC
@4louisMC 2 года назад
Congrats on one mil!
@rohithm6280
@rohithm6280 3 года назад
Congrats on 1 million James, plz make video on your 3d modeling
@maywah1276
@maywah1276 Год назад
Thank you so much James, may god bless you and your family, and youtube.
@amirhm64
@amirhm64 3 года назад
awesome stuff as always James
@hesalovelybuoy5944
@hesalovelybuoy5944 3 года назад
Cool! Carry on with the useful robot project too
@czateu1391
@czateu1391 3 года назад
Just noticed you are already 1million subscribers, congratulations James!!!!
@Isambardify
@Isambardify 3 года назад
IMUs are so fiddly to get working if you want anything more complicated than "did the sensor tip." Have you looked at the 9 axis versions with magnetometers? You might be able to filter out the roll/pitch confusion. I'd love to see a whole series making a full IMU digital motion capture suit if you wanted to make one.
@lindonwatson5402
@lindonwatson5402 Год назад
much excitement for this series
@shpluk
@shpluk 3 года назад
as always amazing!
@LLJW4
@LLJW4 3 года назад
This is awesome! Great start!
@robotcantina8957
@robotcantina8957 3 года назад
Another cool project, you have me hooked. Congratulations on the 1M !!!!!
@OsoPolarClone
@OsoPolarClone 2 года назад
Awesome project!!!!
@muneeb-khan
@muneeb-khan 3 года назад
What a wild project. This is so cool!
@Saxandviolins
@Saxandviolins 3 года назад
So amazing again, keep up the good work!
@fireinnature9445
@fireinnature9445 3 года назад
Wow Just Amazing!
@Will_Huff
@Will_Huff 3 года назад
Excellent demonstration with your prototype!
@Skipperrrrrrrrrrrrrrrr
@Skipperrrrrrrrrrrrrrrr 3 года назад
CONGRATS ON 1 MILLION JAMES 🎉🎉🎉
@isthissiddh
@isthissiddh 3 года назад
CONGRATS ON THE 1M!!!
@Mechabjornis
@Mechabjornis 2 года назад
Functionality aside, this is the best looking stuff you have designed, imo. Sleeker and seems even more refined. Great work and presentation, as allways !
@micah4932
@micah4932 3 года назад
This was an insane project and it would be amazing to see this used for actual disabled people in the future
@masterpig5s
@masterpig5s 3 года назад
Very cool to see it gone into
@jamesbruton
@jamesbruton 3 года назад
Thanks!
@DavidSpencer22
@DavidSpencer22 2 года назад
Would love to see an open source build for an assisted walking device, exoskeleton. Possibly for older people with walking troubles. Thanks for your great content!
@stefanguiton
@stefanguiton 3 года назад
Great stuff!
@sanoopsiby8296
@sanoopsiby8296 2 года назад
You never sieze to amaze me
@stevesloan6775
@stevesloan6775 2 года назад
Awesome upload
@linconwalker8329
@linconwalker8329 3 года назад
Thank you so very much for sharing your process and results. I have been thinking of working on a similar concept, but utilising fpv quad flight controller boards, as they work on all axis' in a very small form factor. They could be used to record the data of one limb, and also to output the data to manually control a prosthetic. The flight controllers are small enough to attach just below each point of articulation on the "learning" limb. Combined with your outlined machine learning, they should then be able to output motion commands to result in a more natural movement style.
@alvaro4186
@alvaro4186 3 года назад
1 Million subs! I've been watching you since your The RPF days. Congratulations!
@rlizardo57
@rlizardo57 2 года назад
Great experiment.
@StevenIngram
@StevenIngram 3 года назад
After thinking about this for a while, I realized that you had already designed a pretty good arm concept for what you're trying to do. Remember the Performance Robots? They had shoulders with a good range of motion, elbows, forearms that rotate and grippers. Anyway, it just seems like those arms would have the range of motion to adhere more consistently to the trained behavior.
@thescienceysworkshop5368
@thescienceysworkshop5368 3 года назад
congratulations for 1 million subs , mr james! i hope your channel grows even more
@Waitwhat469
@Waitwhat469 2 года назад
Stuff like this is why subscribing and being a Patreon of you is such an easy choice.
@lsav1085
@lsav1085 3 года назад
Cool idea
@iiinsaiii
@iiinsaiii 3 года назад
Congratulations on the 1 million subscribers 👏👏👏
@eunoia921
@eunoia921 3 года назад
Congratulations for 1 million subscribers. You DESERVE more. 👏👏
@gusobrien8491
@gusobrien8491 Год назад
I have no idea how this man has this many ideas and consistently puts out these insane videos
@CreepyChappy
@CreepyChappy 3 года назад
You’re my favorite kind of nerd !!!!!!! Love your stuff bubba
@TheMagneticDude
@TheMagneticDude 3 года назад
Congrats on 1mil!
@dumbtex6107
@dumbtex6107 2 года назад
you deserve so much more
@thewatcherofpaintdry9288
@thewatcherofpaintdry9288 3 года назад
Keep up the good work
@easyBob100
@easyBob100 3 года назад
This could really update your 2 leg walking robots. Train the AI on walking/standing still motion + remote control input. Cool stuff man!
@bonzogamer6966
@bonzogamer6966 3 года назад
Good start.
@imxheartz7846
@imxheartz7846 3 года назад
this is really cool
@balkiprasanna1984
@balkiprasanna1984 2 года назад
You're just amazing. How come this video didn't get a million views is just beyond my comprehension?
@davidlong2691
@davidlong2691 3 года назад
Always wanted some Doc Ock arms; this is the way to do it :) Nice work!
@EdgeImpulse
@EdgeImpulse 3 года назад
Awesome work, James!
@NicksStuff
@NicksStuff 3 года назад
Complex yet simple
@fightme5543
@fightme5543 2 года назад
This plus the muscle monitors could be amazingly unique. Not only would you have accurate motor controls, but unique situation awareness relating strength of signal and force feedback. This would allow someone the ability to differentiate between crushing a brick and shaking a hand whereas currently gripping is much more of an on off signal.
@JarydGiesen
@JarydGiesen 3 года назад
This is just damn cool
@Kevin-ls9zs
@Kevin-ls9zs 2 года назад
You make me wonder why I’m even in college for mechanical engineering when I could have just done this type of stuff for a living. You have the dream job I wish I could do stuff like this everyday instead I’m doing math and memorizing formulas and stuff
@jaysonbunnell8097
@jaysonbunnell8097 3 года назад
This is so cool! can't wait to see what you do with brain signals or something.
@r.iyushofficial5318
@r.iyushofficial5318 3 года назад
Awesome 👌
@MIGuy
@MIGuy 3 года назад
Excellent!
@dynorat12
@dynorat12 3 года назад
looks good
@KnightsWithoutATable
@KnightsWithoutATable 3 года назад
This project reminds me of how the multiple brains in an Octopus are thought to function.
@Matty.Hill_87
@Matty.Hill_87 3 года назад
Octopus have multiple brains? That explains how they're so good at problem solving
@this_commenter_had_a_stroke
@this_commenter_had_a_stroke 3 года назад
@@Matty.Hill_87 yup, and about 60% of their nervous system is located in their tentacles, so essentially each tentacle has a mind of it's own, which makes the octopus an excellent multitasker. also, scientists have observed how a severed tentacle is still able to move, and do stuff, and have even been seen grabbing and bringing food to where the octopus's mouth should be (if the tentacle was still on it)
@Matty.Hill_87
@Matty.Hill_87 3 года назад
@@this_commenter_had_a_stroke that's crazy, I'm going to have to watch some Documentarys now
@KnightsWithoutATable
@KnightsWithoutATable 3 года назад
@@Matty.Hill_87 Cephalopods are weird and almost completely alien when compared to other animals. Granted, chordates are pretty freaky too. Sharks are literally all teeth on the outside, avians/dinosaurs grow super fast, and then there are mammals.
@gearandalthefirst7027
@gearandalthefirst7027 3 года назад
@@KnightsWithoutATable no source needed for mammals being freaks XD
@netgeek3010
@netgeek3010 3 года назад
Longtime member congratulations on hitting a million subs.
@Tsukay.
@Tsukay. 3 года назад
Very interesting!
@zeekjones1
@zeekjones1 3 года назад
Now to scale it up, add the rest of the limbs, an omni treadmill, and make a mech. Can use the learning as a feedback for a 'fly by wire' controller, even if you have all your limbs. Theoretically if it can predict your movements, it would react quicker than a direct 1:1 controller, with enough training.
@CommonApathy
@CommonApathy 2 года назад
Would probably more like, assume I'm still doing what I was doing and continue it until you get a different input, rather than predict the future.
@anthonyvillanueva4500
@anthonyvillanueva4500 3 года назад
this one i love very cool
@hardiknayyar7057
@hardiknayyar7057 3 года назад
Hey, I like the videos were you give conceptual knowledge in deep it helps me a lot please do these in depth video explaining telling about each and every step in detail no matter how long is the video I like watching long videos
@swannschilling474
@swannschilling474 3 года назад
OMG this is sooooo cool!!!! 😀
@d-channel5841
@d-channel5841 3 года назад
Very cool
@SentinalSlice
@SentinalSlice 3 года назад
You should definitely make a choreographed slow motion fight. Have sensors on one arm and set the robot arm to react to those sensors. Then make the outputs be motions that would block slow punches and attacks. That would look really cool.
@Gormfork
@Gormfork 3 года назад
I designed something like this in middle school, cool to see someone with the money making it real.
@ironman12328
@ironman12328 3 года назад
I see absolute no one so far, sooo: Congratulations for reaching finally the 1 Million Mark you deserve it sooo much and I hope the Next Years are going to be Interesting AF and also Awesomer, Better and much more Complicated haha again Congratulation for the 1 Million
@jamesbruton
@jamesbruton 3 года назад
Thank you so much 😀
@VideoStefan17
@VideoStefan17 3 года назад
awesome!!
@Abishek_Muthian
@Abishek_Muthian 3 года назад
Great project as always! I was wonder if pose detection would have been easier than manually encoding the position of the arms, legs for training and inference.
@andrewslater6846
@andrewslater6846 3 года назад
We should make public research like this more common! For people who are serious about researching new technology or ideas but A. don't have access to equipment, B. aren't interested with getting a doctorate degree and doing research at an academic institute, and C. have a practical knowledge background on use cases (aka real world). There is lots of untapped potential innovation to be had out there in the world!
@bhativatsalsinh
@bhativatsalsinh 3 года назад
Congratulations for 1 million subscribers 😎
@kavindulakshitha9732
@kavindulakshitha9732 3 года назад
Hey you have 1M subscribers. Congratulations 👍👍👍👍👍
@christopherashford822
@christopherashford822 3 года назад
Seems if you walk around for a day or more normally training the algorithm and switch it to playback, it would probably surprise you how good it is.
@_Piers_
@_Piers_ 3 года назад
Happy Gold Play Button James :)
@rebeccac4573
@rebeccac4573 3 года назад
James hit 1 Million Subscribers great job. 😊
@kingmasterlord
@kingmasterlord 3 года назад
yes james, this is what I've been talking about! you can 3D print a Dexter's Laboratory exosuit if you throw in some aluminum extrusion. just make opendog longer and you're done!
@laureven
@laureven 3 года назад
Big things have small beginnings :) ....Awesome Video
@joecro15
@joecro15 3 года назад
Nice dude,
@syphusjameswell909
@syphusjameswell909 2 года назад
this is veryy cool
@0508toya
@0508toya 2 года назад
당신의 노력은 항상 빛을 발합니다👍
@An_Achorn
@An_Achorn 2 года назад
you the really life dr.octavius
Далее
How this Active Gyroscope Balances
18:18
Просмотров 257 тыс.
This Car Travels Farther Than You Push It
13:42
Просмотров 2,9 млн
Our BIGGEST project yet! (SPIDER MECH!)
29:27
Просмотров 11 млн
I let people control this robot
28:57
Просмотров 108 тыс.
Recreating CIA Spy Technology
17:26
Просмотров 16 тыс.
Why this Omni-Wheel is Really Weird
17:29
Просмотров 2,7 млн
I Made a Robot Arm... in the Middle of my Room!
14:42
The Robot-Arm Prosthetic Controlled by Thought
5:05
Peristaltic locomotion device
10:07
Просмотров 115 тыс.
The Microspheres Hiding in your Phone's Screen
11:09
Просмотров 782 тыс.
Samsung laughing on iPhone #techbyakram
0:12
Просмотров 1,2 млн
ОШИБКИ НА ANDROID 2
5:13
Просмотров 25 тыс.