Тёмный

AI Data Glove: Somatic 

Zack Freedman
Подписаться 559 тыс.
Просмотров 178 тыс.
50% 1

I turned my favorite hand into a keyboard!
Tools/software used: TensorFlow Lite, Fusion 360, Prusa i3 Mk3S
Design files, training utility, and pretrained network: github.com/ZackFreedman/Somatic
Assembly instructions: www.instructables.com/id/Soma...
Project page: hackaday.io/project/169297-so...
P5 data glove video: • P5 Data Glove! Unboxin...
My wearable computer is a modified Epson Moverio BT200. Exactly one (1) orange was harmed in the making of this film.
Voidstar Lab is accepting prototyping jobs and sponsors! Send me a message for more info.
Written by yours truly. Camera and production by my lovely wife Brooke.
Licensed material:
Power drill SFX: ZapSplat
Interference SFX: Partners in Rhyme
Dramatic horror music: Fesliyan Studios
Background music - "Hazy After Hours": MixKit
TV glitch stock footage: Videezy
Copyrighted material, excerpted for educational purposes:
Johnny Mnemonic: Sony Pictures
Minority Report: Paramount

Наука

Опубликовано:

 

6 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 513   
@krissisk4163
@krissisk4163 3 года назад
Shut up and take my mon....oh, links to the project files. Sweet. That'll do.
@Aethelbeorn
@Aethelbeorn 3 года назад
Shut up, like and subscribe =)
@hydrolisk1792
@hydrolisk1792 3 года назад
Hahahahaha this is great!
@vystorm
@vystorm 3 года назад
Anyone feel like making me one?
@astikjadhav3544
@astikjadhav3544 3 года назад
@@vystorm yess have you started already?
@tristanvliet
@tristanvliet Год назад
Did you do it
@racebannon2708
@racebannon2708 3 года назад
"Now you're playing with POWER!"
@ZackFreedman
@ZackFreedman 3 года назад
It's so bad
@Bmacthecat-uy8ou
@Bmacthecat-uy8ou 3 года назад
@@ZackFreedman no it isnt
@kaislate
@kaislate 3 года назад
This is why I came here.
@Cassocian
@Cassocian 3 года назад
Mechanically simplistic, sleek, ergonomic, fairly sexy, and actually useful tech gear. Hat's off to you maker pro on this super project. Thanks for sharing it and for the massive amount of time you spent on it as well.
@elicage5010
@elicage5010 3 года назад
"this is my second favorite hand" X'D lol
@leonardovigilatodemorais7280
@leonardovigilatodemorais7280 3 года назад
the third is his least favorite coz of the place it is in
@andrewlhoover
@andrewlhoover 3 года назад
This is cool as hell! Would be interesting to setup two of these to decode sign language into a TTS system.
@ErichWidemark
@ErichWidemark 3 года назад
I was thinking something similar - get the glove to decode asl fingerspelling, already universal. Though you might have to put a sensor on the thumb too?
@mrtheblackarrow
@mrtheblackarrow 3 года назад
@@ErichWidemark Unfortunately this would not work. As he stated, he is not representing his hand in the 3d space. This could interpret some signs but even with just the alphabet, the letter R requires the crossing of two fingers, which this could not detect. Remember it only detects whether or not the finger is extended. Please correct me if any of this info is inaccurate. I may have completely misunderstood the video. I am not an engineer, just a CompSci Major who wishes he was. :p
@ThadStarner
@ThadStarner 3 года назад
@@mrtheblackarrow switching to analog sensors and doing recognition per fingerspelled word instead of letter might solve the problem. 1) for a letters like R MNTA&S some fingers have slightly more bend than others. Hopefully the analog sensors would pick that up. 2) because not all letters can follow all letters in English, a certain amount of disambiguation would occur when recognizing at the word level.
@mrtheblackarrow
@mrtheblackarrow 3 года назад
@@ThadStarner I agree completely. It is definitely possible to build a device that would allow you to do ASL with some level of accuracy, however the device shown in the video is not capable of it without a serious rework.
@ThadStarner
@ThadStarner 3 года назад
@@mrtheblackarrow I suspect using analog hall effect might be sufficient for fingerspelled words with a limited vocabulary.. I might have a student try it for a class project; we have some good resources for it. Just search on my name and GT2k at scholar.google.com or "Towards a one-way American sign language translator' if you're interested in this space.
@notimportant7682
@notimportant7682 3 года назад
actually impressive and the aesthetics are off the charts
@notimportant7682
@notimportant7682 3 года назад
though I would have gone all black
@daniel-pablo
@daniel-pablo 3 года назад
I'd love to see more about that head mounted computer
@ZackFreedman
@ZackFreedman 3 года назад
You're gonna love tomorrow's video.
@KnightMirkoYo
@KnightMirkoYo 3 года назад
Zack, you've got to try expanding human sensory abilities! Ideas may include pairing vibrating motors (or modern taptic modules) with infrared sensors (to expand eyesight), microphones (to hear danger even in headphones, or for deaf people), distance sensors (to feel when someone/something is behind your back), EM field sensors, you name it. You can make a whole range of actually useful wearables.
@tibfox
@tibfox 3 года назад
Maaaan im happy that RU-vid suggested your channel ! Love your creativity, editing and the detail of information you transport with your videos!
@jonahhauser8588
@jonahhauser8588 3 года назад
I just wanna say, you sir, are an inspirational force! I'm still in high school, but I've always wanted to make wearable tech, and your videos keep making me want to go out and research how to build something like your HUD or glove on a low budget! Keep it up, man. You're awesome.
@silenttoke
@silenttoke 3 года назад
2:53 is when I realized I'm joining the notification crew! I just came across your channel this morning and have been hooked. I've binge watched every video of yours besides the ones over an hour long. Haven't laughed this hard or been so happy to find a new channel in quite some time. Thank you for your content my new friend!
@ErichWidemark
@ErichWidemark 3 года назад
Truly revolutionary! First time I’ve seen something this elegant. Been waiting for something like this in vr to allow nursing students and Med students to do skills in augmented reality with hand movement.
@xxportalxx.
@xxportalxx. 3 года назад
I'm impressed by how good it looks, something between a motorcycle glove and a lifting glove. The flexibility of the connection is amazing as well! Enabling it to connect to any device as if it were a wireless keyboard is dope!
@wii3willRule
@wii3willRule 2 года назад
This was my introduction to your channel, and to this day still my favorite video of yours
@somoysubandhu789
@somoysubandhu789 3 года назад
It just feels awesome to see someone do projects normal people usually dream/dreamt of doing and not to mention that Zack is achieving these dreams with utter perfection! Way to go my dude. Hoping to see more awesome contents like these.
@IncenderyLemon
@IncenderyLemon 3 года назад
I'm shocked you don't have more views and subscribers, your projects are both intrinsically amazing and also presented in an extremely engaging and educational way. keep up the awesome work
@peterstephen1005
@peterstephen1005 3 года назад
This is so incredibly cool. Thank you so much. The hall sensor idea is just genius.
@H411UCIN093NIC
@H411UCIN093NIC 3 года назад
You are seriously my favorite RU-vidr. Thanks for helping me level up on my tech journey!! Happy New Year!!
@DefaultFlame
@DefaultFlame 2 месяца назад
Cool, looks good, is actually functional and useful. Probably one of the best gadgets on your channel, though I have quite a few more videos to watch.
@deepwoodsengineering3763
@deepwoodsengineering3763 3 года назад
"It's cyber-punk as f*ck!" I'm hooked, buddy. Good to meet you lol
@EyeKnowRaff
@EyeKnowRaff 2 года назад
Your production quality has definitely upgraded from then to now. Nice work.
@neoncyber2001
@neoncyber2001 3 года назад
Using the hall effect sensors instead of the flex pots was ace! You will also never need to replace a worn out sensor so +10 to durability. I need an RNN for chord and note permutation, and you gave me that last bit of data I was missing. Awesome project!
@condormusicman
@condormusicman 3 года назад
I’m currently a 2nd year computer engineering student. I appreciate you sharing your work with the Internet. Thank you. 🙂
@hydrolisk1792
@hydrolisk1792 3 года назад
I did this simular thing in 2010 with an old power glove and a gyro. Worked our really well. Had a keyboard on the forearm as well. Never thought about using HE sensors though! Pretty awesome and very useful design you have here! Well done, very well done.
@blackstyme
@blackstyme 4 месяца назад
I was trying to find a way to build this type of glove for AR typewriting, and you just give me the way to do it 🤩 thank you so much! now it is time to learn some electronics
@gumbo64
@gumbo64 3 года назад
It's been a while since I've been this blown away. Hats off to you!
@TalismancerM
@TalismancerM 2 месяца назад
I once did a chording keyboard in a glove using contacts made of conductive thread. I combined this with the bed-sensors from a Powerglove. That was pre-2000. Modern materials make all this a lot more tenable.
@no_360scope9
@no_360scope9 Месяц назад
This is not just engineering, but actually so artisful. I am so inspired by this
@R3DE3MER
@R3DE3MER 3 года назад
This could have so many more applications as a practical use gesture interface. Damn good work and clever use of magnets!
@jarredelijah6803
@jarredelijah6803 Год назад
Thank you for not being greedy and sharing these to us. We are humbled
@charliecarpenter2840
@charliecarpenter2840 3 года назад
Subbed, first time I have seen a diy hud and interface that looks like a practical tool and not a gimmick or toy
@jbuist
@jbuist 3 года назад
I love this video, man. Love the work you're doing!
@ivancorrea5110
@ivancorrea5110 3 года назад
Wow man, today I discovered your channel and it's awesome! Already watched half of your videos xD keep up the great job !!! Cheers from Chile !!!!
@mosta5
@mosta5 3 года назад
Great work . Looks nice and more practical than most of other designs
@i8screaminmoose
@i8screaminmoose 2 года назад
Holy crap, this whole project is amazing... I don't think I could walk around in public with the setup.... but I like the idea of a HUD greatly
@Excalibur32
@Excalibur32 3 года назад
Sick project, thanks for sharing!
@xaimeglez74
@xaimeglez74 3 года назад
Zack, you are by far the coolest guy! Love the stuff you do on your channel!
@Allmixedupworksandmore
@Allmixedupworksandmore 7 месяцев назад
Love it! Thank you for sharing!
@lopypop
@lopypop 3 года назад
This was incredible! Thank you for sharing!
@hakatox
@hakatox 3 года назад
This is amazing! I'm totally interested in learning about this more!
@DecoyProductions
@DecoyProductions 3 года назад
Just found your page. Watched the "What's on my face!? video before this. Really good channel you got. Subscribed and am gonna be clicking watch on all your new videos! Thanks.
@meeponinthbit3466
@meeponinthbit3466 3 года назад
By far the best glove I've seen... Awesome 😎.
@nevyn041
@nevyn041 3 года назад
I would wear this everywhere. Looks amazing.
@Eden_Maker
@Eden_Maker 2 года назад
Absolutely amazing.
@KlauV
@KlauV 3 года назад
You are awesome! I'm glad RU-vid imposed me to watch one of your videos lol Your humor is as good as the information you present,,, now I feel I need to finish one of my projects
@Taernsietr
@Taernsietr 3 года назад
Holy shit, this is one of the most interesting projects I've seen! I'm fairly new to microcontrollers and this type of diy stuff, but I might start learning neural networks earlier than planned because of it lol
@rutvikpanchal466
@rutvikpanchal466 3 года назад
I cannot believe dude, i am working on this project using the exact solution you are using for past 3-4 months. I came up the idea of using a hall effect sensors when i disassembled an Xbox controller and found out that they use hall effect sensors for the triggers. I am using the Memsic MMC5603NJ sensors.
@zanekelbrick9158
@zanekelbrick9158 3 года назад
Wow, this project is insane - nice job man, might have to build my own Somatic too.
@qazimashhood
@qazimashhood 3 года назад
Man this is amazing. I loved it, I am definitely going to replicate it. This will teach me a lot
@ZackFreedman
@ZackFreedman 3 года назад
Thanks a lot! This isn't the easiest project to replicate, but all the documentation, code, and models are ready for you!
@adrianmarianpopoviciu215
@adrianmarianpopoviciu215 3 года назад
I always wonder how people got time and money to do amazing stuff like this. Cool project, looking into replicating it as well.
@ZackFreedman
@ZackFreedman 3 года назад
Electronics always look more impressive than they really are. It's amazing what you can with a cheap microcontroller, a handful of sensors, and a few grams of 3D-printed plastic.
@CemKumral
@CemKumral 3 года назад
That's cooler than what I expected.
@prateekmahajan1929
@prateekmahajan1929 3 года назад
The hall sensor idea is awesome
@GraemeGunn
@GraemeGunn 3 года назад
That glove is really cool. I want your wearable set up! lol It's so cool.
@olavikaukamieli1314
@olavikaukamieli1314 3 года назад
I love you. This is amazing. I don't think I'd use this instead of a twiddler, but it's amazing anyway.
@toamastar
@toamastar 3 года назад
this is INSANELY cool!! Thank you for introducing me to this whole crazy world!! :)
@fdmspeedy
@fdmspeedy 3 года назад
Seriously this is GENIUS! I want one. The question is will you make me one for less than I value my time to do it myself? Name your price, sir.
@pedrohenriqueboscofi
@pedrohenriqueboscofi 3 года назад
breathtaking
@AbeDillon
@AbeDillon 3 года назад
This is bad ass. There's a company called "Emotive" that makes a fairly good EEG that might be worth looking in to for more cyberpunk UI input.
@Mogalize
@Mogalize 3 года назад
Some pretty interesting things you do here. I like it. Subscribed.
@cristovaotrevisan1430
@cristovaotrevisan1430 3 года назад
Absolutely awesome, Zack Freedman needs to go viral
@TheSlyMouse
@TheSlyMouse 3 года назад
What a cool project. You obviously have ten thousands projects under your belt
@SJF-n9k
@SJF-n9k Год назад
You inspire me keep up the good work
@redd1234
@redd1234 3 года назад
I wasn't too convinced on subscribing in some other video or 2 I saw but I subscribed anyway. This definitely got my subscription tho. cool af. simple and not clunky like other kinds of gloves
@peteratkin3788
@peteratkin3788 3 года назад
simply amazing...
@chapitela
@chapitela 2 года назад
This is a lot better that any commercial alternative.
@NicksStuff
@NicksStuff 3 года назад
I see potential for a motorcycle glove (controlling satnav and stuff)
@accueil750
@accueil750 5 месяцев назад
this is insanely cool
@DakkyW
@DakkyW 3 года назад
Honestly one of the nicest wearables I've seen a vid of holy damn
@surfboypr
@surfboypr 3 года назад
Awesome!!!!!! I just want to finish my nursing board and submerge in all this, I have tons of ideas but lots to learn hopefully "never too late to learn" still works jejejejejejeje Your vids are awesome pretty sure your channel will keep growing!
@mihhailgotovtsev2555
@mihhailgotovtsev2555 3 года назад
I watched this five times, it's soo good.
@matthewdeane235
@matthewdeane235 3 года назад
Fantastic job man! I can’t even seem to finish my projects.
@aydenvis
@aydenvis 3 года назад
Love this video! I'm planning on using the Hall Effect idea (and perhaps the .stl based execution) for use with VR text entry via ASETNIOP. Small hiccup is that the fist is a needed character in ASETNIOP, so I'm thinking of adding two conductive surfaces to the "karate chop" area of each hand. If you tap them together (closing the circuit) they turn on and off. Other than adding that, your video and instructions are perfect idea sources!
@john-franklinanusiem3304
@john-franklinanusiem3304 3 года назад
This is awesome.
@shawnmulberry774
@shawnmulberry774 3 года назад
Inspiring work
@ku6479
@ku6479 3 года назад
Dude, I'm not even a tech nerd and that is freaking cool!!
@juliansalva5502
@juliansalva5502 3 года назад
Quality stuff right there.
@bryandelledonne3029
@bryandelledonne3029 3 года назад
This is dope!
@Nokem61
@Nokem61 3 года назад
You can add little button's on fingers for user defined macros. Place them in such a way that you can turn them on with your thumb.
@mtruxillo4502
@mtruxillo4502 11 месяцев назад
Really smart & practical design . Appreciate the minimalism, knowing what you don't need can sometimes be the hardest part of a design one of the coolest wearables i've seen in a bit Thanks for sharing! Was wondering about how much could one type with it before experiencing fatigue- a couple words here and there? 2 or 3 sentences ? paragraphs? I'd imagine ease improves with use a bit
@albertroswell
@albertroswell Год назад
zack, thanks for this video, I am a fan and loving gridfinity to organize the bathroom drawers!, the iidea of using magnets is brilliant, I was about to use flex sensors, but I only need binary data (flex or not), thanks for the inspiration
@ShadowoftheDude
@ShadowoftheDude 3 года назад
This is really cool… and is also forcing me to rethink my sci if world building project.
@choerrybomb2195
@choerrybomb2195 3 года назад
this is SICK
@anorymous8614
@anorymous8614 3 года назад
great freaking job!
@willywally5997
@willywally5997 2 года назад
you have no idea how much I wish these were for sale
@jameswalker199
@jameswalker199 3 года назад
Honestly, that hall effect sensor usage is pretty damn genius. I doubt adding more sensors for the rest of the finger would impede movement too much, either - certainly I can't see it impeding movement like a flex sensor would.
@alanm.cuevas8691
@alanm.cuevas8691 3 года назад
I wonder if you could make a pair of gloves that can type using ASL gestures -- super cool!
@GrimmSpector
@GrimmSpector 3 года назад
You're a genius and I want to replicate this so badly.
@djblast101
@djblast101 3 года назад
"Look at me I am the keyboard now" - Tech Pirate
@safetylast6482
@safetylast6482 3 года назад
this is legit so cool
@cpunching
@cpunching Год назад
I would love to see this expanded into something for sign language. Not just so it's more accessible/something to get people interested in learning about the deaf communities out there, but because you could easily change it to recognize arbitrary inputs/gestures that may share the same movements as some signs as their own macros! Then you could literally be Keanu Reeves from Johnny Mnemonic!
@johnnydingo8680
@johnnydingo8680 3 года назад
Here from the future. Now I know why the cyborg look. Great project, well executed. You should be an inspiration to a lot of youngsters.
@CatDevz
@CatDevz 3 года назад
This is so cool, like actually so cool.
@AkselBredahl
@AkselBredahl Год назад
Dude is litteraly a real life cyborg! Holy crap some cool projects!!
@vamsigagjew1535
@vamsigagjew1535 3 года назад
Why the hell this stuff aint more commonplace? This is so cool!
@vexationc-ops4449
@vexationc-ops4449 3 года назад
Now this is fucking cool . Plz further develop this so one day we can all enjoy it.
@nialltracey2599
@nialltracey2599 3 года назад
A point on ergonomics (and why they mean that this design is very good). It's tempting to want to put extra sensors at different joints -- after all, a human can hold the big knuckle straight and bend a minor joint (or vice versa). However, there are only two main muscles controlling the bending and straightening or a finger, so holding one joint straight while bending the next meaning holding a lot of tension in the two muscles simultaneously. It isn't harmful when you do it occasionally, for things like shadow puppetry, but we don't do it for any of our frequent actions. A data glove with independent sensors at two knuckles on the same finger would be likely to result in UI gestures being developed that take advantage of these less ergonomic motions for relatively common functions, resulting in a repetitive abuse injury. This design measures the most important variables, and removes the possibility of either the software designer or the user to use a lot of potentially harmful gestures.
@JasperSkallow
@JasperSkallow 3 года назад
you're amazing zack
@jarredelijah6803
@jarredelijah6803 Год назад
THANK YOU
@masheroomboi2884
@masheroomboi2884 2 года назад
Shoot, this is just rad
Далее
Small Brain, Big Think: AI on the Edge
12:40
Просмотров 455 тыс.
Why Are Circuits on Boards?
17:15
Просмотров 437 тыс.
Я НЕ ОЖИДАЛ ЭТОГО!!! #Shorts #Глент
00:19
Редакция. News: 128-я неделя
57:33
Просмотров 2 млн
10 Free Prints to Make Friends Suffer!
22:19
Просмотров 615 тыс.
The bizarre flashing lights on a smartwatch
13:29
Просмотров 2,8 млн
Read My Chest: This Hoodie Subtitles Everything I Say
15:32
I made $22 Virtual Reality Gloves.
8:20
Просмотров 1,4 млн
I built VR Haptic Gloves to Control Robots
15:04
Просмотров 56 тыс.
Recycle Cardboard into Anything with 3D Printing!
10:27
Why I put a Teensy in Every Project
11:13
Просмотров 332 тыс.
I Built a Transparent Katana
22:02
Просмотров 15 млн
How to Soldering wire in Factory ?
0:10
Просмотров 13 млн
Проверил, как вам?
0:58
Просмотров 390 тыс.