Building a Camera Motion Control Rig

Подписаться 1,2 млн

Просмотров 113 тыс.

50% 1

Ad: You and your company can try Onshape for Free at Onshape.pro/JamesBruton
Do you think static camera shots are boring, with the camera sat still on a tripod? Well, some RU-vidrs have camera operators, which makes the footage look super fun, and they can interact with the RU-vidr too. William Osman has a camera operator called Cameraman John. But who exactly is Cameraman John? I’d love to make my footage look super fun too, so today I’m going to build an AI-driven robot camera operator that can do lots of fun things, just like Cameraman John. I'm using an A.I. deep learning model on running on a Jetson Nano to track where I am in the shot and move a pan-tilt-zoom camera gimbal. There are also some other special features.
CAD and code: github.com/XRobots/CameraBot
You can support me on Patreon, join my Discord, or buy my Merchandise:
***************************
Discord: / discord
Patreon: / xrobots
Merchandise: teespring.com/stores/james-br...
***************************
Other socials:
***************************
Instagram: / xrobotsuk
Twitter: / xrobotsuk
Facebook: / xrobotsuk
***************************
Affiliate links - I will get some money of you use them to sign up or buy something:
***************************
10% off at www.3dfuel.com/ - use code XROBOTS at the cart screen.
Music for your RU-vid videos: share.epidemicsound.com/xrobots
***************************
CAD and Code for my projects: github.com/XRobots
Huge thanks to my Patrons, without whom my standard of living would drastically decline. Like, inside out-Farm Foods bag decline. Plus a very special shoutout to Lulzbot, Inc who keep me in LulzBot 3D printers and support me via Patreon.
HARDWARE/SOFTWARE
Below you can also find a lot of the typical tools, equipment and supplies used in my projects:
Filament from: www.3dfuel.com/
Lulzbot 3D Printers: bit.ly/2Sj6nil
Bearings from: simplybearings.co.uk/
Lincoln Electric Welder: bit.ly/2Rqhqos
CNC Router: bit.ly/2QdsNjt
Ryobi Tools: bit.ly/2RhArcD
Axminster Micro Lathe: bit.ly/2Sj6eeN
3D Printer Filament: bit.ly/2PdcdUu
Soldering Iron: bit.ly/2DrNWDR
Vectric CNC Software: bit.ly/2zxpZqv

Наука

Опубликовано:

11 дек 2022

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 509

@jamesbruton Год назад

I started a Discord! discord.com/invite/fc6MedG7eW

@pearcomputers Год назад

How easy to give the bot a website so viewers can drive/remote view 1t James? #surrogate #ThePeriferal xx

@BoHolbo Год назад

Apparently, it is possible to balance an inverted pendulum on the X and Y axis using only ONE reaction wheel! And I was very surprised to learn that it is NOT done by changing the rotation angle. The only moving part is the reaction wheel’s rotation. 🤔 It’s called “The One-Wheel Cubli.” Here is the link to the video showing it: LM74EBbetGU

@williamosman Год назад

It's how cameraman John films when he's drunk!!!!

@jamesbruton Год назад

Yeah - there's still quite a bit of tuning to do I think. It gets worse when I wave my arms around - I probably need variable motion filtering depending on how much ENERGY I need!

@CH4NNELZERO Год назад

This is the most universally useful project you’ve built in a while. I hope to see this in use on all your future videos.

@petejandrell4512 Год назад

This is the comment I would have made had you not already made it.

@cheeriosaltcream Год назад

@@petejandrell4512 Your comment commenting about his comment is the comment I would have made had you not already made it.

@ThereIsOnly1ArcNinja Год назад

@@cheeriosaltcream Your comment about someone commenting on a comment is a comment I would have done if you hadn't already posted that comment - keep commenting 🤪

@andr_line Год назад

@@ThereIsOnly1ArcNinja Your comment commenting about how we should keep commenting on a comment commenting on how a comment that is commented under the video is exactly the comment the commenter would have made, being that said comment would not have already been commented by another commenter is exactly what I would have commented under said comment, had the described comment not already been commented by another commenter that thought it would be funny to comment the same comment again, just in a slightly different style.

@ImseetheArtist Год назад

Our comment from a comment to a comment to comment made also many comment and me to to comment the same and im referesing the first commentator to this comment to have my comment also to comment lol to me ✌️peace from finland

@PreownedQuasar Год назад

This mimics most every youtube cameraman weirdly perfectly. Its motion is just slightly shakey and the movement speed is such that it really mimics a person holding a camera. you've done a lot of awesome projects, but this is weirdly the one I'm most enthralled by

@jamesbruton Год назад

Thanks!

@CraftingCake Год назад

I think it's even too smooth. Jon has usually more aggressive shot movements.

@foldionepapyrus3441 Год назад

@@CraftingCake Agreed, most YT level camera people don't have really good motion smoothing gimble to correct for their walking around or, tripods/tracks to run the camera down so its much rougher than this, plus YT rewards short punchy video's it seems, so everything is FAST. Its not quite studio camera operator good, but darned impressive - better some live sports I've watched at following the target...

@dh2032 Год назад

@@foldionepapyrus3441 shaky a bit off putting, but, as you say (mounting an off the shelf youtuber, gopro, one, and let that do the correction stuff, unless he feels like reinventing the wheel, ? but the shaking is really off puting, now where up to you normal video you do, not the worst by the standard RU-vid videos out there, but a step down in the ones you, hope it not in all you video at the moment un till the shakey is sorted out (could be like tony starks fire extinguisher robot, when it working right?

@dh2032 Год назад

and the photo bombing by Elmo the (the red robot toy), the made me smile, the robots are taking over 🙂

@eg0zb Год назад

Man, if you continue using this as your official cameraman, I would actually be sooo happy

@IAmMisterD Год назад

Gotta give the cameraman a name! lol Amazing work btw! :)

@alantupper4106 Год назад

The MST3K fan in me really wants it to be CamBot.

@kwerk2011 Год назад

For a first iteration, it's remarkable how human like the outcome is. Amazing as usual, James.

@diegeeleel Год назад

I’m pretty sure most other RU-vidrs if they produced this kind of content would stretch it out over about five videos. Amazing amount of work and skills, not to mention the experience and understanding required to produce something like this. All crammed into one short video. My head is spinning.

@rosserobertolli Год назад

I'm suspecting now he has multiple Johns in service to help him out designing and building cool projects at this pace

@josuelservin Год назад

And the speed! It's impressive how much content he can make and without a huge team

@Wookei Год назад

Yeah he is hands down the fastest maker on youtube. I can't wrap my head around how quickly he can materialize his ideas.

@Meoiswa Год назад

Train it to recognize a "frame this" gesture where it points the camera exactly in the center of the rectangle shaped by your indexes and thumbs. that way you don't need to fiddle with the remote to set up the static framed shot!. Another idea I had is making it toggle between "wide framing (full body)" and "portrait framing (half body)" by recognizing the "T pose".

@WeAreChecking Год назад

These are genuinely fantastic ideas that would greatly improve the workflow of actually using this device, fantastic

@omegaroguelp Год назад

and maybe face recognition to prioritise keeping the face in frame over just keeping the body in frame

@RAFMnBgaming Год назад

@@omegaroguelp Or a similar hand recognition mode, given often what we're doing involves our hands.

@RandStuffOfficial Год назад

Also maybe detect when the body is oriented sideways and frame it accordingly in a 1/3 - 2/3 ratio (that would allow to see the computer at 10:32 for example).

@Davedarko Год назад

You had me at the demo already, loved the motion and how alive it all became, really felt like a second person filming it!

@jamesbruton Год назад

Thanks - there's still some tuning to do, but I plan to use it more in the future

@StevenIngram Год назад

@@jamesbruton I certainly would, I had nothing but the sense that this thing was amazingly useful during the whole demo of its operation.

@StevenIngram Год назад

Ps. The thumbs up was a master stroke. It really helped sell the illusion that the bot was contextually aware.

@hippie-io7225 Год назад

@@jamesbruton I always admire your projects!! It would be nice to see a project you have created, being used all the time and making your life a little easier.

@liambohl Год назад

Would PID control be a viable way to keep you in frame while smoothing the camera movements?

@benyed1636 Год назад

I hope this is a mainstay of the channel. The camerawork is actually pretty good and having a robotic cameraman is very on brand.

@turbo2ltr Год назад

This is one of the coolest projects yet. You've just put thousands of cameramen out of the job. lol. It works so well. One of the foot switches should do this: hold the switch down and the jetson will start tracking your hand. You put your hand where you want the camera to look at (like a closeup of what you are working on) and let go of the pedal and it will stay there until you hit the pedal again where it will start tracking you again.

@lightdark00 Год назад

You made you own cameraman friend. You're growing up so fast, soon you'll make yourself another friend.

@Skyliner_369 Год назад

You should probably look into curved values for pan and tilt. If you're near middle-frame it pans super slow, if you're near the edge it can whip round. Also maybe look into using some form of face recognition as well as hand recognition to maybe get it to more dynamically track what you're doing and your face.

@andrzejstepien85 Год назад

The most amazing part for me is that this one can actually move around, unlike similar projects on RU-vid. What would be great is if it was programmed to follow some composition rules, like diagonals or simple thirds. In theory you could get transitions like from Stanley Kubrick's movie while you can focus on working on your project.

@tadhgd350 Год назад

Bros got an entire print farm just for these projects

@IanSlothieRolfe Год назад

I'm genuinely impressed at how good the result is, considering you probably haven't devoted thousands of hours of software development to the tracking, its basically functional and adds a level of dynamic to the camera work which is more interesting than static shots. There are obviously lots of "user interface" options to explore to make the filming seamless and fit your video making style. It will be interesting to see if or how much you use this in the future.

@CodySchatzle Год назад

You could absolutely mass produce this and sell it to RU-vidrs.

@onyxtay7246 Год назад

This is cool. I wonder if the "seasickness" effect could be reduced by leaving it slightly zoomed out and then applying stabilization in software. I don't think it's quite to the point of an actual human, but it's still pretty good.

@Jaco9307 Год назад

Yeah i think some sort of filtering to reduce the small adjustments would help a lot, like if James just moves a tiny bit to the right the camera doesnt really need to follow as long as he is still in frame. I definitely think the issue is the constant small adjustments And just in general, a small increase in tracking smoothing would be good, definitely feels a bit too delayed in following him when he moves

@MartinRunesson Год назад

Why not add another camera to the stand? Then you have the option not to show the movements all the time.

@boonjabby Год назад

I was thinking a second camera can be used for the algorithm where the main camera is for filming. The 2nd camera would keep tracking, distance, and position in mind and give more organic commands to the main camera

@blutube9916 Год назад

Due to lenses, this can give shots a weird warped feel. Like some of the older youtube videos, where things looked like they were warping, as youtube had applied this kind of stabilisation. It would be better to try and eliminate it using the gimbal.

@unknownhours Год назад

I think a dead zone in the center would help

@toomanymats9755 Год назад

Very cool project. You might be able to also track heads in order to make the response slightly faster if your head goes out of frame

@andybrice2711 Год назад

Yes, I would prioritise the face tracking, and increase the exponent of the motion smoothing. This way the camera will move slowly and only whip-pan if you move near the edge of the frame. This is typically how commercial camera gimbals work. Extremely impressive though. I thought James would have all sorts of trouble with vibration. But it already looks good, and I can see this becoming a design which many people start using once it's refined.

@acidxero Год назад

Cameraman John getting a tip of the cap from you makes me very happy. Cheers.

@acidxero Год назад

Follow up comment: this entire video is brilliant. I don't know why but I find it to be the most fun and possibly most practical creation of yours I've seen in ages. Fantastic work, James.

@anthonyfn Год назад

Wow!!! The foot pedals were a total game-changer.

@MatchaMakesThings Год назад

Holy shit that "jump" cut made me spit out my tea. Amazing! Thanks for making things the way you do James!

@DamagePerHour Год назад

It's crazy how good that looks, genuinely looks like you have someone operating it

@madeintexas3d442 Год назад

The fact that James continues to upload these amazing videos to RU-vid is awesome. Someone with his talent could easily be working for some large company making good money but keeping his knowledge locked up. I'm glad he chooses to share everything with us. James's drive and ability to constantly deliver is truly something to admire.

@christophertnugent9100 Год назад

LISTEN, I'm blown away just imagining all the time and effort goes into designing the stuff that gets 3-D printed given how WELL everything connects together

@Azzameen99AZ Год назад

Honestly, I like this better than most hand-held cam shots. Nobody's jostling the camera around with every breath, its steadyness depends on your movements or what switches you press. Also, no showing something awesome but not noticing that 95% of the awesomeness is out of frame.

@jamespray Год назад

This is one of your best! Amazing application of so many things you've built for separate projects before. One suggestion: perhaps add a shock-mounted buffer ring around the upper part of the tower, so that when the inevitable happens, the crash won't destroy the camera 😮

@arnabmusouwir9018 Год назад

This is one of your most useful projects after the opendog series

@mihajlonesic Год назад

For each one of these robots build, one Cameraman John loses his job

@NeilABliss Год назад

A cool but difficult trick is to drive in while zooming out... Or Vis versa ... Timed right it creates a cool compression effect. Would love to see you pull it off, on a foot switch

@thomasvnl Год назад

You could automatically widen the view/zoom out when you are a certain distance away by adding a TOF sensor that is aiming at whatever the camera lens is aiming at and have these wider views that you now have to do by extending your arms, as an extensions to the foot pedals. But this camera man "john" works really good as-is already.

@EddieAdolf Год назад

It does exactly what you wanted! It adds more of the human element to the viewing experience, and it feels like we're really there. Awesome! 👏

@slackius851 Год назад

12:38 "I found that I can manipulate the hand into quite a few different expressions that we could use in the future." *makes hand stick up middle finger*

@matiaskuperman2890 Год назад

It is crazy how organic that looks! mad respect

@ArcanePath360 Год назад

Dude! This is so next level! Would love to have this. Your robotic skills are getting insane. Been following you since the Iron Man mask days, where things were so much simpler and easy for a novice to replicate. This thing needs to be taken to market. So many RU-vidrs would buy it. You could make some serious money if you could patent it. Take from someone who is fed up with setting up multiple cameras, sound syncing all the footage and editing static shots in post with digital zooming. It's really tedious and not the best.

@UntrackedEndorphins Год назад

1:30 I love this kind of comedy

@addictedtoart Год назад

my guy here literally building a functional 2nd shooter out of a 3d printer while huge companies haven't even thought of anything like that much less being able to get anything close to this to the market within the next years... INCREDIBLE!

@jordy_3d Год назад

Robots and John? Skynet, coming soon!

@awesomelyslowplastic Год назад

This is honestly my favorite video you've done so far. Completely in awe of the work you put into every project you do. To then release the whole project start to finish in one video instead of stretching it over multiple, even better! Hats off to you James.

@SavalioDoesCodingStuff-dd5yb 3 месяца назад

I love how Elmo in the background got detected as a person

@nickjones7437 Год назад

We actually have these in the land surveying industry! We carry around a prism and the robot somehow tracks where to move the laser so it stays on the prism. It can take measurements to the hundred thousandth of a foot

@akira5872 Год назад

Omg, this project is amazing. I would love to see more of the details on the project to build one myself ! Keep doing an awesome work man !

@turrboenvy4612 Год назад

This looks so organic/human. I also loved the literal "jump cut" where you kept in the landing in the first jump and the takeoff in the second one. *chef's kiss* All I'd say is if it's possible increase the maximum speed. A person would move the camera faster (possibly even overshoot) to get the subject back in frame.

@some______guy Год назад

You are so competent it's almost criminal

@odiogoponto Год назад

2:22 An open dog with an aiming gun? That's great!

@4thfrom7 Год назад

I get so happy every time I see a new video from my favourite robot builder. 😁

@mrmb84 Год назад

I'm convinced, I can't tell that it's not a human...until the hand comes up! Makes me feel like I'm in the room, amazing stuff!

@BrenoLuna Год назад

9:27 For a fraction of a moment, it recognized James as a skateboard. This gentleman keeps pushing the bar up for cool and useful projects. Kudos!

@sabrinazwolf Год назад

This might just be the coolest one yet. The motion is so realistic of a cameraperson. Nice work James!

@Dangineering Год назад

WHOA, this is awesome and will DEFINTELY give your videos a bit more life in them. Absolutely Brilliant James.

@boonjabby Год назад

Cool idea! Quickly delivered content as always Jim. 👏

@v6contodo Год назад

Your videos are great man, I love how much engineering you actually do and keep it super entertaining. And this one just might take the win!

@ADurXD Год назад

Having watched these videos for about a year, it's lovely to see how much they've changed! You are so much more carefree and goody now, thanks for the fun, James!

@MahBor Год назад

This is gonna change your vids so much! Amazing build

@ahbushnell1 Год назад

maybe a dead band on the camera. When your not moving much it's still moving and sea sickness is not far away. Nice idea!!

@CarlBugeja Год назад

Awesome build! Love how organic the footage looks!

@NavyVeteran1776 Год назад

This is going to make your videos so much more dynamic. Great job sir.

@toesandfingers 9 месяцев назад

I James about 6 months ago and have been loving binging the archives. This project really stands out though, it is so clever an as others have said feels really organic. I'll watch newer videos with interest now, to see if this is in use!

@maeldorne5522 Год назад

Very interesting! It looks so good, makes the video more dynamic and fun, hopefully you keep using it even if you don't use the wheels. My favorite video in a while!

@CharlesVanNoland Год назад

This was very fun. It's clear you're really motivated about this project, and I can see why. Awesome.

@project-hq Год назад

This is amazing James!! Absolutely love it

@NoahZipin Год назад

This is amazing!!! Use this for your videos from now on!

@navid9852 Год назад

Superb! One of the best inventors on RU-vid ever

@seanrobinson7464 Год назад

Honestly, with tuning, this seems incredibly useful. Great project.

@loekpro2697 Год назад

I love the transition to the 3d printing montage

@chrissugg968 Год назад

I would pay any amount of money for a James Bruton/William Osman collab.

@reesesapphire267 Год назад

nice video, can't believe i missed it when it came out! your "jump cuts" were really entertaining btw

@stevenmcneese8173 Год назад

This is one of the best projects you have posted. Very useful and practical application of AI

@neilredelinghuys3263 Год назад

you always make cool stuff, but this is one of your best so far!! very cool

@spammy1tube Год назад

YES! I really like this!!! Nice work James.

@hippopotamus86 Год назад

Now that's working better than I thought it would.

@ankokuraven Год назад

This is awesome and i hope you get alot of use out of it. It feels really organic

@acuteioa Год назад

This is just amaaaaazing! This video deserves to go viral! Which youtuber would not like to have one of these? Thumbs up, James!

@mattimotion Год назад

That bit at 11:55 caught me completely off guard haha Amazing project!

@Eisneim1 Год назад

this is super useful if you could make is more portable! really want to see you test this outside the workshop

Год назад

This is really cool, probably the most useful project so far. The next feature to add could be to add the ability to change the height of the camera.

@bengelman2600 Год назад

Super impressed with the results on this one!

@Blutankalpha Год назад

Very good! You have inspired me to make my own robots

@harkrits.nagpal6505 Год назад

6:00 That was hilarious 😂 the way you moved made me thing you were flipping me off before I realised what it was😂😂

@FakeButt Год назад

This is amazing! At many points in the video, I totally forgot it is a robot doing the camerawork :) I think a useful improvement would be to recognize your body rotation so if you are facing left or right to interact with something it can pan a little bit more and get the thing you are interacting with in frame. Like when you were typing on the computer, it does not feel natural to have only you in the shot but not the computer. I could see this becoming a real product - depending on how much you can get it to cost at the end. A lot of smaller RU-vid channels can benefit from such an invention!

@lescarneiro Год назад

This is REALLY COOL! Superb work! You're probably going to get a lot of requests from other YTbers, that's for sure

@robertmeyer8221 Год назад

I was just thinking about a project like this. I see all these people on RU-vid trying to film whatever they are working on one handed. Nice job!

@ipiqqyfpv Год назад

i really enjoyed this more organic video style, amazing video as always!

@TheMeditron Год назад

You are always so impressive, Can't wait to see more videos shot by your robot and hat jokes!

@Will_Huff Год назад

oh boy! This is a great one! Great job James....I might have to build one for my channel!

@johandrewortley3388 Год назад

This is absolutely brilliant!

@vannoo67 Год назад

Have you considered adding a feature that allows you to specify the point of interest interactively, say when you hold down one of the foot pedals, it tracks your hand until you release the pedal (then maintains the attitude until directed to go back into normal mode)?

@PaulJoy Год назад

In one video you've exceeded what all the big camera motion companies have developed in the last ten years :)

@zeeshanarshad9684 Год назад

It will be very exciting to see some astrophotography and astrovideography with this setup. Time lapses using of celestial bodies with tracking enabled are soo cool

@sergioa.1530 Год назад

This project is super useful, amazing job 👍🏼👍🏼

@moth.monster Год назад

Honestly amazing, has a great style to it.

@ZoneKei Год назад

This is so good! The thumbs up hat joke was perfect.

@darkquail2003 Год назад

This is the greatest project you have ever done, i hope you actually use this and improve it over time.

@nickjth Год назад

I don’t know why but I absolutely lost it when it zoomed into your knob at 9:23

@DJlegionuk Год назад

I have wanted something like this but to keep what ever I have on my workbench in shot. Great video

@makermelissa Год назад

Great execution on this idea. I had a similar idea for a AI controlled camera dolly as well, but it wasn’t quite as elaborate as this. Very cool! Please do more projects like this in the future.