How to Edit Vision Pro Spatial Video in 3D with DaVinci Resolve

Подписаться 250 тыс.

Просмотров 14 тыс.

50% 1

Learn how to edit 3D spatial video in DaVinci Resolve for Apple Vision Pro. This tutorial will cover all the basics in 3D and Spatial Video editing starting from decoding/transcoding MV-HEVC, Importing 3D footage, Editing in Edit Page, 2D to 3D Graphics overlay and VFX, recalibrating 3D, adjusting 3D depth, rendering Spatial Video and handling common 3D problems. This is the ONLY editing workflow on the Internet that works on your Apple Vision Pro. If your edited spatial video does not play correctly inside Vision Pro, this is the tutorial you need to watch (over and over again!)
0:00 - Introduction
1:30 - My opinion of 3D depth
2:30 - How to convert MV-HEVC to 3D SBS
2:55 - How to watch Spatial Video with any USB-C AR glasses or 3D TV
4:07 - FFMPEG command to separate Left and Right eyes
5:18 - Why DaVinci Resolve for 3D Editing?
5:58 - How to import 3D video correctly in DaVinci Resolve Media Tab
6:42 - How to edit 3D video in DaVinci Resolve Edit Tab
7:06 - How to insert 2D graphics in 3D
8:27 - DaVinci Resolve 3D features in Color Tab
9:00 - How to fix the Spatial Video alignment problem
10:03 - Make iPhone 15 Pro Spatial Video more 3D
11:24 - How to render 3D Spatial Video from DaVinci Resolve
13:13 - TWO ways to convert 3D SBS video to MV-HEVC
⬇️ Download my MV-HEVC Spatial Video footage to follow along in this tutorial: bit.ly/4aNGejI
✅ Copy and paste my FFMPEG command here: bit.ly/48lFHEk
⬇️ Get MotoinVFX FREE DaVinci Resolve template: motionvfx.sjv.io/y262Mv
⬇️ Get MotoinVFX Insta360 Template: motionvfx.sjv.io/Ordrqz (use code HUGH10 for extra 10% OFF)
🐕 FOLLOW ME & Kimchi:
➜ Instagram: / hugh.hou
➜ Facebook: / 360creator
➜ Meta Quest TV: ocul.us/30uMZUj
➜ TikTok: / hughhou
🤝 We are open for HIRE! Reach out: hi[at]hughhou.com
#spatialvideo #applevisionpro #3dediting

Опубликовано:

3 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 97

@silvertube52 7 месяцев назад

Thanks for another wonderful video Hugh. You're a real asset to the VR and 3D community.

@hughhou 7 месяцев назад

My pleasure!

@janetliu9861 6 месяцев назад

Thanks for sharing what nobody else does, and exactly what we are interested in!

@hughhou 6 месяцев назад

Oh wow and thank you for the support and keep our light on to share more unique workflow and research 🙏🏼

@Mastajwood 5 месяцев назад

this opens up some great possibilities. thanks for the great explanation

@taosranch 5 месяцев назад

Great info! You are at the very forefront of a massive wave of new ways to communicate. Thanks so much for helping newbies like me wade into the technical requirements.

@hughhou 5 месяцев назад

Happy to help!

@WilliamCerniuk 5 месяцев назад

That was completely awesome. Thank you for taking the time.🤩

@hughhou 5 месяцев назад

Our pleasure!

@PeterLum 6 месяцев назад

Thank you for this video. Well done!

@hughhou 6 месяцев назад

My pleasure!

@HolzmannMedia 7 месяцев назад

Great video! Very helpful 😊

@hughhou 7 месяцев назад

I'm so glad!

@pauzfilms 7 месяцев назад

Thank you so much Hugh! Start to make 3D videos again…🎉

@hughhou 7 месяцев назад

You are very welcome! Yes time to back to 3D.

@pauzfilms 7 месяцев назад

@@hughhou What do you think of my first spatial editing? ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-XX37eWkVu9I.htmlsi=IQwGlO7ITaXHAMJJ

@AskJoe 6 месяцев назад

Thanks!

@AskJoe 6 месяцев назад

Thank you for posting this. I also have two other 3D cameras with different resolutions, so I'll adapt the scripts to split it at 960 instead of 1920. I originally thought I could do this using crops in Fusion, but I think FFMPEG is a great alternative.

@hughhou 6 месяцев назад

Crop in Fusion also work. We might have a Spatial Video prep script out soon to auto crop it for you. After this video, the community suggested several improving workflow. Will gather all the knowledge and make an updated tutorial. You can also upscale your 960 to 1920 and then remerge them in Fusion.

@SuperZoomVideos 7 месяцев назад

Keep doing the good work mate, great stuff…..maybe change the Xmas jumper 😂

@hughhou 6 месяцев назад

Good suggestion! Xmas is over but Kimchi on my cheat is still good!

@SuperZoomVideos 6 месяцев назад

@@hughhou good excuse to get Kimchi clothing for all holidays and occasions

@mm2dip 4 месяца назад

thank you so much for all you do for us 🙏 an I use that App with a iPhone 12 Pro Max... ???

@hughhou 4 месяца назад

Only iPhone 15 Pro / Pro Max can do Spatial Video now. I don't think iPhone 12 can.

@Diglicous 7 месяцев назад

Excellent tutorial on the steps required to properly edit 3D Stereo content.

@hughhou 7 месяцев назад

Glad it was helpful!

@user-oo7or7qj7w 2 дня назад

Does Hugh Hou have a tutorial on stitching two ordinary fisheye lenses into a 3D video? I am willing to pay, thank you. It's not a VR lens. I plan to use two 24mm lenses to splice and display on the Vision PRO

@geoffroyguillemain5770 7 месяцев назад

Thanks for your tips, you rock my « boy Hugh » … Too bad I still haven’t got the money to get these devices (iPhone 15 pro 1To / Apple Pro Vision).

@hughhou 6 месяцев назад

You can use any 3D camera btw! Just skip the MV-HEVC part and go straight to Resolve to edit 3D and then encode for vision pro. You can play the vidoe on VisionOS emulator.

@visitas360vr 6 месяцев назад

Hi Hugh… awesome info… Just a question…. There is any alternative to extract left and right video different from the FFMPEG workflow… always I have seen this option as a complicated option based on coding/command structure. Thanks a lot for your effort communicating new information about the whole VR and 3D workflows.

@hughhou 6 месяцев назад

Oh yes, just use any NLEs to crop left and crop right to render it out. I do that too something and it is easier as you can copy and paste and use Media encoder to queue them all up.

@wkinyin 7 месяцев назад

謝謝！

@hughhou 7 месяцев назад

十分感谢🙏🏼

@buthman 7 месяцев назад

Another great video! Are you using Davinci Resolve Studio (the paid one)? It looks like the 3D tools might not be in the free version??

@hughhou 7 месяцев назад

That is correct. All 3D or VR180 feature are only in Studio version. I bought a Blackmagic 6K camera so I have it free.

@buthman 7 месяцев назад

I think you mentioned in your previous vid that you upscaled to 4K using topaz. Do you do that before you do any editing?

@Explorister 6 месяцев назад

You said in the video that Davinci has the most powerful 3D alignment tool you've seen in the industry. Can this replace Mistika VR? I'm going to be experimenting with different selfmade 3D cameras soon and I'm wondering if I can skip "Mistika VR" straight away? Can the usual alignments be carried out completely in Davinci?

@hughhou 6 месяцев назад

Resolve is not VR - just 3D alignment. VR you still need Mistika VR

@Teacher-Fan 6 месяцев назад

Still the same question: Is it possible to crop vr180 video to regular 16x9 spatial video using daVinci Parse/Fusion? It would be great to have a tutorial on this!

@hughhou 6 месяцев назад

Yes, absolutely. I just have not find the time to make one lol. It is planned :)

@TheCosmopolite 7 месяцев назад

👍🏾

@castle_media423 2 месяца назад

Can you kindly provide a link to that phone lens? Is this like a cpl filter?

@Sydney2217 7 месяцев назад

The lens width is in my experience needs to be near to eye width . As it is on my Fuji 3d camera & Panasonic 3D1.Following this development with great interest as i still like my own 3D gear & results but lack , now , a 3DTV . So i would like a VR "googles" for mainly 3D .

@hughhou 7 месяцев назад

Yes, AVP will have a better Stereo camera. iPhone 15 is an after tho from Apple to get some buzz before AVP drop this month.

@sandys-channel 6 месяцев назад

Any tutorials on taking our existing VR180 and converting it to Apple Spatial Video? Would be nice to bring new life to some old VR180 footage

@hughhou 6 месяцев назад

I will need the get the Vision Pro on hand to figure it out. So will follow up on February 2nd! Doing my best!

@sandys-channel 6 месяцев назад

@@hughhou amazing thanks Hugh! You're the best

@kingjames1866 6 месяцев назад

Hello Hugh. Love your work, I wanted to ask a small question. Is there a way to merge 2 vr180 photos together like can be done with 2 normal photos?

@hughhou 6 месяцев назад

Merge mean merge into 360 3D photot or still VR180 photo? Yes, you can, just paint out the overlap but again you need to do it in 3D. 3D photomaker is what I will approach this

@kingjames1866 6 месяцев назад

@@hughhou I have 2 photos that I took on my insta360 EVO. One is a female model in a white studio and the other is a nature photo. I wanted it to look like the model is in the nature photo. I will try the overlay method you mentioned, thank you.

@kingjames1866 6 месяцев назад

@@hughhou Is there a 3d photomaker that you can recommend using?

@TheFunDimension 3 месяца назад

It’s somewhat confusing. What did you used to upscale it to 4K in the previous video? And how to upload to RU-vid?

@hughhou 3 месяца назад

Wait this one I shot on iPhone and did not upscale. Which previous video you referencing to? Feel free to make a new comment of comment on that video directly so I know which one you are. talking about.

@AnthonyTori 7 месяцев назад

Would you be able to edit in Final Cut Pro since they have VR editing?

@hughhou 7 месяцев назад

Not that I know of. FCP do not support Stereo 3D editing YET.

@JimmyGiliberti 6 месяцев назад

So, does this workflow behave any differently if I’m starting out with Equirectangular left/right footage? Color correction wouldn’t, but won’t you have issues with spherical/planar elements with any graphics, and does MV-HEVC have any connection with spherical video metadata?

@hughhou 6 месяцев назад

For immersive video (Apple term), there are too many unknown. I will nee to get my hand on Vision Pro first to do more revert enginnering to figure this out. So hold tight on immersive video - which is 180 and 360. I will follow up as soon as I figure out how to do it (I have not figure it out yet lol - to be 100% honest)

@JimmyGiliberti 6 месяцев назад

@@hughhou I’ve thrown K1pro footage through halocline and tried in Simulator and it plays as 2.5k square left eye using their media player calls. Can’t wait to see immersively…

@captteemo9133 6 месяцев назад

Do you also use Prores on a Windows PC? Even though it has no hardware acceleration there? (I speak of 3603D8K footage if this makes a difference)

@hughhou 6 месяцев назад

ProRes work well in PC as well with NVIDIA GPU and hardware accelecration

@AnthonyTori 6 месяцев назад

Is there a way to export a RU-vid ready file from Spaatialify? I tried all of the export files and none of them worked when watching on RU-vid VR.

@hughhou 6 месяцев назад

In this video description, there is a download link for FFMPEG command. Download the docs and there is a command line to use to do exactly that. Just use it and it will work for RU-vid 3D

@skatingphoto 6 месяцев назад

I tried building the Spatial Media Metadata Injector v2.1and running it on an M1 Mac, but nothing happens. Based on previous videos, it seems this is needed to inject the metadata for Da Vinci Resolve videos. Any clues on how this might work to export to RU-vid VR with this issue, whether it's still needed to inject the metadata? Thanks!

@hughhou 6 месяцев назад

You need Python and run the Phython file in terminal. But anyway, Resolve DO NOT inject any metadata. You will need to inject them manually.

@janetliu9861 6 месяцев назад

Thank you. I built using Python3, and there was a resulting gui.app. I clicked on it but nothing happens. Not sure if there are logs I can look at to debug the issue. I may build on a Windows to get around this.

@friedguyfriedguy 6 месяцев назад

is it possible to convert vuze xr 180vr video to apples spacial video? if so then how?

@hughhou 6 месяцев назад

Same as any other VR180 video. You just need to inject spatial metadata - I will talk about it when I get my Vision Pro and can do more indepth testing. Stay tuned!

@alersito 7 месяцев назад

Any news about the Canon? I need a 3D VR180 camera 😢

@TV355 7 месяцев назад

Me too 🙂

@hughhou 7 месяцев назад

I hope soon. I am gonna ask them at CES 2024 - and if there is any news, you will hear it here first

@marsliu2331 6 месяцев назад

那个R7的镜头太牛了，啥时候量产@@hughhou

@renanalves5513 9 дней назад

excellent video, I'm playing it to learn, I just had a problem with dividing the video into left and right, the command gives this error, can you help me? [in#0 @ 0000028512fd87c0] Error opening input: Invalid argument Error opening input file *.MOV. Error opening input files: Invalid argument

@hughhou 8 дней назад

You don’t need it now! New update in 19 beta support spatial video natively!!!!

@NickGregorio 5 месяцев назад

I found that Halocine’s compression is really bad - if you use the paid does it get better?

@hughhou 5 месяцев назад

No. Use this workflow and FFMPEG instead: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-BHtKOxGEiAw.html - it is the last step in this tutorial, 3D to spatial.

@NickGregorio 5 месяцев назад

@@hughhou thanks for the response and for all of the useful resources

@marydeguzman8838 5 месяцев назад

Hello, I am so sorry to have to ask. Very new with all of this and really interested in learning how to do all this. Why can't we use the video recorded in iphone 15 pro and edit it directly in davinci and have to the left and right if the video captured in iphone15 is already 3d? Really appreciate any answers. Please don't hate me. Thank you.

@hughhou 5 месяцев назад

Don't be sorry to ask. This is why I am here. Always feel free to ask anything you don't get! So you can actually edit the video (trim) directly on your iPhone 15 - you don't need any software. But if you want to get the best stereo, control the disparity, add graphics, then you need other software. You can edit it straight up but then you don't know your stereo quality and risking making your viewer cross eye - which is #1 rule in 3D - depth editing. I hope that make sense. If you edit directly on your iphone then you don't need to worry about any of this.

@marydeguzman8838 5 месяцев назад

Thank you so much for getting back to me@@hughhou really appreciate you! Further risking sounding really clueless. Does this mean I can treat it like a normal video in an iphone and stitch the video clips using Imovie and play it on vision pro and it would work? Not minding the video quality etc. of course.

@marydeguzman8838 5 месяцев назад

Hello at @hughhou, really struggling here. How can I splice the spatial videos we took using iphone 15 without really needing to edit it. Just splicing it and getting it back to format that is going to play the video in vision pro. Sorry, been scouring the net these past couple of days and have not gotten anywhere. Your help would be truly appreciated.

@marydeguzman9206 4 месяца назад

Hi @hughhou so i followed your video step by step but my boss says that when she plays it on apple vision pro she says “on the video you sent.... the entire window is filled with the video, by stretching it in all directions.. like those weird mirrors on fairs.. and the feeling is that you are at the edge of the cliff.. that stretch your image in all sides… not sure what I am doing wrong.. i followed all your steps.. video source is from iphone 15 pro.. used ffmpeg.. spatialify.. davinci resolve studion.. all steps… i don’t know what I am missing…. 😢😢😢

@LuiiSbg Месяц назад

Is there an option in adobe to do the Stereo 3D Sync? 6:10

@hughhou Месяц назад

No, it is a resolve only thing and why Resolve is what Apple recommanded NLE

@LuiiSbg Месяц назад

@@hughhou thank you, your videos are awesome btw.

@VirtualViews3D 7 месяцев назад

So maybe I’m misunderstanding a basic concept… I was under the impression that apple “spatial” video had a slight element of “real” depth (that you could look at someone in a video from a *slightly* different angle or get *slightly* closer) because of the depth sensor, contrary to “regular” 3D where you could never do that and can only see the angle recorded by the camera. Am I understanding incorrectly? I thought this video dealt with that but maybe it is my lack of understanding of the term…? Love your videos 👍🏼

@hughhou 7 месяцев назад

Everyone tho that as well but when it came out, it’s just same old 3D video with a efficient codec. There is no LiDAR data embedded in the MV HEVC file and there is no low resolution depth map like in the new Apple map. We will need a low resolution depth map to do what you mention but there is no depth map at all… just left and right images. And yes, disappointing.

@VirtualViews3D 7 месяцев назад

@@hughhou So there’s nothing “special” about “spatial” 😖😂

@geroldwaefler9485 2 месяца назад

There is not one Tutorial who show how to sync the left and right Video, if they are in time not together. If we shoot the left and right Video with 2 independent cams its essntial important to can sync in time the 2 Videos. Not on Tutorial say how we can do this in Davinci Resolve and its possible.

@GeraldDonovan 7 месяцев назад

Hi - 11'33" "There is no way for Davinci Resolve to export a full size side by side video". Would it not be possible to do this by creating a video collage (Resolve FX Transform in the Edit page)?

@hughhou 7 месяцев назад

Sorry I don’t know what you mean.

@GeraldDonovan 7 месяцев назад

@@hughhou Apologies for not being clear. I'm probably missing something obvious - I'll have a play around.

@GeraldDonovan 6 месяцев назад

OK got it now - many thanks. It was a stupid question from me :) Just walked through the tutorial with one of your provided files - superb work, many thanks for everything you do! One question - I currently don't have an iPhone 15 Pro, but I do have a Canon R5C. Since the dual fisheye lens and the 15 pro cost about the same, is there any benefit whatsoever in getting the iPhone to create spatial videos, or am I better off getting the dual fisheye so that I can do everything in 4K per eye?

@bapi507 6 месяцев назад

Where do I find the folder "samplefor3deditingtutorial"?

@hughhou 6 месяцев назад

It should be in the link.

@TheFunDimension 2 месяца назад

Dude, I am so frustrated. How the f-$;-did you upload the video to RU-vid? The first problem is that people can’t follow your terminal code while using a windows machine, so I had to figure it out, and create a workflow so I can also use my blender renders in the time line. Now that I am able to edit things in davinci, I had no idea what you are doing afterwards. Also how the hell can I see this videos using my Vision Pro? I heard people saying the word moonlight but not even gpt 4o can make me understand what’s the deal. Come on, dude, I have been looking at your freaking tutorials left and right, I don’t see an answer.

@clamojoat8543 3 месяца назад

the ONLY way to change depth on an already made 3D video is to re do the footage. for example.....the croods, it has stronger depth that the croods 2. to change the crrods 2 the studios must go back and re-calibrate the stereo camera and re shoot it. another way would be to take all the shots in a program that is capable of generating disparity maps from a stereo pair to generate the new eye for each shot. but its WAY faster just to re-shoot it. and that's bull shit that the software to convert this format to sbs isnt free 😡fucking apple and there proprietary bull shit.