Amazing! Thank you Hugh :-) I had no idea that youtube had opened up for 4ch ambisonics with headlocked stereo. This is great progress for sound design on 360 videos. Brilliant guide, nice and easy to follow. Keep making these technical guides even though they don't get much traction with the mainstream audience, they are pure gold!!
Hey, your are awesome!! Thanks a lot. I'm a production designer from Brazil and now I'm in PHD studies, my work is a 360o narrative video, and your channel is a great fountain of knowledge!
Hay Hugh, thanks for that very helpful video. But here are some Questions: 1) Why don't you convert your ambix mix directly in reaper with the FB360-Converter Plugin in the 3D-master track to a 4 channel 1st order ambisonic and render a 4-channel wave file at the end? 2) I am not so familiar with the FB360-Encoder, but there is also an option for injecting a headlock audio track. Wouldn't it make things much easier than the workaround with audacity?
1) You can! I just explain a different workflow as I mentioned that already on my other tutorial. There are always more than 1 way to the same result. Good to have different approach 2) It WON'T work for RU-vid 6-channel. So be careful - Facebook and RU-vid use different AmbiX standard. This is the ONLY way to get correct RU-vid VR 6 channel - the FB360 won't work correctly.
@@hughhou I just tried the FB360 Encoder with the Output format: "RU-vid (with first order ambiX)" and it seems to write exactly the same metadata as Spatial Media Metadata Injector, apart from the entry "StitchingSoftware", which I assume RU-vid doesn't require in order to detect it as ambisonic audio. Uploading a test now to check this...
Greetings from Peru, a query I want to remix a production made in Protools, this audio has to be exported from ProTools in WAV Stereo or has to be exported in another way to be binaural, and this audio I want to adhere to a normal RU-vid video, you have to encode in a special way the audio and video for binaural? or add any metadata? Thank you for your reply.
Hi Hugh, thanks for all your videos and help- I've been learning a lot. Question: I've been trying to use ffmpeg to mux video and audio together, and I keep getting the message "not writing 'chan' tag due to lack of channel information" and it's not rendering and output video. Any pointer on what to look for to fix this would be greatly appreciated, thanks!
Hello Hugh, I found your tutorial to be very comprehensive and insightful, as always. I'm currently attempting to compress a 277gb 360 stereoscopic render created from Unity 3D for RU-vid and Vimeo. I use stereo audio. Would you recommend using the same pipeline for this type of file? I'm thinking of following your guidelines concerning the 5k x 5k export in h.265.
Hugh! You are amazing. Your tutorials are equivalent to a degree course at any university. Brother, I have one question. Shall I use the same video application for making my project for Oculus GO/ PICO G2 4K? Will the settings remain the same?
Awww thank you!! Oculus Go yes. Pico G2 4K - you might want to run some test - as G2 4K has a better screen and can go higher resolution. I do not run extended test on G2 yet.
@@hughhou Thanks! If I inject with the 360 tool first and the 180 tool after that on the same file, it works. The 180 tool ignores the 3d audio, maby a bug or something.
Yes for RU-vid 180 does not support ambisonic. That is a Oculus TV thing - but you can use FB360 to embed that as well - check my other tutorial if you looking into Oculus release.
Hi Hug, thanks for all your content! I have a question for you about Head Lock. I too am trying to produce 360 videos with ambisonic audio + Head Lock for youtube and I followed the procedures you explain here, but when I upload them the audio has problems (the HL is in one position of the space and my ambisonic panorama completely changed). Talking with Angelo Farinam he was explaining me that currently youtube doesn't give more support with this kind of production. Can you confirm that this is the case? You can no longer upload ambisonic 1O + HL videos?
First: You are the best! The know-how and inspiration you share are of high value. Question: at 3:10 you mention that it is possible to export 1st Order Ambisonic from GoPro Max with ffMPEG, do you habe a link where this is described in more detail. Thank you. Best, Johannes
I detailed the workflow in this video description. Here is the FFMPEG command line you need (how to install FFMPEG check description): ffmpeg -i YourGoProMAXfile.360 -vn -acodec pcm_s16le outputAmbiXaudio.wav
@@hughhou Thanks to you I can export a 4 channel audio from the MAX it is in AmbiX if I'm not mistaken. But I don't find information about the microphone orientation in the camera. My question is, where is the north of the sound, on the display side or the other side? Thank you!
Hi, first of all great content! I am looking in your channel how to publish a 360 video in RU-vidVR to reproduce with Oculus GO. Im stock with that, I have the 360 video already in RU-vid but when I go to reproduce with my oculus go, I can see the thumbnail but not allowed to reproduce it. Don´t know whats happen.
I am switching from Vegas to Resolve, really struggling to get the workflow in Resolve for my video/audio I have the Zoom F6 with the NT-SF1 for audio, and I have the Insta360 One RS right now and may get the new 1" version. I have no issues exporting to binaural using Reaper and handling it as a normal stereo track in the video editor, the issue is the 4 channel ambisonic I need to use that in the video editor to match my cuts/film. So I have no idea how to export the audio from Resolve when its in the 4 track format.
@@hughhou Actually got it working only in Resolve now, that way if I cut my video and audio the cuts are part of the audio as compared to not knowing what to do with the original audio track in another program. Now trying to figure out a 6 track headlock workflow, much more complicated but I think possible. I think the FB Special Workstation would be very useful, but is no longer available.
This tutorial is using FB360 Encoder and Reaper - which support 16 or 64 channel ambix : ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-pLk53pXNrHg.html
I just got an H3VR and have several clips using it and my Qoocam 8k. I am wanting to make a documentary with the ambisonic sound and then add in background music and the narration. The only way I can see do so it would be to sync the ambisonic audio in Davinci Resolve and export and then use this tutorial to add in the music and narration. Is that a possibility?
Have you check this tutorial: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-pLk53pXNrHg.html - you use background music as HL Master and your H3VR as ambisonic source.
@@hughhou Yes, I have watched that video as well but, I am new to this and it is a steep learning curve. I am sure I will get it with the help of your tutorials. So to clear up my confusion, I use the method you linked above for Facebook/Oculus uploads and this method for 6 channel RU-vid uploads? You also state in this video that we can mux the video and audio with Davinci rather than ffmpeg. How would I mux with Resolve without ruining the 6 channel audio?
I’m working with a project with 5 stereo tracks and 4 or 6 mono tracks. I’m planning to lock the mono tracks and have the stereo tracks stay in the space. Would you recommend 9 or 16 channels? Thanks 🙏
In order for the sound to be in 3d: you need as many sound sources (speakers) as there are microphones and they must be located in the same area as the microphones (only in the distance). And in headphones, all you can hear is dynamic stereo. Im gona use Ableton live pro tools for musicians , to create a great stereo that would prove that it is easier than it seems with ambisonic elements it will sound cool. Do not make sound 192 kb\s this little minimum need 320 kb\s
Yes agree. I am not really an audio pro - I know Ableton for live djing but that is. Please and send me your creation. I am talking with DTS and they have this kind of speakers room with full room rigged with speakers - so we do need next level sound design - but this is out of my expertise :)
If I don't want headlocked stereo, can I still check the bottom option in the Spatial Media Metadata Injector, or do I have to insert two silent tracks in the soundfile to get 6 channels?
Hello Hugh, thanks for this and all your videos. I have a problem: Reaper does not find FB360 spatialiser of version 3.3.3 for Windows. It does with 3.2.0, but I do to want it, because it is limited to 9 channels (2nd order Ambisonics). Any suggestion?
@@hughhou thanks. I found a way last night thanks to the Fb group. ffmpeg hosting web server is actually down so installing the Video Player, the Encoder and the Spatialiser is a nighmare. But they provide a script to run on Ubuntu for Windows or from terminal in MacOS to fix this and “manually” install ffmpeg for Fb360 Spatial Workstation.
Thanks Hugh!! Any tip on how to bounce multi channel stems from Premiere so they can be easily imported into a different DAW? So far I have to solo each track and then export wave for each of them manually. Thanks so much :)
Thanks a lot for the great video, because of your explanation i was able to finally post a vr mix in youtube. The only problem i still have is the. mkv export. U tried 16ch ambi + headlock + h. 265 video i the facebook encoder, and no luck. Matroska isn't working neither. Do you know what is the proper set up to export for oculus rift and go. Thanks again for your your precious help.
@@hughhou the mp4 Facebook 360 and RU-vid with your explanation work perfectly. When i export from the encoder for rift or go it doesn't work. I use 16 ch 3rd order ambi + headlock stereo +video h. 265 with matroska and rift export. When i play the result in oculus player for rift the video is good but no sound, i can't hear my mix. What do you think?
uploaded some tests and they were all working on youtube, just checked back a couple days later and the ambisonics dont seem to work anymore? theyre all private vids, not sure what caused it.
thanks for this tutorial, I have a tutorial request: an easy as possible spatial audio workflow using only stereo audio sources (sound effects, ambient) with staying as much as possible in premiere. FB360 does get installed in premiere, can it work? how does ambisonic panner and binoraulizer work in this type of workflow, how can I got to reaper with as little messing about as possible? the reason is that I teach students 360/VR, it's complicated enough to deal with the visual aspects, I need to give them a solid easy workflow for spatial sound as easy as possible. they don't have dialog, or fancy mics for recording at this point, only post production audio they can embed on a spherical video (animation or video). so far both tutorials you made on the subject are way over their heads, and over mine too. :) so something for the complete newbies. monoscopic, 1st order ambix, that sort of thing
Thank you for the suggestion. Oh no this is too complicated? Yes, I can work on a simple solution. Premiere is not built for audio works - there are lots of issue when integrated with VST - Facebook actually suggest to get out of Premiere as soon as possible for audio work. So the pipeline knowledge - which I think it is really important to your students when they take on jobs in the industry - is visual and audio need to be finished in different pipeline, prob by different people. For professional job, I don't touch audio. I locked fine stitch and a stereo mix and bound the XML file to audio engineer (video to colorist) and they will mix it in Pro Tool, Reaper and do finishing. Maybe a good practice to group your students into team and work together? I will work on my end tho for a Premiere only tutorial. if you know Adobe, as I can not seem to reach them right now, I will need to run coupled issues with them. But I think I can give a simple tutorial if you only care 4-channel output without background music - this tutorial kinda explain that: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-cy3fqID1dxA.html
@@hughhou thanks. for now it's just about lighting the spark for them to work in the medium. showing them how cool it is so they can start to create! so trying to find the easy path to creation is my goal. for people not coming from audio, it's a lot of buttons to push with a lot of new terms in between. so for starters I thought something simple like 1st order ambisonic, monoscopic, so just 4 channels. for example, what I found in reaper for 4 channel to go from stereo->ambisonic, I can just work with the FB360 fx on the audio, even without bringing an xml, without routing to 3d master and control, without changing the channel settings of the tracks and export as 4 channel back in premiere, preview, and export. so I use reaper just to make my sources ambisonic so I can place them back in premiere, and close it from there. or mux it with the fb360 encoder. I would love to see more tutorials about how to work with the FB360 plugins with a video as a reference and the video player. I think this would help a lot for folks who are just starting with this medium because it's overwhelming as it is. I have seen the other tutorial you mentioned right now and learn something new! (monitoring ambisonic! who knew!) so I think for the newbies, who do 4 channel, premiere can work (with reaper to convert the stereo->ambisoinc) and I think specifically a tutorial for converting stereo sources to ambisonic to place back in premiere would be very useful. and maybe another way to create headlock? can't reaper merge the channels instead of audacity? and is there another simpler way than ffmpeg to mux the video with the audio? Thanks!
You can also follow the above link to directly render 4 channels in Premiere without going to Reaper. If you bring in 4 channel without any mixing, you can pan using Noisemaker or Premiere build in audio panner - and then just render 4 channels (set to mult-channel and render out directly)
CreatorUp thank you yes I have seen it. The main thing is the whole stereo->ambisonic process which I think is most valuable. I expect most newbies don’t record the audio themselves as ambisonic so using stereo sources in an easy way would be most valuable. Thanks for all the effort in making these tutorials and keeping up with the tools and techniques.
@@hughhou a few more questions: can't I create 6 channels merged HL+AMBIX from Reaper directly? maybe by exporting and reimporting again or something? do I really need another audio app just for creating the merge between ambisonic+stereo?
Are these steps correct for gopro max 4 channel ambisonic upload to RU-vid? 1. Extract ambisonic .wav file from .360 file with provided ffmpeg command. 2. Use the Facebook 360 audio encoder and select RU-vid 1st order, the ambisonic .wav file, mono video, and finally a hevc .mp4 4K video file exported from gopro beta player on windows 10. (After completion, I tested the video file in vlc and the codec of the file shows ambisonic) 3. Use the RU-vid google spatial injector tool and select the file from step 2 (which automatically checked 360 video and ambisonic but not top/bottom and I left it as only the 2 checked even though your video said to check all 3) to inject the meta data for RU-vid. 4. Upload on RU-vid? I can’t really tell if it’s ambisonic and head tracking from watching my RU-vid video that I uploaded with the above steps.
@@hughhou Thanks for confirming. I actually followed your steps with ffmpeg to get the 5.6k video. I was on the fence for a while between insta360 one r (with cool/somewhat gimmicky effects), kandao 8k (a little to complicated with issues for regular user) and gopro max for 360. I got to play with the insta360 one r twin edition for a bit (not long enough to see if there is lens fog problem though). I was super tempted to get the one r for the 1-inch mod but I already have a hero 8 and was not ready to give up the superview with hypersmooth boosted at 4k30 after the update for snowboarding. The primary purpose of my hero 8 is for action videos so I think it is still the best for that purpose. Besides getting a good deal on the gopro max, I also prefer the protune gopro color and the better built for action. But the final deciding factor is the max's spatial sound. I enjoy 360 videos and VR. And I enjoyed the max spatial sound videos on youtube. It appears that an extra standalone ambisonic recorder is delicate and the cheapest zoom h2n is around $170 new (slightly cheaper used). I plan to try the higher order ambisonic in your guide later on for some vacation videos and to put one of those deadcat windshield on the max's mics. Although still behind in software (it's not worth it to pay for premiere pro for us hobbyist) gopro finally released a 1.00 gopro player for pc users and at least a 3k60 slowmo.
Hello, I extract the 360 Audio (4 channel audio) with ffMPEG, like in the description under the video. But I still have some questions: Where is the north of the audio relativ to the camera? Which format is the file? It says AmbiX, but not whether it is A- or B- format. The waveform has signals in all 4 channels, so is probably not B-format 1st order AmbiX. Which is the right setting in the FB360Spatializer PlugIn in the DAW (Reaper)? Do I have to convert it also with an A-B converter like with Sennheiser AMBEO? Is there a manual / tutorial somebody know of? Any information is welcome. Thank you very much. Best, Johannes (I postet this question in a thread above, but for better visibility I reposted the question here.). BTW: Does someone know a newsgroup about 360 Video/Audio)?
It is B-format - The north info is with the camera north - but this question better post on the GoPro MAX user group and ping GoPro support to answer :)
I'm having the hardest time getting to mux the 6 channel audio to the rendered video with ffmpeg. I have tried so many times this code, several file directories. And can't find your video on your detailed ffmpeg copy paste codes. D:\360 project\ffmpeg-4.3.1-win64-static\bin>ffmpeg -i Red Rock test 1.mp4 -i "Song_1_from_Audacity.wav" -map 0:v -map 1:a -c:v copy -c:a copy output.mov 'ffmpeg' is not recognized as an internal or external command, operable program or batch file. I've tried to create a folder in my C: and it looks like this: C:\>Users\The Buckness\ffmpeg-4.3.1-win64-static\bin>ffmpeg -i Red Rock test 1.mp4 -i "Song_1_from_Audacity.wav" -map 0:v -map 1:a -c:v copy -c:a copy output.mov Access is denied. This is the message I received.
I have followed all the steps and have the video ready with the exception of muxing in Resolve Not sure which audio output settings I should use there. I side loaded it into oculus quest 2 to test, but the audio is locked. Is that because they use different methods? Will the ambisonic not work in some apps? I tried deo vr and skybox but the audio is locked. Is there any way to test if the audio is properly rendered for youtube 6 channel before uploading and waiting 2 days for the video to render? Thanks for the help.
Hi, man! You have a great content, but unfortunately I still cant't understand how to make clip in davinci resolve or premiere, and then export it to VR format. I mean that I want to have several videos combaining together with choosen first moment racurs in each other, and then export hole video. I use FX Reframe for premiere and the same in davinci. But in davinci I didn't saw the VR export function at all. May be You can explain me dirrectly, or You could make a video for this? how to do vr videoClip and then export it using davinci and using premiere. Hope U will see my message=)
where are you running ? : 10k video, ambisonic? and you don’t even have this video in stereo. Learn to make at least NORMAL stereo. on insta360 evo stereo sound, there are two microphones there that is enough for VR 180 stereo video.and there is 5.1 sound that's more than enough for vr 360 stereo.
@@hughhou ok I got it working for youtube 1st order. Trying to encode to facebook 3rd order with headlocked audio I get error 8 channel instead of 2. hmmmm and then the spatial audio doesnt work without headlocked with facebook 3rd order
