Hugh's note: The new version of the software v1.1 has just been released. It increases the speed of rendering and previews 5X time. If your system is suffering before, give it a try.
I bought Rezup but its a disaster. I tried to enhance 100gb prores 8k 360 x4 footage. It says it takes 63 hours to complete, even though my computer doesnt have bad specs (i9 12900, 128gb ram and rtx 3090.gpu). Topaz video ai 5 enhances it in 3,5 hours to a prores file. I should contact the makers of Rezup.
I've found that I can get better noise cleanup from my ONE R 360 footage by using Resolve's temporal denoise filter. It works better than Topaz for me. I render the Resolve denoise footage into DNxHR HQ for lossless compression. Then I import that into Topaz to do my AI sharpening. My workflow works well but it's very slow so I'll be very interested into checking out Rezup. Thanks for the great video!
What is your resolve temporal denoise setting? I am on M2 the the resolve denoise is painfully slow. Blackmagic said they will fix it. But I also do not get better result than Neat Video - it will be great the fix the noise problem at color stage as I use resolve to grade
@@hughhou My temporal settings are: Frames: 5 Mo. Est. Type: Better Motion Ratio: Medium Luma: 25 Chroma: 25 Motion: 25 Blend: 0.0 It took 632 seconds to process 7843 frames (5760 x 2880), or 12.4 frames/second My system: i7-5820K Overclocking to 4GHz with a RTX 4080 GPU. So my system does temporal Resolve denoise pretty fast. But when I do Topaz AI processing, my system crawls! It takes about 1 hour to process 1 minute of footage. I need a new CPU with lots of cores.
@@hughhou My workflow is: Insta360 Studio export 360 video to ProRes422 (Lossless) Resolve DeNoise export to DNxHR HQ (Lossless) Topaz AI export to PNG frames (Lossless) Resolve combine PNG frames to original audio, export to DNxHR (Lossless) Then Resolve again for color correction, editing, final export to H.265. So my workflow is entirely lossless until the final render. It's kind of complicated but I just batch things up and let it run on my big PC while I do other work on my laptop. Rezup should help me to simplify my workflow by just using the original ProRes export from Studio 360 (I hope)!
@@RealGaryGibson RTX 4080 - That is why it is so fast. I only have 3080 GPU lol... and M2 Mac. Topaz does not officially support RTX 40-series yet just FYI. On Apple it is a lot faster.
It is wrong, that Topaz is subscription based. You pay once and use forever. Just 1 year of updates but it still works after the year. Rezup etc. do it exactly the same way, there are no lifetime updates either and you have to pay for each new major version. Furthermore Topaz is cheaper when being fair since it offers not only upscaling but also upframing etc. Am I missing something or is this just wrong in the video?
Thank you for the feedback. Yes Topaz update a lot and basically useless if you lost subscription. Rezup as far as I know it is only 1 time purchase. But I might be wrong as I have full bundle - all the Re:vision plugins for VR works (re:Lens and re:map for STMap and virtual production). Go for Topaz it is more user friendly and AE plugin beta is coming
@@hughhou Why is it useless after I loose the subscription? I still get the same results just no further improvements, but it's absolutely fair and common to pay for a new major e.g.
As always great information! I’m using Topaz also to increase frame rate from 30 to 60fps for using inside headsets. In this case there are other options or you think that the internal upscale of Davinci can get some similar result?
For increase the frame rate, we use Twixtor and combine it with Topaz actually. It is a difficult topic as none of the AI tools do a prefect job of frame conversion yet. Some free open source Ai tools actually work better the paid one.
Although these don't have any integration into video editors, I recommend checking out CAIN and RIFE. You'll get much better results compared to Topaz. CAIN in particular tends to blur rather than warp due to it using channel attention rather than optical flow - resulting in a more pleasant interpolation result in motion. If you would like a gui for these I recommend using enhancr :)
Oh you should try it. The new 18.1 has so many improvement - I am new to fairlight but I love it. I don't even use izotope any more since Resolve is so much better.
Yes I am testing it next week - It is still beta as they told me in a way native app will pull more Tensor Core rendering power. But I heard the stability increase a lot. I will test it and report back.
Reframing 360? NO! We want this for full VR :) Ah, a bit in there is mention of full 360 :) Very exciting. We can see ourselves saving thousands of dollars on 360 camera hardware :) Now, how will this tool work for 180 VR?
For VR180 it is the same as 360. It will work natively within your editing software - you can pick less aggressive / faster options as your vr180 video probably from higher end source like R5C or FM Duo.
@@hughhou thank you. We have tried Topaz Video AI (latest version) to see if we can improve 360 shots from the Insta 360 X3, but the effect is basically the same image quality at higher resolution. Bigger files, same terrible image :) Are the results better with this software? No stitching line is great, but how about increasing detail?
Hello Hugh, great work as usual. I got 2 questions (maybe you'll find'em stupid) 1. In Premiere workflow you uncheck the sequence 360 metadata - why is that ? 2. When render i guess i have to check video is vr , echirectangular, 360/180, side by side etc I ask you this because i use to shoot Canon r5c @4k 10bit @225Mbps 60fps and i wanna reframe to 6k (i know i can shoot 8k raw, but i got my reasons). The stitch is made with premiere plugin and render @60Mbps then i came back in premiere for color and editing (CG + Clog3 + lut).i wonder if its ok to use Rezup in the same stitching session. After i come back in premiere for color and edit, it doesnt bother me. Thx and sorry for long post.
Thanks for sharing your knowledge and expertise Hugh. This is really helpful and informative. I've been using Topaz to upscale my 360 videos to 8k then editing in PP. This will really help produce better results. Off to purchase a copy and try it out. Thanks. 👏🏻👍🏻😊
Another awesome tutorial. Wind noise is always an issue filming outdoors and this tool in DR will certainly change that! Most impressive. I was wondering about the no mans land between 8k and 4k on youtube, now I know. Thanks for giving us a heads up on that! Didn't they used to allow sizes in between, I swear I've seen 5k or 6k video before? Keep up the great work Hugh, love watching all your tutorials.
Yes it did. Then RU-vid change that and all my 6K x 6K video become 4K (very bad for my viewers and it does make me look like a lier...). There are lots of complaint on the Internet. But RU-vid is not doing anything to fix that so there is that...
@Hugh Hou Could you provide some downloadable upscaled 360 footage of the ONE-RS 1-Inch 360 Ed.? That would be absolutely incredible, since I am currently missing the needed processing power and plugins to try it myself. If the link was available before the next Saturday, I could test it on the rented Meta Quest 2 of a good friend of mine (he sends it back after that). Have a great day, and thanks for the insane effort you put in your videos!
I don't have any footage upscale available yet with this solution that is not copyrighted current. In a big job right now everything in the pipeline is commerial projects :(
@@hughhou Oh okey...I understand. (A spontaneous 1 minute video anywhere outside while walking handheld with no effort in setting up a scene or anything would also be amazing just to see how the upscaline looks if watched in VR. I also will mount the camera on a selfie stick in my backpack and film my vacation / walkthrough through cities while just walking there, so that would anyway be a common use case for me. But I don't want to bother you with that 🙈)
I don't see stitch line so far and the example here is shot on x3 and one rs 1". One RS 1" has stitch line in Topaz. X3 actually work okay - it depend on your source resolution.
Hi Hugh... as always, tons of information... In our situdio we are so happy after watching results using VR 180-3D using footage in 8K form Canon R5C and 5.2mm fishe eye dual lens... but after that, we have delayed a bit the 360 content form the inste 360 One R... in most cases because the amount of pixels in the final result watching on youtube at compressed from 5.7K to 4K or even directly inside Oculus Quest 2 at 5.7K is dramatically lower than 8K footage from Canon R5C... I think that using Rezup will be a very helpful tool to promote a bit the 360 content to a better level and to feel more comfortable with the final result... specialy because most of people love unusual points of view as the aerial 360 fotage with full drone deletion... After that... just about 2 questions.. in order to "drone deletion tecniques" as clone sky in a separated layer or even using Mocha Pro... would you use first the Rezup to upscale to 8K first and then drone deletion process or viceverza?... and second question... is Rezup an "Only One Payment" softwae such as Studio version for Resolve o even is a anually model to pay USD 167 each year... I didn´t have seen information about it in Rezup website..... Thanks a lot again for the info... You are a crack!!!
THX! Really helpful info here! I just started doing spatial audio on my freshly born channel and was wondering how to optimize the AI video workflow! What sharpening profile do you use on your X3 while shooting 360 footage when you AI enhance later? Is it recommended using the "LOW" setting to avoid the X3 sharpening?
X3 I usually just shoot manual. Also sharpness turn all the way down to avoid Halo in 5.7K 30fps. I mostly use One RS 1" tho unless the camera is on drone or snowboarding like this video - fully action sports.
As always another great and hugely useful video as I was getting tired of trying to reduce the number of renderings and edits to preserve better quality. Maybe you can give me an idea if it's possible to adjust the FOV of a 360° video through Davinci without reframeing. For instance you know that you can zoom in or out in the Insta Studio, but the export of 360° doesn't save that FOV and the export has a very narrow zoomed in FOV.
Neatvideo is for denoising only. Rezup is for upscaling. I will sue NeatVideo first for denoise and then REZup to upscale (without upscaling the noise) - usually have better result than Topaz that way.
Trying to follow this video to upscale a 6k to 8k video and media encoder is telling me it will take 180 hours to render. Anyone else getting better results than this? I have an i9 11th gen cpu and a 2080ti gpu and I can do this same upscaling on topaz in a couple of hours, why is this taking so long?
Hey Eric, the public version right now still not fully optimized yet. They will have an update soon. The update will optimize for OFX plugins first - which mean DaVinci Resolve and Nuke. And they are solve multi-thread render in After Effects b/c of new update in Adobe break the support. So give it a week or two or I will ping here again when update come out. It will be 4x time faster when the plugin can leverage the new multi-thread rendering in After Effects.
