Real-time Compositing in Unreal Engine 

Absolutely amazing! So glad to be living in a time where this is possible.

Damn that was an amazing performance from the actor!

Awesome, but there was a lost of opportunity. The director should have had the subject walk through a virtual wall. We would have loved to see that.

Wish I had huge studio space like that. Dope effects 👌

Oh hell ya, this is 3 years old and still looks better than most of the stuff you see today with UE4 lol...I want this set up : )

Very nice- the key works pretty good! 🎉

This is awesome and terrifying at the same time. Can't believe anything I see on TV anymore.

Amazing setup

absolutely incredible.

Holy fuck this looks amazing! Subbed and waiting for more tests!

Wow, this is stunning. I hope to see this technique exploding in the near future, the capabilities here are staggering.

Plot Twist: The computer monitors are also green screens and this is all fake.

And just imagine how much nicer it will look with a dolly grip pushing the camera!

They are using Ultimatte 12 by Blackmagic Design for the hardware keying. It retails for $10,000USD and from the looks of things, its worth every penny! I love Blackmagic Design and currently edit and colorcorrect using DaVinci Resolve. Wonderful video that shows the good work they are doing.

That's really cool.. ✌ Unreal Engine is the Future of Film Making...

incredible! fantastic

That’s AMAZING!! 😝☝🏾❤️❤️❤️

Fair enough! This is impressive!

After watching this I'm not even sure the steak that I had for dinner last night is real.

man that's amazing

This is unreal!

Holy shit! That's incredible. Just toss a giant green screen on any old soundstage and you can shoot like you're anywhere.

Thats amazing!

*she:* babe are you at home? *me:* sure I am *she:* *calling me facetime to check if I am home* *me:*

THAT IS HOW NASA DOES THEIR SPACE VIDEOS

I'm amazed that an engine stemming from a shooter title has evolved into this. It's a shame they left that initial core gameplay that made me fall in love with the game behind for the most part (new UT isn't as accessible or fun as the previous titles.) Personal nostalgia attacks aside, this is simply awe-inspiring. UE community ftw.

that's amazing!

Seeing is no longer believing

I want to see you do "The Ghost", walk through walls, walk through the sofa ect...

Amazing!!

NICE!!!👍🏼

this is insane

Anyone else wanted to see him walk through something?

Anyone still remember when seeing was believing?

Awesome work it's very impressive! Now apply that same camera tech and do a 360 degree with a multi cam setup. So you could capture a full performance and place it literally anywhere.

soo good

that is amazing

牛逼的卵样的！good work!

This is absolutely astonishing guys! Very well done! Just a quick Q, would it be possible to achieve this at home? With a selfie stick for instance, I have a student license for both Maya and After Effects but not UE4. Should I decide to invest further, what would your advice be? Also, please do consider making another video in tutorial form or at least one describing the process and any hardships experienced during the experimental phase.

Genius......👍👍

Gamechanger.

Excelente

Нормуль))))мне понравилось)))

Looks so awesome!. How are you guys placing the live actor in the scene - obviously you are not using a 2D plane otherwise it would look weird? It's the post processing running through unreal engine to make the actor 3D in the environment?

Avatar sequel is currently shot with real time depth compositing developed by Weta Digital.

They're using the Unreal Engine 4 real-time compositing www.unrealengine.com/en-US/blog/composure-compositing-tool-sample-released Damn under powered video consoles They really are holding gaming back.

Tech used www.onsetfacilities.com

Really nice. We do a fair bit of green screen work. But really interested to get into this work flow! What’s the signal chain from camera to UE4 you using?

Damn. It even got his shadow right.

We have an amazing test on its way, shooting tomorrow, subscribe to know when its up!!

just wow :o

buenas..excelente!!! que capturadora estan usando? y con que plugin realizaron el recorte quedo muy bien.

Damn now I know why the couch is so hard!

Great 👍🏻

This is great! Question, where does the Ultimatte 12 fall into the workflow? What inputs are you sending to it?

this is where all your spiderman no way home shot, no need set, just 500x500 meter place will do all the movie need right now

I AM CONFUSED, TERRIFIED, AND EXCITED

I'd say everything looked super smooth except the couch part.

Funziona chavalin

this is my favorite movie. chair sit

Oh my gawd.

Great work, what tools i need to make compositing, how i can connect camera

Ok we're ready to see someone walk on the moon or something cool

Oh geez the matrix is real!

You guys must of spent so much work on this one! You must have some pretty expensive computing systems to do it all live!

Great 👍🏻 After ,How do you recording project ?

How did you render the background separate from the live camera? Is there something I can do in take recorder to disable the live camera so that I can record the background only? Any help would be greatly appreciated. I’m stuck on that at the moment. Cheers and great stuff!

Que top

What camera is he using that's allowing Unreal Engine to track the camera movements? I'd like to be able to do this for myself too.

Wow, its cool and better, like a cheap version of technodolly or something!!! what tools do i need to make it like that? 😍😍😍😊😊😊

With some software, connect the camera in real time to remove the screen greenery and other backgrounds

wat wizardry is this!?

Has my life been a green screen this whole time?

I want to see him do something wacky, like when he gets up from the green box walk to his right instead of the left and into the virtual wall.

NASA loves this technology.

Hhmm I guess the next challenge would be projecting lighting on the real life objects/actors so they would fit the scene more.

I was gonna call BS, but then I saw the Screenspace reflections blending away on the window and sofa!

Man that actor's head is massive.

Woow... But how did you include d man's shadow

Asi hacen los videos de la NASA

que pasada

Wow! So this is how commercials are made?

Good works. Green screen with tracking matchmover?

Pues parece que si funciona

i dont see trackers on the greenscreen wtf how did they track the camera

I would love to be apart of this

Sir, what processors do you do in your video editing system ......?

Why did the actor look so angry to be in that beautiful home?

Very clever technology. The plot and writing were crap though. For example @ 00:46 I can see what the director was going for. That particular frame and drawn back perspective. The character was dwelling on his past mistakes and that's supposed to express his despondency with feelings of discouragement and dejection. It simply didn't come through strong enough. Maybe if you used Tom Hanks, I dunno. Yes I'm being facetious. Anyhoo, looks really good.

I don't doubt that this technology is possible but why are the movements of the guy on green screen not identical to what is in the monitor? At first I thought it was a small delay due to the software but it isn't exact movement happening consistently like an echo but rather slightly different through out...especially in the arm swing. I may be wrong.

Juan Mata???

George Lucas just jizzed his pants

What is the best processor for video editing....?

Plot twist - the studio is also a render.

We are living in a simulation.

oof, pretty good.

How is the quality? I mean can be made true Hollywood feature film with this unreal engine compositing?

Which soft do you use in this edit

No trackers? How are you tracking spatial position and the lighting?

Walk behind the green box! I wana see him clip the couch.