VFX Artists DEBUNK CSi "ENHANCE" Effects 

JUST 8k? XD

@Steven Shorts 🅥 no

8K is only 33 megapixels lol

@@Velgeiss bsd

800k maybe.

Maybe we already have and they're just holding back on the public?

@@ROBOHOLIC1 if so, we wouldn't have so much unsolved murderers and criminals.

Fourth

.

So you’re just ignoring when they actually enhance? When they were looking at license plates, that’s the technology needed. It is just based on numbers because we don’t have the processing power to be able to enhance a hat.

great! as a recording engineer i would love to see this!

Foley artists. There are a few RU-vid vids about what they do.

We need that series considering the fact that I've just came to know that the dolphin sounds use to censor slurs was actually the sound of a kookaburra in faster speed.

Like the Squidward Walking sound

Oh I would love if they did that. I remember there was a tutorial they did once on punching sound effects, but I'd love to see a bunch of audio stuff broken down.

Because simply clicking one '+' to zoom in would make a boring show :P

@@Shade01982 I would argue that using this tired old cliche scene (wait what’s that? Zoom and enhance!) to advance the plot already makes for a boring show

@@matthewwright2524 True...

That's how brilliant the technician is. He's programming ai in real time

Are you sure you're not thinking of Red Dwarf? (Which was British)

@@jsl151850b No, the Red Dwarf scene was "uncrop, forehead, through a window at other end of street, a doorknob, a faucet, out the window again, a car door, a building's glass door. Video ID 2aINa6tg3fo

what's the name? I'd love to see that lol

I’m dead bro lolololol

What's the name of the show?

I second this!

i would love that! also you have a lovely hat.

This is a totally awesome idea. I want to see it happen now!

Love this idea!

yess

Un-crop!

😂😂😂🚑

Red Dwarf was a comedy, so that just shows how long that's been a joke... Unless that joke was in the revival series?

That's what I was thinking. If you have one-second 24 fps video, 1 frame is only 1/24th of your available data. Use it all!

It doesn't help that they were also doing this with a 2D 'mask' instead of an actual 3D face.

I was like screaming use the plate number enhancement tool, it tracks the plane and stacks with opacity bringing the details up

This would be a very cool followup!

yes please that sounds like it has a lot of potential!

Which episode was that from?

@@lightcycle87 I think it's when Bart was trying to find out what made skinner such a boring square, so it's the episode where Bart finds a prankster who put worms into a swimming pool. I could Google the episode name, but I'd guess its called 'pranks and all' or something like that.

Maybe CSI is in the same universe as Person of Interest.

A little bit like SIBYL in Psycho-Pass? xD

@@taylankammer Yeah... Honestly, that's a Netflix anime adaptation I'd actually watch. CSI but it's in the same universe as Psycho Pass

Even such net wouldn't be able to recreate whole picture from one pixel.

It apparently happened in the Kyle Ryttenhouse trial

I mean, your brain does the same thing for what you're actually looking at in real life, so this is really just semantics. The AI definitely does *not* invent details from nothing. It reconstructs (yes, reconstructs) detail from context. The real question is how accurate the AI is at reconstructing this detail. That VFX artists don't fully understand upscaling AI is not surprising.

@@skipfred the difference between inventing and reconstructing (the way you're using the word) in this context is just semantics. You can't use AI to prove or even indicate what was there irl

@@soundninja99 The way I'm using them is exactly how OP used them, so yes it is semantics, that was my point, but it's not a semantic argument because we're agreeing on OP's original usage. Saying that you can't use AI to prove or indicate what was there is like saying that you can't use blood splatters to prove or indicate that a stabbing occurred. Yes, you very obviously can because of *context*. The question is whether or not the investigator (or the AI) is capable and reliable, not whether it's technically feasible.

@@skipfred fine, it can be used to indicate what was there to the same degree as some investiigator staring at it and guessing what was there

The only way you could use an enhanced image like that would be to find a vehicle (or person) and then find additional REAL evidence to use in court.

@@angelbear_og indeed and with speeding, usually the photo is the only evidence.

was it an AI algorithm adding detail, or simple math translations?

"But . . . they did it on CSI!" I think prosecutors are hoping for jurors who don't know a thing about image enhancement. I'm glad the defense saw through the state's BS.

Ah, the idiocy of archaic courts.

What if the reason they don't enhance immediately is because the computing power is so much, every time you press enhance it costs thousand of dollars lol I can imagine if such a thing is even possible it would require using some super computers to completely recreate things

The enhance feature only works in the presence of a trained technician.

A goat must be blood sacrificed every-time they enhance, so they try not to do it too much (blood sacrifice is the only logical answer for there enhance "algorithm")

@@durza7173 a trained technician guided by an authority figure, of course

They are actors, they love to have lines to speak however silly they might be.

that's actullay very accurate

so, google street view

Exactly it feels plausible in a "big brother" surveillance state

@@SOLIDSNAKE. No, it really doesn't. It kinda would make sense in futuristic scenes like Star Trek or something to that effect, but a scene that takes place in current day, no. Even assuming all those devices are even aimed at what you want to see, the majority of those are not going to be of any better quality than what you already have. The resolution is not going to get any better. You know just have two blurry images instead of one.

not sure if that'd explain why the image of "Nuevitas" was flipped vertically clearly, they thought - well, words appear backwards in a mirror, so we'll flip the image horizontally, then rotate it to where we need. That'll be fine, right?

this is the same reason why blurring or mosaic-ing text is not enough to obfuscate it since you can just iterate through blurred text and see what matches

Mans was on the grindset

Man the police really go to the nines to catch those speeders.

That sounds like some reverse logic and should not be allowed in court

​@@rp9674 I think the principle is that it was able to narrow down a list of potential suspects who could then be investigated and one of the suspects panned out. So the license plate enhancement couldn't be used to convict the person as it was inconclusive, but the evidence from the investigate that followed could. Now it would be in error to assume that one of that group of suspects must be guilty and that the most plausible suspect was in fact guilty because the pool of created suspects might not include the guilty party. But it would not be in error to investigate and see if you could find the guilty person among them with more conclusive evidence. Like maybe you eliminate the vast majority who had great alibis, then focus on the remaining few.

And the pieces of the enterprise fell back down to earth in the form of “Chocolate rain” You may have stayed dry but the others felt the pain

They literally build interstellar spaceships. I think they can go a bit better than Atari level computers.

RLM recently brought this up if I recall correctly. It is fun to imagine how Klingon culture deals with scientists and nerds. They've got starships and all, but...how?

@@FangsFirst they probably have a planet in the empire that is tech support with a conquered people on it. "Welcome to Zainar Technologies how can I help", "Tell me how to make the view screen work WORM", "So I understand you have a problem with the view screen, is this a Brell or a K'tinga?", "THIS IS A VORCHA P'TAK", "Oooh sorry, the Vorcha uses an M117 Digiplex Viewscreen, you want a different support line. Please demonstrate your honor by holding." *music starts playing*. Klingon Captain: "I'm not dishonorable, I will wait through your music. *taps foot*"

To be fair, it wasn't the Klingons that pulled it off. Soran was the one smart enough to bug Geordi's visor. The Klingons just had to watch the footage.

It really has! the licence plate demo straight up blew my mind with how the AI took basically nothing, just incomprehensible smudges, and figured out what it said.

Out of darts comments : 7 likes How

@@justleo5997 The license plate demo didn't use AI (5:18 - 5:35), Niko explicitly points out how that was just mathematical algorithms. If the application did use AI there would be no way to guarantee what was real information and what was generated information. Given a solid enough model and the correct type of AI algo it could be sort of possible to do this with a high enough confidence to have this be admissible evidence, but I wouldn't trust generative AI to be able to do that, maybe a neural net that is well tuned but in general nothing is better than just solid math. Not everything is AI, software and math have been doing these things incredibly well for a long time.... I guess the Mark Ruffalo thing was impressive as long as you discount that the team was primed with information about the image, and then refined the generation with the additional information. This would mean that if used in a real court, not only would a eye-witness testimony (which at this point DNA evidence and project innocence have proven eye witness testimony is nearly never reliable) be a part of this, but the results would be dependent on the type of model, the input parameters, and the model training to perform the enhancement of the "Evidence". AI is a great tool for some use cases, but its not a panacea, and its certainly not something that should be trusted with matters of fact.

Well, google maps and other civilian services provide satellite photos that are clear enough you can sometimes spot individuals on them. Stuff not for public access like government and military sats should be of even higher fidelity, so it's not particularly impossible.

while not satellites..... there are actual military drones these days that can do that (UAV miltary drones that fly around cloud height, some use up to 500 separate sensors similar to a smartphone and than record and send that feed to a technician in real time). the key difference with high tech miltray drones is they are equivalent to 2500 combined megapixles.......for perspective 4k video is 8 megapixels

@@scottmantooth8785 maybe because it doesn't exist? Even it existed it should've died from old age

@@DarthBiomech Google map doesn't use satellite data for the most detailed zoom levels. They use photos from planes overflying areas, which is also why the maximum detail level can vary from area to area, since it depends on whether they have airplane photos from each area.

@@Carewolf Commercial satellite resolution used to be limited to 50cm/pixel by U.S. law until 2014 - then they allowed up to 30cm/px native resolution, however some companies started offering even better 'synthetic' resolution - basically A.I. upscaled. Best I've seen is 15cm/px by Maxar. Spy satellites are said to have resolution up to 5cm/px which is still not enough to read license plates or recognize faces. It's much easier, cheaper and far less regulated to achieve higher resolutions using planes or drones.

I was thinking the same thing. That would provide a lot more "detail" (or at least "data") to work with.

@@justaviking yeah! Astronomy programs can stack frames like that, so that’s an obvious way to be more ”state of art” if implemented well

Wouldn't that just reinforce the blocky, pixelated features? Give the AI 30 frames of black holes for eyes and over exposed face and it will just assume that's what it's supposed to look like and not correct it.

@@radioethiopiate9327 It's how jpg handles brightness, combining some greyscale preset images (quantization table, technically) to generate a more detailed composition, the only issue for this usage case is nailing the alignment, but I've manually done this in the past and athought still very soft, figures can become way more recognizable.

I saw some tiktok about something like this where a guy took a video of a spinning record and then took the average of all the frames in photoshop or smth and it was suddenly really readable

Would you be able to do photogrammetry with multiple security cameras? I know that there's some pretty good software for it nowadays

@@xWood4000 Yes, in fact you can. You get a blurry mess as an animation but you can. Look for radiohead-house of cards for an example.

Closest tech to this now is NeRF i guess. They generate 3d model and textures from one photo

We laugh at it, until we make it real :)

@@xWood4000 actually in batman arkham origins they do make a holoprojeciton of the crime scene and you have to connect the evidence to fill in missing data, is pretty cool

You can do that with good DSLR, no need for 3d modeling.

Is this so that it is verifiable in court? Really brings up an interesting topic in the near future as more and more black box algorithms are used to run things.

@@philipfahy9658 Yeah, basically. Black boxes can be a nightmare. As a technician, I documented my process as best I could. If opposing council has an issue with my results from a black box, they may just have to bring it up with whoever created it.

@@peterehowell Yeah and it gets worrying when you realize how poorly most of our politicians understand the internet. I can only imagine what level of familiarity or lack thereof different public institutions have with this technology.

If Kyle Rittenhouse trial is representative of your average trial then the CSI one is closer to reality where the prosecution just phtoshops shit in to fake evidence.

​@@XAJUSS And yet it was still allowed in. Later we had the HD recording leaked that showed that the "reconstruction" is bullshit, they cropped, reduced the resolution and sharpened it up to make sure you cant tell whats going on. But yeah, the prosecution was awful, and showed how corrupt the legal system is. My favorite part was when the prosecutor pointed a gun at the jury with finger on the trigger while talking about gun safety, peak comedy ...

I was willing to allow _Blade Runner_ as well (which appears in here). Fancy super future technology where replicants exist? Sure, why not.

@@FangsFirst That’s a very fair point!

There was a TV show called I think Continuum, where the lady was from 200 years in the future and her nanosuit thing accessed the security cameras of every business downtown and created a 3d reconstruction of a vehicle moving from their footage and in cases like that, yeah just go with it. For the TVA, they can do whatever they want, they have Time Magic

some pornbot stole your comment, so i subscribed to you

The original comment

I would argue Blade Runner gets a pass because it's not a Polaroid, it's supposed to be a science-fiction-y holographic photograph with unspecified 3D-type features built into it, which the machine he inserts it into can manipulate. In the movie, he adjusts the perspective of the camera such that he sees around the frame of a doorway to reveal what's behind it, and I suppose in any case that's pretty implausible. But at least they make it clear this is all some technology that's foreign to us, something in the future that doesn't currently exist. CSI doesn't have this excuse.

@@mikekohary1075 That's actually pretty good.

In order to zoom in on tiny objects on security footage like they show in the movies, there camera resolution would have to be extremely high to pick out those details.

Mine is the lack of marksmanship by law enforcement officers that have supposedly spent years training with firearms missing shots that I know I could make cold even with my limited ammo supply and range time.

As a programmer, the 1000 word-per-minute typing in a lime green command console to hack into the FBI in 10 seconds tips it for me.

@@TheMightyHams sounds like you're just not good enough at your job

@@phosphatepod Very true, I'll download some more RAM, switch my editor to green highlights, and deploy some swanky UI loading bars with flashing red warning labels. FBI will stand no chance.

They didn't call it sharpening? They called it deblurring. And they were referring to motion blur.

@@plzletmebefrankthey called it both sharpening and motion blur, you can use deconvolution to remove both motion and disc blur. The ripples around the edge are an indicator.

@@alan2here Fair. They are probably just using terms people like me can understand though. It's definitely more complicated than they make it out to be, but the software hides a lot of that complexity within itself.

That's something I hadn't thought about! If you're talking about trying to flatten an angled image (as per the second license plate example in this vid), does the type of lens used in the original camera make a difference? Like, do you need to know what kind it is so you can calculate how much it may be distorting the image? Or can the software just work out all of that?

Sounds like those differential lens tests the optometrist always does when one is getting fitted for a new pair of glasses! 😂 "Is it better like this....? Or like this?"

It sounds like a rather extreme extrapolation of keystroke recognition, the existing software that can capture and individualise people's typing patterns?? 😆

My phone screen does have a fingerprint reader built into it, so this is not entirely ridiculous. A lot of phones do.

@Don't read profile photo I read your mind, you sick puppy!!!!

Unfortunately the OneWheel scandal...

You serious?

lmfao

@@kappadarwin9476 yeah, it was great! That's why Gordon is the best! He's a magician

The victim was standing in front of the mirror. We can't see the perp, but we can partially see the rest of the room in the image. What's that? Enhance the victim's eye in the mirror. It's a fishbowl. Apply inverse focal length and water light refraction. Zoom in on the fish's eye. It's our guy! It was the butler all along!

@@mac1991seth lol, exactly 😂

There was a scene like that in an episode of Red Dwarf.

@@mrcydonia "Uncrop!"

Well they kind of already did it was in blade runner the original one

you can be your own Wren

@@holliswilliams8426 not like wren. Wren is a special breed 😇

For ten minutes, then you just want to lock him in the fridge for some peace and quiet.

?acting

The human Labrador Retriever

Yeah, I'm pretty sure you could get a much better image of Mark Ruffalo if you took the raw footage, then motion tracked the face and stabilised it accounting for distortion, then superimposed all of the frames and averaged them out. If you think about it it's the same idea as the motion blur number plate example Niko was showing, except spread out frame by frame in the video. If you took all the frames and composed them together you can get more data out of it.

I was thinking exactly the same thing. I was half expecting the swirl face case to come up in the video. It was actually a nice case of karma. The guy in question was a prolific producer or trader of child pornography and his online avatar image was his face made unrecognisable - he assumed - by that swirl algorithm. The police 'unswirled' the image and then found and arrested him. His name is Christopher Paul Neil and he even has a wikipedia page if you're interested in the story.

@@bucklogos That's the type of thing intelligence agencies were doing years ago with specialized software that could provide greater resolution than what the camera alone could provide. One guy who had done work on satellites, though limited in what he could say, pointed out that while a camera in orbit taking a picture had a certain minimal resolution, taking _two_ images in rapid succession could, hypothetically and with the right processing, be functionally the equivalent of taking a single image with the optics of the camera being the size of how far the satellite had traveled between images, thus vastly greater resolution.

@@bucklogos I agree, stacking multiple frames from video should give additional information (after correction for changes in angle). Astronomy software such as Registax does something similar

The

A gigabite of RAM should do the trick

Matrix Reloaded is one of the few movies to depict hacking accurately.

NCIS has a pretty good one where 2 characters to counter-hack the mainframe by pressing random keys on the same keyboard. Like they each take one side of the keyboard, and then another character walks in and unplugs the computer. It goes from complete fantasy to the easiest and most realistic solution in a single scene and its fucking hilarious.

I have watched RD many times, but don't remember this. Which episode was it in?

@@lotuselansteve Red Dwarf: Back to Earth Episode 2

Coincidentally, also the most common words on gas station boner supplement packaging

That first paragraph described what temporal upscaling is essentially. Just done within your brain. It's the most high level straight upscaling method we have, reconstruction is the hard part to tune for a clear image though.

A real world analog might be riding in a car past a slat fence and being able to see what's going on on the other side almost as I'd there was nothing in the way. But if you stop suddenly you can only see through the slits. The human brain is great at averaging information over time I to a synthetic image.

More detail could definitely be drawn from the footage this way if we had the ideal algorithm. The Google Pixel’s camera does this to enhance its clarity. It will take a quick set of photos and combines the info captured in them to allow an incredibly impressive improvement to its digital zoom. Our eyes actually do the same thing. If look closely a focused eye doesn’t stay still, it has these microjitters essentially using a “set of frames” from slightly different offsets to get as much information as possible from it sensor cells.

I believe this is how someone was doing some...DS9 remasters, I think it was? They looked pretty dang good.

Amateur Astronomic Photographers use this method to get ultra sharp photos of the Moon and planets. Dozens of photos superimposed.

Yup, the whole time I was thinking of this. I don't remember where I saw it but it is definitely possible to accurately calculate sub-pixel details by using the data from multiple frames, if the subject shifts even a fraction of a pixel all the pixels will shift slightly in brightness so the more frames the more detail can be extracted

@@LennertK This is how temporal anti aliasing also works (TAA).

I actually tried this on the footage in the video this afternoon. Unfortunately (not helped by youtube compression) the results after stabilizing and stacking weren't very good. But perhaps with access to the original raw footage it would be better.

I was thinking this same thing the whole time. If you have, say, 3 seconds where a face is visible (and moving) then you have potentially 60-180 different versions of that object. Then instead of training the AI with 'real world' data, you select the clearest frame and train the AI with the other 179 frames. I'm sure it's much more complicated than that but you're no longer using invented data, so more admissable perhaps.

Thank you. Now l know l am not the only one.

they are just extrapolating existing film photography, like for example they are already familiar with micro-film where they could zoom in and see a document otherwise unintelligible to an unaided eye.

That happened to me. They asked me to enhance a client’s low res logo. I eventually got it done and they were happy. They asked me how I enhanced it at the end, I told them I just redrew it in illustrator

Been there too. 🤓

as someone who has been asked that before (not an illustrator but, for other things IT related) my response was it'll only work if you can give me the project file. you're out a lot of time or are boned otherwise.

As working in the same kind of profession, I feel your pain... A LOT!

Good to see some content from that case here. Truly one of the trials of the century.

Poor little Binger.

doesn't he get the image of the woman from extrapolating a mirror I.age of parts if the room you cannot see? :)

Analog photography is limited by film grain

Film grain is small but never on molecular lvl, hence all the ISO standards. Same problem, we cannot control particle size to that degree be it pnp-based sensors or silver precipitate particles. I think record with (gold) particles atm is nano scale or something

Nerd

@@noahduncan5524 good thing nerd is a compliment now

That's exactly what they did for the license plate enhancement shown in this video.

@@blindleader42 As I understood it they just watched an example video of the software, but didn't use it themselves. Using multi frame super resolution on the CCTV video should yield much clearer results, if you get enough good frames.

That’s hilarious. How many movies were ruined by one too-illogical VFX shot? We’ll never know…