Space Carving - Computerphile

Подписаться 2,4 млн

Просмотров 255 тыс.

50% 1

Removing voxels until the shape emerges. Space Carving is a kind of virtual sculpture. Image Analyst Dr Mike Pound explains how though it's a bit rough and ready, it can be lightning fast.
Rob Miles on Game Playing AI: • AI's Game Playing Chal...
Deep Learning: • Deep Learning - Comput...
Secure Web Browsing: • Secure Web Browsing - ...
Thanks to Rick van de Zedde, Wageningen UR for kind permission to use their Tomato Seedlings footage.
3D Stereo Vision: • Stereo 3D Vision (How ...
Deep Learning: • Deep Learning - Comput...
ISP Advert Injection / Secure Web Browsing: • Secure Web Browsing - ...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com

Опубликовано:

11 май 2016

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 322

@SkyFoxTale 8 лет назад

2:20 "What's this?" Topologist: a torus

@unaliveeveryonenow 8 лет назад

Physicist: a point mass Materials engineer: a group of crystal lattices Biologist: a population of skin bacteria on a rock Mechanical engineer: a part that is very difficult to manufacture Graphic designer: an ugly font Photographer: bokeh with artifacts Programmer: an object

@DavidWillanski 8 лет назад

Surrealist: a horse galloping on a tomato

@Croxmata 8 лет назад

Chemist: A ceramic, probably silicate, with a mostly organic substance applied to the surface.

@AntiComposite 8 лет назад

Lawyer: An object that appears to be consistent with a description of a mug.

@KasranFox 7 лет назад

The office's single IT guy: My fuel for the day.

@wanderingrandomer 7 лет назад

I love the use of technical terms. "A sort of triangulary cylinder" Otherwise known as a prism.

@onemanenclave 5 лет назад

triangular prism*

@Bradley_UA 2 года назад

Triangularly cylindrical prism.

@Permutatorem 8 лет назад

So basically, a silhouette tells you where the object definitely isn't and where it might be, but not where it definitely is.

@ITR 8 лет назад

You forgot to write beneath the Rubik's cube >.>

@ArnoldsKtm 8 лет назад

@Diggnuts 8 лет назад

+MMMIK13 Bit of a Parker Square...

@PhilBoswell 8 лет назад

+MMMIK13 maybe they meant :-P

@BrickOfDarkness 8 лет назад

+MMMIK13 maybe it is a loosely defined derivative of XML and hexagon is defined to not need a closing tag.

@666Tomato666 8 лет назад

+BrickOfDarkness in that case it's missing the SGML doctype

8 лет назад

I love these videos of Mike Pound, so interesting!

@mrnarason 8 лет назад

3:29 Basically the rule for all youtube videos.

@mrembeh1848 8 лет назад

+Victor P. thought the same :D

@richardpike8748 4 года назад

read this comment at the exact moment he said it lol

@Acid113377 8 лет назад

Running ubuntu and then a "WPF in C#" book in the background. Seems like a jack of all trades. Good stuff!

@adelarscheidt 8 лет назад

A good way to illustrate that the hulls can't be understood by the camera would be to imagine the object made from a vantablack material. You'd only see the silhouette, you'd understand the convex hull, yet wouldn't be able to tell wether there's really a hull in there. (Apart from your intuition about the object, as they mentioned haha)

@adelarscheidt 8 лет назад

+Adelar Scheidt *whether

@Mengmoshu 7 лет назад

That is a really cool way to help wrap one's head around the problem. Thank you.

@Anvilshock 7 лет назад

*Edit button

@goeiecool9999 8 лет назад

Love this guy! Clear and to the point.

@Mezurashii5 8 лет назад

That took a long time to explain a reeaaly simple concept. There's plenty interesting stuff on the 3d modeling topic to talk about though, now is a great time to jump onto the theme too.

@phildxyz 2 года назад

I could listen to Dr Mike all day...

@JavierSalcedoC 8 лет назад

4:00 the key is to avoid the computer to think it´s a #parkercube

@TheHardRage13 8 лет назад

Very great video, proud of your work:)

@gabrielbeedles1172 8 лет назад

That tomato seedlings footage looked awesome! Would love to see more of that! Is there any additional RU-vid footage available of the high speed use of space carving?

@AnimilesYT 5 лет назад

You said 'Wageningen' with the proper 'g' sound. You're awesome! :D

@smileyball 8 лет назад

This reminds me of the CVPR paper "3D ShapeNets: A Deep Representation for Volumetric Shapes" which models the uncertainty of the 3D geometry of an object and tries to find the next-best view to minimize the uncertainty.

@ThePamimo 4 года назад

It's amazing how much progress we've made on this in the last 3 years. Look up meshroom or photogrammetry if you haven't seen it yet. I don't know if it works the same way as this but man, new software is becoming so powerfull its incredible

@DannyBurkeBanjo 7 лет назад

its great when you watch these videos and they help with your revision!

@Huizelogica 5 лет назад

+1 for pronouncing Wageningen correctly

@5imian 7 лет назад

This channel is cool as hell.

@clockWorks10 7 лет назад

"Voxels are quite popular these days due to a certain piece of software called Minecraft"

@mf-rozi 5 лет назад

That got me 😂

@LowtechLLC 8 лет назад

thanks for the info on optical 3d systems. (I bought a lytro after watching that video.) can you discuss how fringe projection 3d systems work? I dont get the phase wrapping and unwrapping that is explained in the white papers. thanks again for the great series.

@iagocasabiellgonzalez7807 8 лет назад

Great vid! Thanks

@sjaaksafari709 4 года назад

I see dr. Mike Pound in the thumbnail. I click.

@pppppaaaaaccccchhh 8 лет назад

You should make a time-lapse of him just drawing lines all day

@IngviGautsson 8 лет назад

I once implemented space carving using POV-ray. Because it's very easy to use it to code extrusion of 2D paths and intersections of 3D objects. The drawback it that you don't get a point mesh that can easily be imported into modeling software.

@cookiesliyr2 8 лет назад

good luck on that project mate!

@TheBigBigBlues 8 лет назад

It's like a 3D CT scan. You measure how well X-rays pass through an object from a number of angles in a 2D to get a 'slice' image. Expand this to 3D.

@joshinils 8 лет назад

+TheBigBigBlues only that either all or no ray gets blocked, there's no value in between

@Mr30friends 8 лет назад

+TheJoshinils proof ?

@ninjafruitchilled 8 лет назад

Similar idea, but CT is way more powerful because you have way more information related to depth.

@TheBigBigBlues 8 лет назад

+TheJoshinils Yeah true.

@Mr30friends 8 лет назад

***** I thought we were talking about x rays ,in which case i am pretty sure this " there's no value in between" doesnt apply

@callummunro7380 8 лет назад

I will never trust mugs to be mugs again

@nickhowatson4745 7 лет назад

a mug with an ugly mug who likes to mug mugs.

@finfan7 6 лет назад

Congratulations, you have begun your training to be a Certified Fair Witness.

@JinKee 5 лет назад

Morgan Yu is that you?

@Kruglord 8 лет назад

That's really cool, I haven't heard of space carving before, but it makes a lot of sense. I wonder if there's a sort of hybrid between space carving and photogrammetry that'll sort of a bunch of problems associated with each.

@valivasiliu2200 7 лет назад

ubuntu and sublime on the background, you have my thumbs up, from a fellow brother in arms

@spacebar420 8 лет назад

I was sitting here for at least a minute thinking about why he's talking about Vauxhalls...

@jonnypanteloni 8 лет назад

+mellanslag HAHAHAHA you killed me

@MrThijmenmees 4 года назад

Haha this must be the most British comment I've read in a while

@KnakuanaRka 4 года назад

I never could figure out how the heck you pronounced that.

@timbittins 4 года назад

Because it looks like a square... With wheels.

@CharlesVanNoland 3 года назад

Hah! I was trying to remember when he *was* after reading this. "Voxhauls, who the heck is that? I don't remember him talking about someone named Voxhauls...."

@DFX2KX 8 лет назад

there used to be some software, way back in the day, that let you take a toy or something small, stick it in front of the lens of your webcam, and manually mark out the edges in each frame, then it would run through it's algorytyms and generate a painted 3D mesh of the thing. This might well explain how that software worked.

@syzer3921 5 лет назад

Love it!

8 лет назад

great video :-)

@thesomething8467 8 лет назад

Voxel ambient occlusion would make the 3d models a lot more pleasant to look at, it's easy to implement and it can be zero overhead for the GPU.

@Ivo-- 8 лет назад

Shout out from The Hague, a mere 15 minutes from the Westland, where at night the sky is bright with light from the greenhouses.

@TheBlenderer 8 лет назад

Netherlands represent, woo! Wageningen, haha, solid effort on trying to pronounce that :)

@divasimao5290 8 лет назад

This guy is awesome!

@sebbes333 8 лет назад

@Computerphile and the person in the movie. What if you move the camera sideways, eventually the center of the camera lens will line up with the edge of the Rubrics Cube and then you can see that it actually is a straight edge.

@KnakuanaRka 4 года назад

Sion Yeah, that requires you to get lucky with how you place your camera.

@AutisticThinker 4 года назад

If the camera had a light source directly behind it illuminating everything it see's (and always aligned with the camera's PoV), so shadows are dependent on the camera position; you could calculate depth from shadows.

@manmanman5371 8 лет назад

The way he pronounces Wageningen! Fantastic. Wacheningen

@dgamma1 8 лет назад

I am quite lost on this subject. Which is the playlist (or first video) one can watch to understand computer vision better?

@Teraku1503 8 лет назад

I'm waiting for the follow up video :)

@daisy3067 8 лет назад

I'm thinking,could you using sound to help in fine tuning the hollow shape ,the frequency change

@DataCab1e 8 лет назад

This technique was used to produce the crude "holograms" in Steven Spielberg's film "Minority Report."

@daringblitz2316 5 лет назад

Can you release a 10-hour video loop of you pulling a sheet off a stack, drawing lines on it, rinse and repeat? Purpose? just to see who would watch you draw lines for (almost) all day? XP

@lobosw3 6 лет назад

How is this diferent to what is done with Computed tomography reconstruction?

@CloudWalkBeta 8 лет назад

Interesting stuff, Moving on from what i can understand, what this computer is missing is colour and lighting, as humans we can see how flat a surface is because of how the colour + lighting changes across objects surface to return depth values or a sense of roundness, if a computer had the same concepts it could make better results right?

@Vospi 8 лет назад

About halfway though a video, when it was stated that "how would you know that something's hollow", then it started pulsating in my mind and it just can't leave it. Light! Additional light source should be a huge help in that, because you can base a lot of predictions of your shape based on shadows, right? Capture an image without that extra light, then let your additional light source to rotate around an object or gradually get closer to it, capture a shadow and get a definite evidence that your mug isn't stretching a mile behind -- even without rotating it! Even just turning some static light source on and off for every picture should help -- if we know its exact position, for instance. Can't you use that in this whole scheme?

@cmm90871 6 лет назад

another alternative is to use narrow spectrum lights each emitting from a 60 degree offset and shadow/shader for each color to determine vectors to cleave, (interestingly possibly use the color mixing gradients for depth and opposing surface shape, especially useful if you compare the objects texture color profile to a full spectrum lighted )

@stationshelter 8 лет назад

So the computer is playing picross 3d trying to solve for real life

@KnakuanaRka 3 года назад

I remember that game! :-D

@mosesnah2893 8 лет назад

I love this Guy

@TemporalOnline 8 лет назад

What if you always assumed that all shapes are hollow, and removed parts of that shape based on pattern recognition (but you would need to have a database of shapes) and see what that blob would look like, if I removed "this" part (whatever that is) would it be closer to some other part in my DB via heuristics?

@jamesessex7374 8 лет назад

Why has this channel not done a video or even talked about memristors yet? And the computer technological significance of this equipment. I am sure many of your viewers have not even heard about memristors yet. ;-)

@Angloth 8 лет назад

+James Essex You just made me smarter, thx

@lukeW7344 8 лет назад

photogrammetry programmes like agisoft photscan and reality capture seem to be way ahead of what they are doing, or is space carving just one of the methods used during photogrammetry?

@Fake_Blood 8 лет назад

This reminded me of the puzzle game Picross 3D.

@leedaniel2002 8 лет назад

I completed that game a few months ago. I've never had a happier moment that that

@leedaniel2002 8 лет назад

+Watch The World Burn *than that

@Fake_Blood 8 лет назад

Hah! Me too, had it for 5 years or sow! There's a sequel on 3DS but Japan only :/

@GordonAitchJay 6 лет назад

13:09 "And finally, our rubik's cube, which is almost, in some sense the worst of our reconstructions. Because it's cube-ish, right? But it's not particularly a cube. I mean, that's cube-kind-of." haha!

@4.0.4 5 лет назад

I wonder, aren't Kinect cameras very cheap right now? Does anyone know how hard it is to use several?

@MiniArts159 3 года назад

In a single video, Mike has singlehandidly upset every Geometer in a 500km radius of nottingham

@rolirolster 8 лет назад

I love this channel, but so much of it goes way over my head, can anyone recommend a channel like this dedicated to programming and software? Thanks.

@Faxter313 8 лет назад

Link to the full Tomato-Seedling-Footage?

@DC-yl3yl 8 лет назад

What if you also used translational instead of only rotational motion to get different camera angles? Wouldn't that carve away the sides of the cube more accurately?

@eideticex 8 лет назад

+David Clemens That's what I was wondering when he described space carving. How much translating and rotating would improve the results as compared to the rotational approach. That and "why not use an orthographic lens" but he answered that one, never realized just how much they cost.

@8bit_pineapple 8 лет назад

1:21 Is that Oskar's Treasure chest Rubix cube on the shelf I see?

@DavoidJohnson 8 лет назад

How far backwards do we have to go to have cameras that cannot detect distance (autofocus)? You simply need multiple focus points to measure the hollowness of the mug. A bit of extra software will communicate this to your computer.

@luffyorama 8 лет назад

I'm currently doing somewhat similar project, but using microCT-scan. And also try to use Meshlab for meshing purpose (3D Slicer is confusing). lol

@ASOTFAN16 6 лет назад

Yay, love for the Netherlands XD

@12pv1 8 лет назад

A wild Ubuntu Linux appears!

@hoffybeefe 8 лет назад

reinventing the wheel? you guys heard of structured light scanning? :P (tongue in cheek) very interesting how different things can be used for different purposes based on their benefits and flaws! cool vid!

@mihirsalot1346 8 лет назад

why not use a distance sensor for measuring distance and hence hollowness??

@tbpotn 8 лет назад

There has to be some elegant way to detect a 90 degree corner and set the camera up such that one of it's peripheral lines lines up perfectly with one of the sides of such a corner..

@Anvilshock 7 лет назад

That's the point of this method: You can't know that very well (if at all) from the outset, you can only optimise so far. You'd need pretty much to know the shape beforehand to set the cameras up. And when you know the shape already, why would you then still bother going through the space carving?

@TheImaxify 8 лет назад

The same as what's called "backprojection" which is widely used in medical imaging specially for a semi-transparent objects.

@Dieze 8 лет назад

shouldn't you go able to get rid of the bulges by moving the cube to the side so that the edge would be in the center?

@littlebigphil 8 лет назад

+Dieze TA Good point.

@martinhill7304 8 лет назад

+littlebigphil Depends how much harder doing everything else becomes after translating the camera location; should work though

@pnw_dev7934 8 лет назад

What about using stereography to develop depth information? Just a thought...

@moviemastersdk 8 лет назад

Well there's my next programming project :)

@MrVankog 8 лет назад

Is this a Team Viewer popup on the screen near the end of the video? ^^

@raymondlee1024 8 лет назад

Oct-tree video! We want the oct-tree video! Today!

@nienke7713 8 лет назад

Wageningen (UR)! = awesome!

@indianfyre 8 лет назад

Mike senpai!

@nbase2652 8 лет назад

@COMPUTERPHILE: Regarding the hollow shape thing... Why don't they make use of an external light source shining on the scene at a different angle than the camera? The shadow that's being cast could be used to compute some depth information, couldn't it?

@StefanReich 5 лет назад

But it wouldn't help you with the inside of the mug

@World_of_OSes 6 лет назад

Why was Ubuntu in the background?

@Twitchi 8 лет назад

Want more on orthographic camera!!

@zoranhacker 5 лет назад

Yes! Same here, all I (think I) know is it just zooms a lot, which matches with Dr Mike saying it gives a small image and also the smaller the image, the smaller the angles and more parallel the "outer lines" of the camera, giving you an orthographic view! Sorry for going off lol you might already know this

@mrvlhs 8 лет назад

It's pretty easy to know if something is hollow or not... cameras have to focus to take a picture and if they focus in different places then you have your answer

@calfischer1149 8 лет назад

You can't always do that, but that's an interesting idea

@Rykemasters 6 лет назад

My takeaway from this video is that, with low-resolution space-carving that can't take depth into account, the jungle plant is functionally undistinguishable from Sideshow Bob's head.

@cosmicsans67 8 лет назад

so are depth camera's just like, 3d cameras? Or do they have some sort of sensor like infrared or something?

@KuraIthys 8 лет назад

+Soda POP 67 The two I know of (because they are cheap and easy to find information on) are the kinect and intel realsense cameras. Details vary, but the first generation kinect is an ordinary 2d camera, an infrared camera, and a infrared projector. The projector projects a specific pattern of infrared light, and the infrared camera picks up the pattern on the environment. The way the pattern is distorted gives the depth, and then everything else about a picture comes from the standard visible light camera. There's other ways of doing it, different kinds of patterns, and so on, but at the moment, infrared cameras seem to be involved in most of the 'cheap' depth camera setups...

@cosmicsans67 8 лет назад

KuraIthys ah ok, thanks ^-^

@georgebizos944 4 года назад

I understand I'm 4 years late, but it seems like you might be able to train a neutral network to take those "3d images" or meshes of 3d pixels and train it to recognize familiar shapes. "Mugs look kinda like this", "Trees generally look like that", "This cube must be a cube", etc...

@RedEyedJedi 4 года назад

Would it not be possible to have 3 cameras. One aimed at the centre and the other two aimed at the edges instead of buying an orthographic lens?

@juliusfucik4011 4 года назад

Use monocular SLAM and you get a point cloud that you can mesh easily.

@KasranFox 7 лет назад

Have they made a video on octrees yet?

@MikMoensted 6 лет назад

Couldn't you use a single light source with a known position in space, to cast a shadow, and post process the resultant pixel intensities to approximate hollow features?

@Desirdef 8 лет назад

Can we get the voxel data that you generate?

@zacharybarbanell1064 6 лет назад

Why are some of the green cubes Bigger?

@ZimoNitrome 8 лет назад

i also like to carve if you know what i mean

@harshag.2085 3 года назад

No ZimoNitrome, I do not know what you mean

@KnakuanaRka 4 года назад

This is basically an actual version of the joke: How do you make a statue of an elephant? Take a piece of stone, and cut away everything that doesn’t look like an elephant. *ba dum tss* xD I’ll be here all week.

@erathornzyltris 4 года назад

Ah, Ubuntu's Unity, that is a blast from the semi-recent past.

@zxuiji 4 года назад

Why are you not factoring in light into the equation? light effects the shades of colour and thus gives depth

@ZeLarpMaster 8 лет назад

When you're so early it's still in 360p

@rumraket38 8 лет назад

It's hexagonal, the rubix cube, when viewed from a side where you see three faces.

@MakerTim 8 лет назад

Wageningen xd met een G ;3

@rondowar 8 лет назад

+MakerTim de a moest nog wat langer, verder best wel respect the a in there should be more like the a in aaaargh

@kliko 8 лет назад

+MakerTim Give him a break, it's not an easy dutch word to prenounce. ;) I've heard far worse!

@MakerTim 8 лет назад

true; its not that bad

@retepaskab 8 лет назад

You could use a moving lamp to detect holes.

@Ceelvain 8 лет назад

How about using the texture / reflecting properties (BRDF and stuff) to infer the shape more precisely? IIRC, the Université de Poitiers (France), did this for quite some time now. At least that's what they told their students. :)

@shaderbytes 8 лет назад

+Ceelvain photogrammetry does this and is widely available. Under the right conditions the results are spectacular. I doubt it is as fast though so in light of the end of this video where he mentions space carving working rapidly in a factory setting it would not be practical. check out sketchfab website there are literally tens of thousands of uploaded photogrammetry results which you can view in your browser.

@Ceelvain 8 лет назад

+ian pretorius Absolutely awesome.