Gaussian Splatting explorations 

This is awesome! Could you do like a detailed explanation of the math in the paper? There is tons of videos on gaussian splitting, but yours is the one that really helps to explain the details. But... it could be even more detailed!

Very nice video, thank you! Can you also share the notebook code you use in the video?

Very nice video with very good explanation of the key concepts! Especially the sh are nicely explained.

i like this guy's personality

Bro your ChatGPT history looks a lot like mine, just tons of insane neerdy stuff. How fast is the retraining process? Like could you retrain a scene during gameplay with a good gpu? Especially if you had some trained gaussians already in place. I've been wanting to make a project like this for a while but I can't figure out a way to do it with mesh objects. What I want to do is have an AI NPC on level 1 start talking to you adout something, anything really and let the player lead the conversation. Lets say you mention clouds then it starts googling clouds and starts training based on that as a prompt. By the time you get to level 2 its ready and level 2 is based on some structure but everything has morphed into clouds. That would be nuts when you realize you are just manifesting your own game play with what you are talking with the NPC about. I was thinking about having some primative sphere for most objects then using picture to depth field from stable diffusion help reshape the mesh then wrap a new texture on it. I think it could work on a high end computer but this method seems like it would be almost a dreamy hasey way to do it. If you could buy some time in cut scenes and dialog interactions it might be possible. Anyway this whole process for rendering is just nuts. Trying to wrap my brain around it.

Guy with worst image quality ever explains technique that produces best image quality ever. Just some geek joke, thank you for such a nice presentation

Ha, guess who forgot to add the visual aids during the intro..... hand gestures will have to suffice ;) Paper and code show up from 6 minutes in.

This is crazy interesting but no one is talking about it

Would it be possible to post the notebook that you walk through in the video?

Can you say the final size of the scene, especially compared to the size of the input images and the number of iterations? Would it be viable to embed the scene representation into a video game, for instance, or are they enormous? (Or would we need to use something like Wavelets to represent the scene, and transform back into these harmonic values before rendering?)

Hi, really good video. Could you share the jupyter notebook you showed in this video? It would be so grateful!

It would've been cool if you could visualize which point in the scene you are showing the spherical harmonics for

very interesting, thank you! Can you also share the notebook code of your on this video?

Can you please share the git repo for all your code, it would be great to follow along and see the results on my end.

well spherical harmonics (thanks for the explanation btw) are cool and all but they are not adequate way of modeling light caustics. like if you have something refractive in your scene, like a half full glass of water, I wonder if splats can represent how objects behind it would warp. and re-lighting a splat scene (adding a light source, post capture) is tricky IMO

Do the gaussians model view direction dependent effects? Or are they best suited to only represent lambertian materials? E.g. can specular highlights, refractions, non-planar reflections, fresnel effects, etc. be modelled using these? If so, how? As far as my understanding goes, these gaussians are basically single-colored blobs, similar to billboards (as used by particle effects for games).

I never would've thought style transfer possible like that! Nice video!

Where is this? "GS website (with links to paper):"

I'm curious though; Weren't there differential renderers with spherical harmonics already a thing since like 2008 ?

Can you share this code you have made for this video ?

thanks for the video ❤! As a suggestion, Would like to see something about peft (LoRa, Quantization …..)

Can splats emit light (instead of just reflecting)? If not, how difficult would that be to implement? I'd like to try modelling aurora, which would correspond to fully transparent splats emitting light.

The video looks like it's from before 2010

Can you also model, texture, light and animate than render with this tech?

Jonathan thank you for the great walk through. The video structure is excellent. It is also really cool work you’re doing to stylize the base results!!

Can you share the code please?

Great video and explanation Jonathan! I really enjoyed your approach with CLIP to be able to modify gaussians given a text prompt. Do you have a link to the jupyter notebook you used in the video?

the description is missing the link to the paper website 😥

The quality of your facecam looks like being in 2002

Thanks. Could you go over the CUDA code as well

Very cool, very well explained, thank you

nice

Wonderful explanation! Thank you!

So, but it doesn't use any poligonal meshes so you can't use it with other techniques, or can you?

So prince Harry is now an IT nerd ?? 🤔

this will be the new live AR option.

Is there a way to continue training from a previously unfinished training?

thanks, very clear!

High Fidelity? Fidelity?

I love the pace, the comedic timing, the content and animations!

I wonder if this would work with a laplacian distribution rather than a gaussian 🤔

Very Good.