Road map of Gaussian Splatting possibilities

Подписаться 14 тыс.

Просмотров 11 тыс.

50% 1

Instead of just spinning the 3D model, I wanted to look ahead and think about how and where we can actually use these Gaussian Splatting models at the moment. I wanted to draw a road map about it. I also go through couple of apps for example the Scaniverse app for iPhone that can now generate Gaussian Splatting models locally on smart device.
Here is my interactive 3DGS road map:
bit.ly/3dgsroa...
Map was implemented with Spline and you can also find it in community page where you can mix it:
app.spline.des...
Here is Ghost Wall FX experiment:
bit.ly/ghostwa...
And here Ghost Wall Game experiment:
bit.ly/ghostwa...
Jaewon Lee's repository for Gaussian Splatting papers
github.com/Lee...
#gaussiansplatting #spline #postshot

Опубликовано:

26 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 78

@eldragon225 3 месяца назад

I see massive use potential for Guassian Splats replacing existing 3-D tours in the real estate industry.

@badxstudio 5 месяцев назад

Super informative brother

@OlliHuttunen78 5 месяцев назад

Thanks a lot! I’m just watching your latest podcast with Winbush and EJ. Great episode!

@360socialms 5 месяцев назад

Excellent explanation !!, didactic and updated, which demonstrates research on the subject, a summary that cannot be found in other channels.

@Tactic3d 5 месяцев назад

Cannot Say better! Exact same thoughts

@Zac33544 5 месяцев назад

Hi Olli, great work as always! You were a big inspiration in my undergraduate dissertation on a comparative study between photogrammetry and Gaussian splatting, I’m curious to hear your ideas for Gaussian splatting in forensic science i.e. for use in police investigations and in courts.

@DaveDFX 5 месяцев назад

I'm using it in my VFX projects. Future is bright for 3DGS.

@AndresArosemena 5 месяцев назад

I just watched your tests on your channel, very cool stuff. Have you shared somewhere else your vfx shots where you used this technique?

@DaveDFX 5 месяцев назад

@@AndresArosemena I'm on NDA for that project until I't released so I can't show anything. Will be using 3DGS and Photogrammetry for digital environmental work and in NukeX Compositing.

@AndresArosemena 5 месяцев назад

@@DaveDFX looking forward to when you are aloud to share them!

@tosolini 5 месяцев назад

Bravo Olli for a great practical video about one of the hottest 3D tech of the moment

@DavidHeath-u8m 5 месяцев назад

Ollie, I love your explanations and have followed your journey with Gaussian Splats since you started. Keep up the great work and coverage. Greatly appreciate your innovation and insight. Keep it coming!😄

@360_SA 5 месяцев назад

Great job. Thank you for bringing the old way to see you, and the way you talk is amazing. I wish if you could show how you make the ghost room and by pressing g it goes to the normal room

@davidarhodes3d 5 месяцев назад

Great overview, Olli!

@Olstman 4 месяца назад

Brilliant! Thanks For such well organised roadmap in the world of Gaussian Splatting

@christian-schubert 5 месяцев назад

WOW. This has probably been the most helpful RU-vid video in quite a while. Gaussian Splatting has always been a sealed book for me (yes, that is entirely on me, I could've researched the material, it's clearly out there). This has the potential to revolutionize Real Estate visualization! Just gotta figure out a) sustainable workflows on non iOS devices b) a way to circumvent subscription models - I know, "ownership" is a term of a bygone era, but I hope there's at least a way to download and OWN your CREATIONS (i.e. freely integrate them into your own site on your own terms) Any chance you'll follow up with a detailed video on this? 😉 Thanks for sharing, again, this was REALLY insightful!

@RelicRenditions 5 месяцев назад

Thank you for another great production. Well done, Olli.

@brappineau4161 4 месяца назад

This is by far the most useful video out there when it comes to gaussian splats. I can't wait until I can convert to mesh environments to optimize for standalone viewing. Isolating movement for 4D recordings and pasting into those for playback.... this would be amazing for capturing loved ones & moments

@jeanm7115 5 месяцев назад

Great presentation. Thank you very much. Hopefully technology develops fast so we can use a proof version of such solutions. Personally I would be grateful when Blender can clean up the .Ply model coming out of Spotshot. I then add my lighting or other objects inside an interior model for further use in 3Dvista .Glb file. Thank you once more.

@TheMrLeoniasty 2 месяца назад

Great video, thanks for the incredible information

@ns194 5 месяцев назад

Thanks for putting this together, Olli. I'm on this journey with you, deploying splats in an educational setting!

@alpaykasal2902 5 месяцев назад

Great work Olli, your content never fails!

@AndreasMake 5 месяцев назад

Awesome Olli!!! Thanks for sharing your view on the practical applications and use-cases! 👌🙏

@andybrice2711 5 месяцев назад

Scaniverse is amazing. I consistently find it to outperform Polycam despite being free.

@DaveDFX 5 месяцев назад

Yes It's awesome ! No need to upload to cloud and the realtime points in the viewer when scanning helps a lot.

@andybrice2711 5 месяцев назад

@@DaveDFX I've just tried the new Gaussian Splatting feature and it's incredible. And that's being processed *on a phone!*

@hanskarlsson3778 5 месяцев назад

Exactly what I was looking for!

@imaginingPhysics 5 месяцев назад

Thanks for these videos. Keep them coming!

@grafpez 5 месяцев назад

I have a feeling 3DVista is going to implement Gaussian Splats hopefully soon down the track ;-) thanks for your fabulous contributions

@祁风-h1g 5 месяцев назад

Thanks for overviewing the splatting world!

@mat_deuh 5 месяцев назад

Thank you for this :)

@surfkid1111 5 месяцев назад

Very valuable video, thanks.

@punio4 5 месяцев назад

Amazing overview Olli. Hopefully I can get aboard all this before everyone else does :D

@simonkennedy6116 5 месяцев назад

Thanks Olli, there are some things here I hadn't heard of

@benwinstanleymusic 3 месяца назад

Thank you so much, this is incredibly helpful

@onvacation960 5 месяцев назад

Great video! Just finished my thesis about 3DGS for Virtual Production and came to a similar conclusion. Use in VFX may be imminent. Note, that VP does refer to all real-time XR applications in the entertainment industry, not only LED wall ICVFX. A paper that has blown me away was the Gaussian Codec Avatars by Meta. Also a great prospect for future VP.

@binchen-l9x 5 месяцев назад

I hope you can share more experiences related to 3DGS and virtual production

@bethany-rp2tq 2 месяца назад

Hey, is there a way I can read your thesis? I am working on 3DGS for my thesis too :)

@XaviSerrat 5 месяцев назад

great video as always, thanks for sharing your experiments and insights

@kaxoxinho 5 месяцев назад

Hi Olli! Amazing work! Btw INRIA is also adding VR support in their Github repo

@CornuDev 5 месяцев назад

Thank you for sharing

@우종범-s1z 5 месяцев назад

Great overview! Thanks

@irrealix 4 месяца назад

We have released a cool plugin for After Effects to work with GS3D

@Leyverse 5 месяцев назад

LOVE IT

@niks.3388 5 месяцев назад

huge thx

@stagrei8233 5 месяцев назад

Thanks for this insight

@buroachenbach703 5 месяцев назад

Great video, Ali, would you consider making a spine tutorial for GS creators - I have played with it, but I feel I’ve not comprehended it completely. I’m sure there are a few tricks that you can teach us all with spine.

@boskobuha8523 5 месяцев назад

Bravo!

@bobbykingAiworld 5 месяцев назад

That is real cool.

@unn357 5 месяцев назад

you can also edit the .ply file in blender

@jayes5066 5 месяцев назад

we need like an instagram for splatts. probably be best for VR/XR viewing.

@tvguide4khv 5 месяцев назад

Love your English :)) thanks for wrk!

@massonnicolas2339 5 месяцев назад

Amazing Thx a Lot 🤯

@sharpvidtube 5 месяцев назад

I hope Scaniverse comes to android.

@sirens3237 5 месяцев назад

Thanks Olli thats great, I know that Nvidia Omniverse has plans to add it. Dont have a timeline for that....

@iainisbald 4 месяца назад

I wonder if you could create High Dynamic Range Gaussian Splats and use them in 3D modelling workflows to replace traditional HDRIs.

@madsvadsholt5324 5 месяцев назад

Thanks for all your research! How far away do you think we are from animating splats?

@beksf 3 месяца назад

i think you are missing the piece where the video output of lumia can be fed into stable diffusion to create AI videos

@brappineau4161 4 месяца назад

Also I noticed your UE5 character interacting with the car. Did you figure out mesh conversion?

@monocilindro3655 Месяц назад

Your videos are pure gold, thanks!

@KORTULSGAMEROOM 5 месяцев назад

Thx! How do you adjust Splat Scale in Spline for your models imported from Postshot? When I import the model in Spline from Postshot each splat is tiny, like a point, and the resulting shape is semi transparent. In Postshot there is a slider to adjust this called Splat Scale. In spline it is imported as 0.1 scale instead of 1.0 like in Postshot for me.

@KORTULSGAMEROOM 5 месяцев назад

Hm, this seems to be fixed if PLY is exported from new 0.3 Postshot instead of 0.28. However, splats look significantly better in Postshot still - in Spline now the individual splats seems too big resulting in flioating artifacts. I'll try retraining with a new version.

@jac6350 3 месяца назад

Do you think Spotshot will have a connection with others softwares like After Effects in the future: Da Vinci Resolve , The Foundry Nuke or Autodesk Flame ?

@whatisrokosbasilisk80 5 месяцев назад

What music did you use, it's a bop

@bethany-rp2tq 2 месяца назад

What types of software can we use to render and view 4D GS for dynamic scenes where there is motion in the scene?

@abcmaya 17 дней назад

8:09 Skeletor?

@Lucky-ui7dh 3 месяца назад

Is it worth it to learn Postshot over using Polycam? Can you tell a huge difference? Thanks Olli.

@OlliHuttunen78 3 месяца назад

Polycam is easy and with it you can create certain quality of Gaussian Splatting models. With PostShot you see how the process go and you can train much better quality models because you are able to tweak the controls and train you model much further than the default setting that Polycam offers.

@Lucky-ui7dh 3 месяца назад

@@OlliHuttunen78 You're the best.

@failerstone7100 5 месяцев назад

I reached out to the team of Postshot. I asked there is any possibility to convert a e57, rcs, ryp ---> to a ply. They said thei are planning it in the future. Here is my question. Do you know anything to connect the gaussian splatting with a LIDAR Scanner. Normally you get an ugly Pointcloud where you dont really much see anything, but if you could combine these technologies, that would be insane. Do you know anything that is already advanced enough to process a e57 file to a nice 3D gaussian splat model? Thanks!

@obvioustruth 5 месяцев назад

Excellent video 🙂👍

@jpjpomxyz2319 5 месяцев назад

Please remove this painful background music. It is wortless, and ruins the quality of the video. Thank you.

@brettalexander.studio 5 месяцев назад

Calm down. 😂😂 Not nearly that serious.

@kaiselone 5 месяцев назад

I would need to use this technology in the fields of engineering and architecture. Being able to take measurements and work with it using CAD software. Does something like this exist?

@briandavis4866 5 месяцев назад

while the "splatting" isn't available, the pointcloud can be loaded in certain CAD/Modelling programs - I use CloudCompare to convert these to LAS points see loading in ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-fCtOUtUCSmM.html

@kaiselone 5 месяцев назад

@@briandavis4866 Thanks a lot!