Using Stablediffusion to create a pointcloud 3D effect in Touchdesigner. Part 1 

Glad you liked it :)

Glad you think so!

Glad you do !

Never mind after many hours I figured it out! Hahah it’s definitely possible just was a bit tuff

Sorry, just seeing your comment now. I would be curious to see what solutions you came up with :) On first thinking I wouldn't use stablediffusion depthmap to do so, as in order to achieve it you would need to extract each images of a movie, and then process the depth map of each pictures. The stability in the results would be a bit odd. But you could extract the depthmap out of a movie using davinci resolve. It will offer a better stability, and the yes, you could process it realtime in touchdesigner.

I have stablediffusion webui dephtmap script installed

@@Dithdsgn Thanks! :D

You can of course use Midjourney to generate the first image, but for the depth one you will need something at 16 or 32 bit float.

@@Dithdsgn when i add the color rgba to the Geo COMP there’s an error. Is this because the the colormap is 16bit pixel, and the depth map is 8bit pixel? Do they have to be the same?

@@KAZZinteractive No, the bitrate should not be an issue, but the resolution of each operator is. Are you sure your color map and depth map are the same resolution ?

@@Dithdsgn yes they're the same. The error says all ops must generate the same number of instances.

@@KAZZinteractive That means that your tops your are instancing from do not match in resolution. Are you using a top for the scale aswell ? You should check the resolution of all the tops you are referencing in your geo.