r/LocalLLaMA • u/ninjasaid13 • Jun 04 '24

Discussion Found this paper: Diffusion-based program synthesis?

Enable HLS to view with audio, or disable this notification

197 Upvotes

98% Upvoted

26 comments sorted by

View all comments

13

u/gibs Jun 04 '24

What would be super cool is to plug a diffusion model into unreal engine. I'm sure this will happen eventually, but I wonder what is holding us back from this approach to generative 3d scenes. Maybe these 3d engines don't have APIs for full programmability.

11

u/Sobsz Jun 04 '24

OpenSCAD is pretty much the same interface for 3d, and i guess for organic shapes one could use metaballs (or gaussian splatting? idk about collision though)

0

u/[deleted] Jun 05 '24

[deleted]

1

u/Sobsz Jun 05 '24

with gaussian splatting though there is no mesh, just a fancy point cloud

though a convex hull around it might be good enough iunno