Uploaded November 2022 | Updated September 2026, 3 weeks ago
In this video we are going to explore using NeRFs (neural radiance fields) in conjunction with imgtoimg to create new 3d objects. It's a little rough around the edges but this will improve as video coherence improves!
Sorry for the low resolution.
timestamps
0:00 intro
0:28 Lenticular Analogy
1:20 Pose Experiment
1:50 RCMP to Goth
2:30 Truck to Art Supplies
3:05 Trying it yourself!
4:30 Differences with Dreamfusion
Academic Sources (they include code)
nerfs - matthewtancik.com/nerf
llff - bmild.github.io/llff
colmap - colmap.github.io
dream fusion (no code) - dreamfusion3d.github.io
Sources:
how to make lenticular images
youtube.com/watch?v=38lMTSIXrok
augmented thinker's post reddit.com/r/augmentedreality/comments/yls9b6/i_believe_i_nerfd_a_first_lava_lamp_with_motion_i
sarai marte's video that made me think about layering
youtube.com/watch?v=JtRDVmqqn7c
In this video we are going to explore using NeRFs (neural radiance fields) in conjunction with imgtoimg to create new 3d objects. It's a little rough around the edges but this will improve as video coherence improves!
Sorry for the low resolution.
timestamps
0:00 intro
0:28 Lenticular Analogy
1:20 Pose Experiment
1:50 RCMP to Goth
2:30 Truck to Art Supplies
3:05 Trying it yourself!
4:30 Differences with Dreamfusion
Academic Sources (they include code)
nerfs - matthewtancik.com/nerf
llff - bmild.github.io/llff
colmap - colmap.github.io
dream fusion (no code) - dreamfusion3d.github.io
Sources:
how to make lenticular images
youtube.com/watch?v=38lMTSIXrok
augmented thinker's post reddit.com/r/augmentedreality/comments/yls9b6/i_believe_i_nerfd_a_first_lava_lamp_with_motion_i
sarai marte's video that made me think about layering
youtube.com/watch?v=JtRDVmqqn7c
![Re-texturing Photogrammetry with Stable Diffusion
Some experiments using Stable Diffusion to re-texture photogrammetry models. This is very much a work-in-progress. I wasnt using up-scaling or image masks which could improve results. Theres so many possibilities!
Timestamps
0:00 Intro
0:52 Image textures examples
1:34 The process
2:37 Projected into augmented reality
3:34 Light in Cycles
3:55 Useful tutorial
some of the prompts I used [universe, vampire, cyberpunk, steampunk,french revolution,gothic, samurai, dragon, spring, autumn, rusted]
Super helpful remeshing tutorial:
https://www.youtube.com/watch?v=I-lH2_Ca3Dw
Stable Diffusion
https://github.com/CompVis/stable-diffusion
Meshroom
https://github.com/alicevision/Meshroom
Some other exciting videos I saw this week.
2minutepaper just dropped a video about an amazing extension to stable diffusion thats super relevant to retexturing
https://www.youtube.com/watch?v=XW_nO2NMH_g
Single image of person to 3d model of person:
https://www.youtube.com/watch?v=GK1WdnULYMQ
Inpainting textures in blender:
https://www.youtube.com/watch?v=2rA4Ny-QQfg Re-texturing Photogrammetry with Stable Diffusion](https://i.ytimg.com/vi/yeOuCJ6qCsU/mqdefault.jpg)


