Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper Explained @TheAIEpiphany
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper Explained  @TheAIEpiphany
Uploaded December 2021 | Updated September 2026, 1 week ago
❀️ Become The AI Epiphany Patreon ❀️
patreon.com/theaiepiphany

πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦
discord.gg/peBrCpheKE

In this video I cover the "Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation" paper where the authors devised a novel representation that made the robotic manipulation much more robust and capable of generalizing to novel shape instantiations and arbitrary unseen poses.

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
βœ… Paper: arxiv.org/abs/2112.05124
βœ… Website: yilundu.github.io/ndf
β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

⌚️ Timetable:
00:00 Intro
02:00 Neural Point Descriptor Field
12:30 Introducing SE(3) equivariance
22:35 Inducing energy landscape and optimization
25:10 Generalizing the neural descriptors to a pose
28:00 Visualizations, Results and Ablation
29:55 Outro

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° BECOME A PATREON OF THE AI EPIPHANY ❀️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Kulsoom Abdullah
Petar VeličkoviΔ‡
BartΕ‚omiej Danek

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#robots #equivariance #neuralrepresentations
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper ExplainedDay 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 3)Day 2: Replicating Metas NLLB - primary & mined dataDo Vision Transformers See Like Convolutional Neural Networks? | Paper ExplainedDay 11: Open NLLB - Apex, mined data, etc.Tanishq Abraham (PhD at 19) - MedARCDay 6: Meta NLLB - data filtering (Pt. 1)How To Install CUDA, cuDNN, Ubuntu, Miniconda | ML Software Stack | Part 3/3Day 17: Open NLLB - community tasks, dataset sharding, eos token (Pt 3)Day 19: Open NLLB - compute grant, downloading HBS parallel corpora (Pt 1)Ask Me Anything: A Simple Strategy For Prompting Language Models | Paper ExplainedNeuroEvolution of Augmenting Topologies (NEAT) and Compositional Pattern Producing Networks (CPPN)
Aleksa Gordić - The AI Epiphany |

Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper Explained

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER