MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and Editing @MatthiasNiessner
MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and Editing  @MatthiasNiessner
Uploaded March 2025 | Updated November 2026, 2 hours ago
Project: derkleineli.github.io/meshpad
Paper: arxiv.org/abs/2503.01425

We introduce MeshPad, a generative approach that creates 3D meshes from sketch inputs. Building on recent advances in artistic-designed triangle mesh generation, our approach addresses the need for interactive artistic mesh creation. To this end, we focus on enabling consistent edits by decomposing editing into ‘deletion’ of regions of a mesh, followed by ‘addition’ of new mesh geometry. Both operations are invoked by simple user edits of a sketch image, facilitating an iterative content creation process and enabling the construction of complex 3D meshes. Our approach is based on a triangle sequence-based mesh representation, exploiting a large Transformer model for mesh triangle addition and deletion. In order to perform edits interactively, we introduce a vertex-aligned speculative prediction strategy on top of our additive mesh generator. This speculator predicts multiple output tokens corresponding to a vertex, thus significantly reducing the computational cost of inference and accelerating the editing process, making it possible to execute each editing step in only a few seconds. Comprehensive experiments demonstrate that MeshPad outperforms state-of-the-art sketch-conditioned mesh generation methods, achieving more than 22% mesh quality improvement in Chamfer distance, and being preferred by 90% of participants in perceptual evaluations.
MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and EditingAnimating the Uncaptured: Humanoid Mesh Animation with Video Diffusion ModelsTUM AI Lecture Series - Implicit Neural Scene Representations (Vincent Sitzmann)Deleted videoNeRSemble: Multi-view Radiance Field Reconstruction of Human Heads (SIGGRAPH23)3D Scanning & Motion Capture: 5. Rigid ReconstructionIntrinsiX: High-Quality PBR Generation using Image PriorsIntroduction to Deep Learning (I2DL 2023) - 11. RNNs and TransformersLightIt: Illumination Modeling and Control for Diffusion Models (CVPR24)3D Scanning & Motion Capture: 0. IntroductionDeleted video3D Scanning & Motion Capture: 9. Face Tracking & Reconstruction
Matthias Niessner |

MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and Editing

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER