IntrinsiX: High-Quality PBR Generation using Image Priors @MatthiasNiessner
IntrinsiX: High-Quality PBR Generation using Image Priors  @MatthiasNiessner
Uploaded April 2025 | Updated November 2026, 5 days ago
Project: peter-kocsis.github.io/IntrinsiX

We introduce IntrinsiX, a novel method that generates high-quality intrinsic images from text description. In contrast to existing text-to-image models whose outputs contain baked-in scene lighting, our approach predicts physically-based rendering (PBR) maps. This enables the generated outputs to be used for content creation scenarios in core graphics applications that facilitate re-lighting, editing, and texture generation tasks. In order to train our generator, we exploit strong image priors, and pre-train separate models for each PBR material component (albedo, roughness, metallic, normals). We then align these models with a new cross-intrinsic attention formulation that concatenates key and value features in a consistent fashion. This allows us to exchange information between each output modality and to obtain semantically coherent PBR predictions. To ground each intrinsic component, we propose a rendering loss which provides image-space signals to constrain the model, thus facilitating sharp details also in the output BRDF properties. Our results demonstrate detailed intrinsic generation with strong generalization capabilities that outperforms existing intrinsic image decomposition methods used with generated images by a significant margin. Finally, we show a series of applications, including re-lighting, editing, and text-conditioned room-scale PBR texture generation.
IntrinsiX: High-Quality PBR Generation using Image PriorsIntroduction to Deep Learning (I2DL 2023) - 11. RNNs and TransformersLightIt: Illumination Modeling and Control for Diffusion Models (CVPR24)3D Scanning & Motion Capture: 0. IntroductionDeleted video3D Scanning & Motion Capture: 9. Face Tracking & ReconstructionIntroduction to Deep Learning (I2DL 2023) - 3. Intro Neural NetworksDeleted videoPBR-SR: Mesh PBR Texture Super Resolution from 2D Image PriorsLiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D ScansDeleted videoIntroduction to Deep Learning - 7. Training Neural Networks Part 2  (Summer 2020)
Matthias Niessner |

IntrinsiX: High-Quality PBR Generation using Image Priors

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER