AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting Conditions @KumarLabPenn
AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting Conditions  @KumarLabPenn
Uploaded September 2024 | Updated November 2026, 4 days ago
Preprint: arxiv.org/abs/2409.15487
Neural Radiance Fields (NeRFs) have shown significant promise in 3D scene reconstruction and novel view synthesis. In agricultural settings, NeRFs can serve as digital twins, providing critical information about fruit detection for yield estimation and other important metrics for farmers. However, traditional NeRFs are not robust to challenging lighting conditions, such as low-light, extreme bright light and varying lighting. To address these issues, this work leverages three different sensors: an RGB camera, an event camera and a thermal camera. Our RGB scene reconstruction shows an improvement in PSNR and SSIM by +2.06 dB and +8.3% respectively. Our cross-spectral scene reconstruction enhances downstream fruit detection by +43.0% in mAP50 and +61.1% increase in mAP50-95. The integration of additional sensors leads to a more robust and informative NeRF. We demonstrate that our multi-modal system yields high quality photorealistic reconstructions under various tree canopy covers and at different times of the day. This work results in the development of a resilient NeRF, capable of performing well in visibly degraded scenarios, as well as a learnt cross-spectral representation, that is used for automated fruit detection.
AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting ConditionsDesign and Evaluation of Motion Planners for QuadrotorsSPINE: Online Semantic Planning for Missions with Incomplete Natural Language SpecificationsControl of Quadrotors using the Hopf Fibration on SO(3)Shape and Motion Control of a SwarmActively Resolving Contextual Uncertainty for Underspecified Tasks in Natural LanguageVision Transformers for End-to-End Vision-Based Quadrotor Obstacle AvoidanceAn Active Perception Game for Robust Information Gathering
Vijay Kumar |

AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting Conditions

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER