HALO: High-Altitude Language-Conditioned Monocular Aerial Exploration and Navigation @KumarLabPenn
HALO: High-Altitude Language-Conditioned Monocular Aerial Exploration and Navigation  @KumarLabPenn
Uploaded November 2025 | Updated November 2026, 2 days ago
Project Page: tyuezhan.github.io/halo
arXiv: arxiv.org/abs/2511.17497
Abstract: We demonstrate real-time high-altitude aerial metric-semantic mapping and exploration using a monocular camera paired with a global positioning system (GPS) and an inertial measurement unit (IMU). Our system, named HALO, addresses two key challenges: (i) real-time dense 3D reconstruction using vision at large distances, and (ii) mapping and exploration of large-scale outdoor environments with accurate scene geometry and semantics. We demonstrate that HALO can plan informative paths that exploit this information to complete missions with multiple tasks specified in natural language. In simulation-based evaluation across large-scale environments of size up to 78,000 sq. m., HALO consistently completes tasks with less exploration time and achieves up to 68% higher competitive ratio in terms of the distance traveled compared to the state-of-the-art semantic exploration baseline. We use real-world experiments on a custom quadrotor platform to demonstrate that (i) all modules can run onboard the robot, and that (ii) in diverse environments HALO can support effective autonomous execution of missions covering up to 24,600 sq. m. area at an altitude of 40 m.
HALO: High-Altitude Language-Conditioned Monocular Aerial Exploration and NavigationDesign and Control of Aerial Modules for Inflight Self-disassemblyVision-based (no motion capture) estimation, control and planning for small quadrotors_oldDevices, Systems, and Methods for Automated Monitoring enabling Precision AgricultureAny Way You Look at It: Semantic Crossview Localization and Mapping With LiDARPlanning and Control of Aggresive Maneuvers for Perching on Inclined and Vertical SurfacesVision-based Multi-MAV Localization with Anonymous Relative Measurements Using CPDAF FilterA Swarm of Flying Phones (CES 2016)Toward Soft Micro Bio Robots for Cellular and Chemical DeliveryTrajectory Optimization with Global Yaw Parameterization for FOV Constrained Autonomous FlightAutonomous Flight for Detection, Localization, and Tracking of Moving Targets With a Small QuadrotorInformation-Theoretic Mapping Using Cauchy-Schwarz Quadratic Mutual Information
Vijay Kumar |

HALO: High-Altitude Language-Conditioned Monocular Aerial Exploration and Navigation

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER