Uploaded March 2022 | Updated November 2026, 4 hours ago
This work presents a framework for Multi-Modal SLAM (MIMOSA) that utilizes a nonlinear factor graph as the underlying representation to provide loosely-coupled fusion of any number of sensing modalities Tailored to the goal of enabling resilient robotic autonomy in GPS-denied and visually degraded environments, MIMOSA currently contains modules for pointcloud registration and fusion of odometry estimates relying on visible-light and thermal vision. A flexible backend utilizes the estimates from various modalities as relative transformation factors. The method is designed to be robust to degeneracy through the maintenance and tracking of modality-specific health metrics, while also being inherently tolerant to sensor failure.
This work presents a framework for Multi-Modal SLAM (MIMOSA) that utilizes a nonlinear factor graph as the underlying representation to provide loosely-coupled fusion of any number of sensing modalities Tailored to the goal of enabling resilient robotic autonomy in GPS-denied and visually degraded environments, MIMOSA currently contains modules for pointcloud registration and fusion of odometry estimates relying on visible-light and thermal vision. A flexible backend utilizes the estimates from various modalities as relative transformation factors. The method is designed to be robust to degeneracy through the maintenance and tracking of modality-specific health metrics, while also being inherently tolerant to sensor failure.










