Abstract
A real-time RGB SLAM system uses differentiable uncertainty-aware bundle adjustment to handle dynamic environments by estimating per-pixel uncertainty from multi-view visual features, achieving state-of-the-art performance in cluttered scenes while maintaining real-time processing.
We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. Traditional SLAM methods typically assume static scenes, leading to tracking failures in the presence of motion. Recent dynamic SLAM approaches attempt to address this challenge using predefined dynamic priors or uncertainty-aware mapping, but they remain limited when confronted with unknown dynamic objects or highly cluttered scenes where geometric mapping becomes unreliable. In contrast, our method estimates per-pixel uncertainty by exploiting multi-view visual feature inconsistency, enabling robust tracking and reconstruction even in real-world environments. The proposed system achieves state-of-the-art camera poses and scene geometry in cluttered dynamic scenarios while running in real time at around 10 FPS. Code and datasets are available at https://github.com/MoyangLi00/DROID-W.git.
Community
Our approach delivers high-quality dynamic point cloud reconstruction, accurate camera pose estimation, and dynamic uncertainty estimation. It robustly handles any real-world videos, including challenging film clips, and also supports static Gaussian Splatting mapping. Check our webpage for more interesting results!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos (2026)
- M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM (2026)
- Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions (2026)
- VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM (2026)
- NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting (2026)
- Dream-SLAM: Dreaming the Unseen for Active SLAM in Dynamic Environments (2026)
- AIM-SLAM: Dense Monocular SLAM via Adaptive and Informative Multi-View Keyframe Prioritization with Foundation Model (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper