Compass 1: Towards Open-World and Persistent Embodied Navigation from Monocular RGB Videos
Embodied navigation requires agents to achieve persistent spatial awareness and long-horizon execution stability in open-world environments. However, existing navigation architectures struggle to sustain both capabilities, remaining effective only over a handful of recent frames. We present Compass 1, the first embodied navigation foundation model to unify language understanding and video generation while enabling memory backtracking through nearly 2mins of visual history. Without altering the underlying architecture, we introduce History Representation, which integrates sparse visual keyframes with an explicit History Representation Map to preserve long-term spatiotemporal context. To effectively leverage this history, we further introduce History Utilization, a structured VQA supervision protocol comprising three categories: task-stage grounding, exploration consistency, and spatiotemporal target retrieval, enabling map-grounded reasoning and stable persistent long-horizon navigation. To fuel this system, we establish a complete annotation pipeline for monocular RGB videos and open-source a massive dataset featuring over 500 hours of high-quality real-world interactions and…
Foundation model for open-world embodied navigation from monocular videos.
- arXiv
- 2611.12087
- Authors
- Hai Zhang, Siqi Liang, Yanjun Guo, Shoufeng Zhang, Yunhao Wang and 15 more
- Categories
- cs.CV · cs.RO