LHNav: Long-Horizon Humanoid Navigation via Multirate Coordination and Physics-Grounded Action Data
We study humanoid navigation across multiple destinations under long-horizon language instructions. This task is challenging because robots must maintain progress across successive goals while continuously producing natural, stable whole-body motion through confined spaces. However, task decomposition in existing methods does not by itself ensure progress throughout execution, while waypoint-based navigation does not guarantee natural, route-faithful whole-body motion. Our key idea is to organize navigation into three complementary roles operating at different time scales: a Brain for task reasoning, a Cerebellum for local motion generation, and a Brainstem for whole-body execution. We realize this idea in LHNav, an asynchronous system that uses progress and arrival feedback to coordinate navigation goals, VLA motion-token prediction, and whole-body control. To train the Cerebellum for natural, route-faithful motion, we develop a physics-grounded data engine that improves physical tracking of motion references along collision-aware routes and pairs the resulting demonstrations with rendered visual observations. Together, these designs allow task planning to proceed alongside…
Long-horizon humanoid navigation with multirate coordination and physics-grounded data.
- arXiv
- 2611.12136
- Authors
- Xueyang Wang, Zehong Shen, Dingkun Wei, Huaijin Pi, Changpeng Wang and 4 more
- Categories
- cs.RO · cs.CV