Physical AI for Intralogistics: Benchmarking the NVIDIA Sim-to-Real Ecosystem for Cosmos-Enhanced COMPASS Navigation on Industrial Mobile Robots

📄 arXiv: 2610.28432v1 📥 PDF

作者: Charbel Abi Hana, Rayan Zaitouni, Kameel Amareen, Mohamad Mostafa, Hasan Sayour, Wei Liu, Yan Chang, Mihir Acharya, Anthony Rizk

分类: cs.RO

发布日期: 2026-10-20


💡 一句话要点

基于NVIDIA Cosmos的COMPASS导航提升工业移动机器人导航性能

🎯 匹配领域: 支柱一:机器人控制 (Robot Control)

关键词: 机器人导航 学习算法 数字双胞胎 仿真到现实 工业自动化 NVIDIA Cosmos COMPASS框架

📋 核心要点

  1. 现有的机器人导航方法在不同机器人和环境中需要大量的手动调整,效率低下且不够灵活。
  2. 本文提出了一种基于NVIDIA Cosmos的COMPASS导航框架,通过数字双胞胎环境进行训练,减少了对手动调参的依赖。
  3. 实验结果显示,使用Cosmos增强的数据训练后,学习导航的成功率从65.3%提升至91.7%,并且旅行时间几乎减半。

📝 摘要(中文)

传统的机器人导航系统虽然可靠,但通常需要针对每种新机器人类型和场地进行重新设计。基于学习的导航方法将这一工作从手动调参转移到数据生成和训练上,使得策略能够通过在模拟环境中的微调适应新的机器人和设施。本文研究了NVIDIA的X-Mobility和COMPASS工作流在Idealworks机器人的学习导航策略训练中的有效性。通过在数字双胞胎环境中进行训练,结合NVIDIA Cosmos生成的仿真到现实数据,显著提高了学习导航的成功率和效率。

🔬 方法详解

问题定义:本文旨在解决传统机器人导航系统在不同机器人和环境中需要频繁重新设计的问题,现有方法在适应性和效率上存在不足。

核心思路:通过在数字双胞胎环境中训练学习导航策略,并结合NVIDIA Cosmos生成的仿真到现实数据,来提高导航策略在真实环境中的可靠性和效率。

技术框架:整体流程包括在数字双胞胎中进行初始训练,使用Cosmos生成的仿真到现实数据进行微调,最后将训练好的策略部署到实际机器人上进行测试。主要模块包括数据生成、策略训练和性能评估。

关键创新:本文的主要创新在于将Cosmos生成的仿真到现实数据与COMPASS导航框架结合,显著提升了学习导航的成功率和效率,克服了传统方法的局限性。

关键设计:在训练过程中,采用了特定的损失函数和网络结构,以适应不同的机器人平台,并通过优化参数设置来提升模型的泛化能力。

🖼️ 关键图片

fig_0
fig_1
fig_2

📊 实验亮点

实验结果表明,使用NVIDIA Cosmos增强的数据训练后,学习导航的成功率从65.3%提升至91.7%,旅行时间几乎减半,接近现有导航系统的性能。这一成果展示了仿真到现实技术在工业机器人导航中的重要价值。

🎯 应用场景

该研究的潜在应用领域包括工业自动化、仓储物流和智能制造等。通过提升机器人导航的可靠性和效率,可以显著降低人工干预的需求,提高生产效率,推动智能机器人在实际工业环境中的广泛应用。

📄 摘要(原文)

Classical robot navigation stacks are reliable but often require re-engineering for each new robot type and site. Learning-based navigation shifts this effort from hand-tuned parameters to data generation and training, where a policy adapts to each new embodiment or facility by fine-tuning in simulation. Whether policies adapted this way stay reliable on real industrial robots has seen little systematic testing. We study this for NVIDIA's X-Mobility and COMPASS workflow for training learned navigation policies on Idealworks robots. In simulation, we extend the COMPASS benchmark with two embodiments, the differential-drive iw.hub and an omnidirectional Humanoid Mobile Platform (HMP), and with a digital twin of the Idealworks R&D center. For the real world, we fine-tune X-Mobility on data from this digital twin, with and without sim-to-real variants generated by NVIDIA Cosmos, train COMPASS on top of it from scratch in the digital twin, deploy the resulting policies on the iw.hub's onboard Jetson AGX Xavier, and benchmark them in the Idealworks R&D center against COMPASS trained only on NVIDIA's environments and the existing Idealworks navigation stack on task success, efficiency, safety, smoothness and onboard compute. Running every static scenario both in a digital-twin replica and in the real facility measures the sim-to-real gap and how far Cosmos-augmented data closes it. Training in the digital twin with Cosmos sim-to-real augmentation raises the real-world success rate of learned navigation from 65.3% to 91.7% across four scenarios and nearly halves its weighted travel time compared with simulation-only training, bringing it within 8.3 points of the production navigation stack, fully onboard; with an integrated global planner, it also reaches far, occluded goals in every trial.