ReDiS: Reasoning-Diagnosis Self-Evolution for Multimodal Reasoning in Remote Sensing

📄 arXiv: 2610.18388v1 📥 PDF

作者: Yi Liu, Wentao Jiang, Shuo Ni, Zhiming Luo, Di Wang, Zengmao Wang, Jing Zhang, Bo Du

分类: cs.CV

发布日期: 2026-10-13


💡 一句话要点

提出ReDiS框架以解决遥感多模态推理中的可靠性问题

🎯 匹配领域: 支柱九:具身大模型 (Embodied Foundation Models)

关键词: 多模态推理 遥感理解 推理框架 视觉证据 自演化机制

📋 核心要点

  1. 现有方法在遥感多模态推理中面临可靠性不足的问题,尤其是在细粒度视觉定位和多步推理任务中。
  2. 本文提出的ReDiS框架通过分离推理探索与候选评估,允许两者共同演化,从而提高推理的可靠性和准确性。
  3. 在LHRS-Bench、MME-RS和CHOICE等数据集上,ReDiS在0.8B、2B和4B规模上均表现出一致的性能提升,0.8B时提高了6.47个百分点。

📝 摘要(中文)

多模态大语言模型(MLLMs)在遥感理解中展现出强大的潜力,但在需要细粒度视觉定位和多步推理的任务中,可靠的推理仍然具有挑战性。现有方法通常依赖于昂贵的预构建推理轨迹或自生成信号,这可能导致共享错误的强化和不可靠的监督。本文提出了推理-诊断自演化(ReDiS)框架,分离推理探索与候选评估,同时允许两者共同演化。ReDiS从共享的多模态骨干网中实例化了两个角色特定的专家:探索多样视觉证据的推理者和评估完整候选集并提供可信度反馈的诊断者。实验结果显示,ReDiS在多个基准测试上相较于Qwen3.5骨干网有显著提升。

🔬 方法详解

问题定义:本文旨在解决遥感多模态推理中推理可靠性不足的问题。现有方法依赖于昂贵的预构建推理轨迹或自生成信号,容易导致错误的强化和不可靠的监督。

核心思路:ReDiS框架通过将推理探索与候选评估分离,允许推理者和诊断者共同演化,从而提高推理的准确性和可靠性。推理者探索多样的视觉证据,而诊断者则评估候选集并提供反馈。

技术框架:ReDiS框架包括两个主要模块:推理者和诊断者。推理者负责探索不同的视觉证据和答案候选,而诊断者则对候选集进行评估,并根据推理者的演变调整学习信号。

关键创新:ReDiS的创新在于将推理探索与候选评估分开,使得两者能够独立演化,从而避免了现有方法中共享错误的强化问题。

关键设计:在设计中,ReDiS引入了失败触发恢复(FTR)机制,以应对所有采样答案均错误的情况,提供最小的结果级别修正,而不需要规定中间推理轨迹。

🖼️ 关键图片

fig_0
fig_1
fig_2

📊 实验亮点

实验结果表明,ReDiS在LHRS-Bench、MME-RS和CHOICE数据集上均显著优于Qwen3.5骨干网。在0.8B规模下,ReDiS提高了6.47个百分点的类别平均准确率,而ReDiS-4B在比较的遥感MLLMs中实现了最高的平均性能。

🎯 应用场景

该研究的潜在应用领域包括遥感图像分析、环境监测和灾害评估等。通过提高多模态推理的可靠性,ReDiS框架能够在实际应用中提供更准确的决策支持,推动遥感技术的发展与应用。

📄 摘要(原文)

Multimodal large language models (MLLMs) have shown strong potential for remote sensing understanding, yet reliable reasoning remains challenging when tasks require fine-grained visual grounding and multi-step inference. Existing approaches typically rely on either costly pre-constructed reasoning trajectories or self-generated signals such as response consistency, which can reinforce shared errors and provide unreliable supervision. We introduce \textbf{Reasoning--Diagnosis Self-Evolution (ReDiS)}, a framework that separates reasoning exploration from candidate evaluation while allowing the two processes to evolve jointly. ReDiS instantiates two role-specific experts from a shared multimodal backbone: a \textbf{Reasoner} that explores diverse visual evidence--answer candidates and a \textbf{Diagnoser} that jointly evaluates the complete candidate set and provides credibility-aware feedback. As the Reasoner evolves, it exposes new candidate distributions and failure modes; the Diagnoser adapts to these changes and, in turn, reshapes the learning signal for subsequent exploration. To handle groups in which all sampled answers are incorrect and group-relative advantages vanish, we further introduce \textbf{Failure-Triggered Recovery (FTR)}, which provides minimal outcome-level correction without prescribing intermediate reasoning trajectories. Experiments on LHRS-Bench, MME-RS, and CHOICE show consistent improvements over Qwen3.5 backbones at 0.8B, 2B, and 4B scales. ReDiS improves category-averaged accuracy by 6.47 percentage points at 0.8B, while ReDiS-4B achieves the highest average performance among the compared remote sensing MLLMs.