Neuro-Symbolic AI for LEED compliance: Document-Centric Benchmarking, Deterministic Numeric Checking, and When Multimodal Hurts
作者: Aritro De, Juliana Felkner
分类: cs.AI
发布日期: 2026-07-20
💡 一句话要点
提出神经符号AI以解决LEED合规性验证问题
🎯 匹配领域: 支柱九：具身大模型 (Embodied Foundation Models)
关键词: 神经符号AI LEED合规性 文档审核 自动化验证 语言模型 数值检查
📋 核心要点
- 现有LEED合规性验证方法依赖人工审核，效率低且容易出错。
- 提出的神经符号管道结合语言模型与符号组件，自动化文档筛选与合规性验证。
- 实验结果显示，4亿参数模型的文本验证准确率为67.3%，并显著提升了数值检查的准确性。
📝 摘要（中文）
LEED v4.1 BD+C认证过程文档密集，需人工审核数百页项目证据并应用特定逻辑。本文探讨小型语言模型在LEED文档筛选中的有效性，并提出神经符号管道，结合项目PDF与LEED信用部分，利用关键字签名检索证据，使用本地4亿参数语言模型验证合规性，并应用特定的数值检查器。实验表明，4亿参数模型在文本验证中表现最佳，准确率达到67.3%。该管道为LEED合规性验证提供了初步可重复的参考点。
🔬 方法详解
问题定义：本文旨在解决LEED v4.1 BD+C认证过程中的文档审核效率低下和准确性不足的问题。现有方法依赖人工审核，容易出现错误且耗时长。
核心思路：论文提出了一种神经符号管道，利用小型语言模型和符号组件的结合，自动化处理LEED文档的筛选和合规性验证，旨在提高效率和准确性。
技术框架：该管道包括几个主要模块：首先，将项目PDF与LEED信用部分对齐；其次，使用关键字签名检索相关证据；然后，利用本地部署的4亿参数语言模型进行合规性验证；最后，应用LEED特定的数值检查器来验证定量阈值。
关键创新：最重要的创新在于结合了神经网络和符号逻辑，形成了一个高效的文档审核系统。与传统方法相比，该方法实现了更高的自动化程度和准确性。
关键设计：在设计中，使用了4亿参数的语言模型（gemma3:4b）作为核心验证器，并通过数值检查器修正关键定量信用的算术错误。实验还表明，低分辨率图像的加入会降低准确性，提示了不同文档特征对提示效果的影响。
🖼️ 关键图片
📊 实验亮点
实验结果显示，4亿参数的语言模型在文本验证中准确率达到67.3%，超越了8亿参数模型。数值检查器在关键定量信用上将准确率从50%提升至100%，整体神经符号配置的准确率为61.6%。
🎯 应用场景
该研究的潜在应用领域包括建筑行业的LEED认证过程，能够显著提高文档审核的效率和准确性，减少人工审核的工作量。未来，该方法可扩展到其他需要文档审核的合规性验证领域，具有广泛的实际价值和影响。
📄 摘要（原文）
LEED v4.1 BD+C certification remains a document-intensive process that requires reviewers to read hundreds of pages of project evidence and apply credit-specific threshold logic by hand. This paper investigates whether small, locally deployed language models can perform meaningful screening of LEED documentation and how deterministic symbolic components should share that work. A neuro-symbolic pipeline is introduced that aligns project PDFs to LEED credit sections, retrieves evidence with credit-aware keyword signatures, verifies compliance with a locally hosted 4-billion-parameter language model, and applies a LEED-specific numeric checker to quantitative thresholds. Experiments on four university buildings (484 PDFs, 153 credit-level decisions) show that a 4-billion-parameter model (gemma3:4b) is the strongest text-only core verifier, achieving 67.3% accuracy and outperforming a larger 8-billion-parameter model (llama3.1:8b) in this task. The deterministic numeric checker corrects arithmetic errors on key quantitative credits, moving EA-p2 from 50% to 100% accuracy and improving several other credits when required values are reliably extracted. At the same time, the full neuro-symbolic configuration achieves 61.6% overall accuracy, trailing the best text-only baseline due to extraction failures and conservative behavior on qualitative categories. Systematic ablations show that adding low-resolution drawing images (150-300 dpi) consistently reduces accuracy, and that prompt effectiveness depends on the building's ground-truth PASS rate: rubric prompts perform best on documentation-rich projects, while chain-of-thought prompts perform best on documentation-lean projects. Within the specific scope of LEED v4.1 BD+C compliance verification over raw project documentation, this pipeline and its baselines provide an initial reproducible reference point for both accuracy and failure modes.