GigaPath-Flash and GigaTIME-Flash: Efficient Pathology Foundation Models for Whole-Slide and Tumor Microenvironment Analysis

📄 arXiv: 2607.18218v1 📥 PDF

作者: Naoto Usuyama, Jeya Maria Jose Valanarasu, Sicong Yao, Hanwen Xu, Jaspreet Bagga, Guanghui Qin, Robert E. Kramer, Cliff Wong, Soohee Lee, Hao Qiu, Theodore Zhengde Zhao, Racheli Ben Shimol, Angela Crabtree, Kevin Matlock, Eduardo Alejandro Lozano Garcia, Naiteek Sangani, Alberto Santamaria-Pang, Jason Entenmann, Alexandra Q. Bartlett, Bill J. Wright, Bernard A. Fox, Brian Piening, Sheng Zhang, Sheng Wang, Tristan Naumann, Carlo Bifulco, Hoifung Poon

分类: cs.CV, cs.AI

发布日期: 2026-07-20

备注: Models: https://aka.ms/gigapath-flash (GigaPath-Flash) and https://aka.ms/gigatime-flash (GigaTIME-Flash)

💡 一句话要点

提出GigaPath-Flash和GigaTIME-Flash以解决病理图像分析效率问题

🎯 匹配领域: 支柱九：具身大模型 (Embodied Foundation Models)

关键词: 病理学 基础模型 图像分析 深度学习 肿瘤免疫微环境 高效计算 临床应用

📋 核心要点

  1. 现有的病理学基础模型多在图像块级别操作，计算成本高，限制了临床应用。
  2. GigaPath-Flash和GigaTIME-Flash结合高效的编码器，能在全幻灯片级别进行病理分析，提升了计算效率。
  3. GigaPath-Flash在保持97%性能的同时，计算需求减少50倍，GigaTIME-Flash在预测质量上超越了原有模型，速度提升6倍。

📝 摘要（中文）

基础模型在计算病理学中已成为推动力，能够通过学习大规模组织病理数据的可转移表示来改变癌症的诊断、预后和治疗选择。尽管现有的预训练模型多在图像块级别操作，且计算成本高，限制了其在临床和研究中的大规模应用。本文提出的GigaPath-Flash和GigaTIME-Flash是高效的全幻灯片病理AI和空间蛋白组学预测模型，前者结合了22M参数的ViT-S图块编码器和21M参数的LongNet幻灯片编码器，后者则直接从常规H&E图像中预测肿瘤免疫微环境，性能显著提升且计算资源消耗大幅降低。

🔬 方法详解

问题定义：本文旨在解决现有病理学模型在图像块级别操作的局限性，导致计算成本高且不适合大规模临床应用的问题。

核心思路：通过引入GigaPath-Flash和GigaTIME-Flash，结合高效的编码器架构，直接在全幻灯片级别进行分析，从而提高计算效率和预测准确性。

技术框架：GigaPath-Flash包含一个22M参数的ViT-S图块编码器和一个21M参数的LongNet幻灯片编码器，二者均在大规模真实世界的组织病理数据上进行预训练。GigaTIME-Flash则在此基础上扩展，直接从H&E图像中预测肿瘤免疫微环境。

关键创新：GigaPath-Flash和GigaTIME-Flash的主要创新在于其高效的模型设计，能够在保持高性能的同时显著降低计算需求，与传统的CNN模型相比，计算效率和资源消耗均有显著提升。

关键设计：GigaPath-Flash的图块编码器是从一个十亿参数的GigaPath教师模型中蒸馏而来，确保了模型的紧凑性和高效性。GigaTIME-Flash在预测质量上超越了原有的CNN模型，同时运行速度提升6倍，GPU内存使用减少8倍。

🖼️ 关键图片

fig_0
fig_1
fig_2

📊 实验亮点

GigaPath-Flash在计算需求上减少了50倍，同时保持了97%的平均幻灯片级别性能；GigaTIME-Flash在预测质量上超越了原有的CNN模型，运行速度提升6倍，GPU内存使用减少8倍，展现了显著的性能优势。

🎯 应用场景

该研究的潜在应用领域包括计算病理学、免疫肿瘤学和精准医疗。通过提供开放权重和模型，研究人员和临床医生可以更容易地利用这些工具进行癌症诊断和治疗选择，从而推动个性化医疗的发展。

📄 摘要（原文）

Foundation models have emerged as a driving force in computational pathology, with the potential to transform cancer diagnosis, prognosis, and treatment selection by learning transferable representations from large-scale histopathology data. A growing landscape of pathology foundation models now spans diverse data sources, architectures, and downstream applications. However, most pretrained models operate only at the image-tile level, use restrictive licenses, and remain computationally expensive, limiting large-scale slide-level clinical and research use. Here, we introduce GigaPath-Flash and GigaTIME-Flash, efficient models for whole-slide pathology AI and spatial proteomics prediction. GigaPath-Flash combines a 22M-parameter ViT-S tile encoder with a 21M-parameter LongNet slide encoder, both pretrained on large-scale real-world histopathology data. Its compact tile encoder is distilled from the billion-parameter GigaPath (ViT-g) teacher and shared by both models. GigaPath-Flash retains 97% of GigaPath's average slide-level performance with 50x less compute. GigaTIME-Flash extends this backbone to predict the tumor immune microenvironment directly from routine H&E images. It surpasses the original CNN-based GigaTIME in prediction quality while running 6x faster and using 8x less GPU memory. Together with GigaPath and GigaTIME, these models form an open-weight, Apache-2.0-licensed family pretrained on large-scale real-world clinical data. By releasing all models and weights, we provide accessible building blocks for computational pathology, immuno-oncology, and precision health.