Unsupervised Keypoints for Real-Time Fall Detection: Comparative Analysis Under Real-world Conditions with Predictive Bandwidth Reduction

📄 arXiv: 2607.15400 📥 PDF

作者: Tasmiah Haque, Jacob Kosinski, Sumit Mohan, Srinjoy Das, Mohammad Abdullah Al-Mamun

分类: cs.CV, cs.LG

发布日期: 2026-07-20

💡 一句话要点

提出无监督关键点框架以解决老年人跌倒检测问题

🎯 匹配领域: 支柱七：动作重定向 (Motion Retargeting) 支柱八：物理动画 (Physics-based Animation)

关键词: 跌倒检测 无监督学习 关键点提取 隐私保护 动作识别 变分递归网络 智能监控

📋 核心要点

  1. 现有的监督姿态估计方法在遮挡和部分可见性情况下表现不佳，导致跌倒检测的准确性降低。
  2. 本文提出了一种基于无监督关键点和预测性时间建模的隐私保护框架，以提高跌倒检测的鲁棒性。
  3. 实验结果显示，无监督关键点在遮挡情况下的敏感性强于监督关键点，且在带宽受限时表现更优。

📝 摘要（中文）

老年人跌倒是一个重大安全挑战，但持续监测难以实施。视频捕捉跌倒相关的姿势和动作，但由于隐私、计算和带宽的限制，部署受到限制。本文提出了一种隐私保护框架，通过无监督关键点和预测性时间建模替代RGB传输，进行局部处理以执行分割和关键点提取。通过变分递归预测和序列分类检测跌倒。实验结果表明，在不同的评估条件下，无监督关键点在遮挡和部分可见性情况下表现出更强的鲁棒性，尤其是在带宽受限的情况下，显示出显著的优势。

🔬 方法详解

问题定义：本文旨在解决老年人跌倒检测中的隐私保护和计算带宽限制问题。现有的监督方法在遮挡和部分可见性情况下表现不佳，导致跌倒检测的准确性降低。

核心思路：提出了一种隐私保护框架，通过无监督关键点和预测性时间建模替代传统的RGB视频传输，进行局部处理以提取关键点和进行动作分类。

技术框架：整体架构包括局部处理模块（用于分割和关键点提取）、变分递归预测模块（用于动作预测）和序列分类模块（用于跌倒检测）。

关键创新：最重要的创新在于使用无监督关键点，这使得模型在遮挡和部分可见性情况下仍能保持较高的敏感性，与传统的监督关键点方法相比，具有更好的鲁棒性。

关键设计：在模型设计中，采用了变分递归网络结构，损失函数设计考虑了关键点的空间独立性，以适应可见的身体结构，并减少在缺失标志时的错误。

🖼️ 关键图片

fig_0
fig_1
fig_2

📊 实验亮点

实验结果表明，在随机分割下，无监督关键点与监督关键点的表现相当，但在遮挡情况下，无监督关键点的敏感性显著提高，几乎没有漏检。而在带宽受限的情况下，监督关键点的定位误差加大，导致性能下降，显示出无监督关键点的优势。

🎯 应用场景

该研究的潜在应用领域包括老年人护理、智能家居监控和公共场所安全监测。通过提高跌倒检测的准确性和鲁棒性，该框架能够有效减少老年人跌倒后的伤害风险，提升生活质量。未来，该技术有望在更广泛的监控系统中得到应用，推动智能监测技术的发展。

📄 摘要（原文）

Falls among older adults are a major safety challenge, but continuous monitoring is difficult to sustain. Video captures fall-related posture and motion, yet deployment is limited by privacy, computation, and bandwidth. Supervised pose estimation is anatomically interpretable but vulnerable to occlusion and partial body visibility. We propose a privacy-preserving framework that replaces RGB transmission with compact motion representations based on unsupervised keypoints and predictive temporal modeling. Local processing performs segmentation and keypoint extraction; variational recurrent prediction and sequence classification then detect falls from observed and forecasted motion. We evaluate the framework on the UR Fall Detection and Human Fall datasets using random, subject-disjoint, and occlusion-based splits. Under random splits, neither representation consistently dominates, suggesting that standard protocols may hide meaningful differences. Under subject-disjoint evaluation, supervised keypoints show a statistically significant advantage, but performance varies by subject: they perform better when anatomical landmarks are visible, whereas unsupervised keypoints are more robust to occlusion and partial visibility, though they produce more false positives for complex activities. Under occlusion-based evaluation, supervised keypoints miss nearly half of all falls, while unsupervised keypoints retain strong sensitivity and substantially outperform them. Their anatomical independence allows spatial anchors to adapt to visible body structure rather than fail on absent landmarks. The gap widens under bandwidth constraints, where supervised localization errors compound through the temporal model. These findings show that representation choice should reflect expected visual conditions and that unsupervised keypoints offer an advantage when body visibility is compromised.