EgoSafe:面向视觉安全理解的第一人称移动拍摄基准
英文标题:EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding
研究团队提出 EgoSafe-Bench,用于评估大视觉语言模型(LVLM)在第一人称安全场景中的取证式推理能力。该基准包含 12,000 个评测样本,由 3,000 段视频及其问答链组成,并采用分层推理评估(HRE)协议,要求模型完成从特征锚定、盲区推断到意图推理的完整推理过程。对 Qwen3-VL、Gemini、VideoLLaMA 3 等模型的评测显示,模型的描述与感知能力可以较强,但在因果推理和逻辑闭环方面仍存在明显脆弱性。该工作为开发更具逻辑鲁棒性的视频理解系统提供了具有挑战性的数据集和系统化评估框架。
612 B
380 B
9.1 KB
32.7 KB
22.8 KB
24.2 KB
34.7 KB
中文
[提交于 2026 年 7 月 29 日(
),最后修订于 2026 年 7 月 30 日(当前版本,v2)]
标题:EgoSafe:面向视觉安全理解的第一人称移动拍摄基准
查看题为《EgoSafe:面向视觉安全理解的第一人称移动拍摄基准》的论文 PDF,作者为 Yuyun Chen 及另外 6 位作者。
摘要:现实世界场景中可靠的视觉安全理解,不仅需要对象识别,还需要在认知不确定性下进行因果推理。尽管大视觉语言模型(LVLM)在标准基准上展现出令人印象深刻的语义对齐能力,但当模型面对动态且部分可观测的第一人称体验时,往往难以区分表层相关性与真正的取证逻辑。现有评测主要由第三人称监控视频和二元分类指标主导,未能揭示这一认知鸿沟。为此,我们提出 EgoSafe-Bench,这是一个专门用于探测以自我中心视角呈现的安全场景中取证推理能力的基准。该基准包含 12,000 个独立评测样本:每个样本由 3,000 段视频片段之一与一条受我们提出的分层推理评估(Hierarchical Reasoning Evaluation,HRE)协议约束的问答链配对生成。不同于标准基准,HRE 要求模型遵循严格的推理轨迹,从初始特征锚定,到盲区推断,再到意图推理;这一机制借此强制保证逻辑一致性,并惩罚依赖捷径的预测。对最先进 LVLM(如 Qwen3-VL、Gemini、VideoLLaMA 3)进行的大规模评测揭示了显著的感知—推理解耦现象:模型通常能获得较高的描述性得分,却在因果推理和逻辑闭环方面表现出明显脆弱性。本研究同时提供了一个具有挑战性的数据集和一套系统化评估框架,以推动逻辑鲁棒的视频理解系统发展。
提交历史
提交者:Yuyun Chen [
]
2026 年 7 月 29 日,星期三,06:33:11 UTC(15,130 KB)
[v2]
2026 年 7 月 30 日,星期四,02:44:33 UTC(15,130 KB)
English / 原文
[Submitted on 29 Jul 2026 (
), last revised 30 Jul 2026 (this version, v2)]
Title:EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding
View a PDF of the paper titled EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding, by Yuyun Chen and 6 other authors
Abstract:Reliable visual safety understanding in real-world scenarios demands more than just object recognition; it requires causal reasoning under epistemic uncertainty. While Large Vision-Language Models (LVLMs) demonstrate impressive semantic alignment on standard benchmarks, they often struggle to distinguish between superficial correlation and genuine forensic logic when grounded in the dynamic, partially observable nature of first-person experiences. Existing evaluations, dominated by third-person surveillance footage and binary classification metrics, fail to expose this cognitive gap. To address this, we introduce EgoSafe-Bench, a benchmark specifically designed to probe forensic reasoning in egocentric safety scenarios. It comprises 12,000 unique evaluation samples, generated by pairing each of the 3,000 video clips with a QA chain governed by our proposed Hierarchical Reasoning Evaluation (HRE) protocol. Unlike standard benchmarks, HRE mandates a rigorous reasoning trajectory from initial feature anchoring to blind-spot deduction and intent inference, thereby enforcing logical consistency and penalizing shortcut-based predictions. Extensive evaluations of state-of-the-art LVLMs (e.g., Qwen3-VL, Gemini, VideoLLaMA 3) reveal a significant perception-reasoning decoupling: models often achieve high descriptive scores but exhibit notable fragility in causal reasoning and logical closure. Our work provides both a challenging dataset and a systematic evaluation framework to foster the development of logically robust video understanding systems.
Submission history
From: Yuyun Chen [
]
Wed, 29 Jul 2026 06:33:11 UTC (15,130 KB)
[v2]
Thu, 30 Jul 2026 02:44:33 UTC (15,130 KB)