论文研究 arXiv cs.CL Fri, 14 Aug 2026 正文 ok 174 words

视觉—语言模型是脆弱的多语言关联器

英文标题:Vision-Language Models are Fragile Multilingual Associators

该论文提出 M$^2$BIND 基准,用于检验视觉—语言模型在上下文和查询语言变化时,能否稳定地将视觉实体与文本属性建立关联。研究从任务性能指标和因果干预两个层面评估概念绑定,发现这种绑定并不具备语言不变性。跨语系、跨文字系统的输入会导致显著的绑定崩溃,模型内部的绑定计算会后移至更深层,并失去部分因果强度。对于开发者和行业而言,这意味着面向全球多语言场景部署 VLM 时,不能假定其能维持单语评测中表现出的关联质量。
打开原文相关 1.6 · 机会 0
media2.1 KB media640 B media612 B media380 B media9.1 KB media32.7 KB media22.8 KB media24.2 KB media34.7 KB

中文

[提交于 2026 年 6 月 2 日]

标题:视觉—语言模型是脆弱的多语言关联器

查看题为《视觉—语言模型是脆弱的多语言关联器》的论文 PDF,作者为 Ritabrata Chakraborty 及其他 4 位作者

查看 PDF HTML(实验版)

摘要:视觉—语言模型必须将视觉实体与文本属性建立关联。随着输入语言发生变化,这些关联或概念绑定能否保持稳定,尚未得到研究。我们提出了 M$^2$BIND,这是一个在多种语言之间改变上下文和查询语言的基准测试。我们通过任务性能指标进行外在评估,并通过因果干预进行内在评估,以衡量绑定能力。我们发现,绑定并不具有语言不变性:跨语系和跨文字系统的设定会引发显著的绑定崩溃,模型内部的绑定计算会转移到更靠后的层,并失去因果强度。关系更为接近的语言相对更能保持关联。更广泛地说,我们的发现表明,在全球多语言环境中部署的 VLM,不能被假定能够维持单语评估中观察到的相同关联质量。

提交历史

作者:Ritabrata Chakraborty [

查看邮箱

]

[v1]

2026 年 6 月 2 日,周二,19:59:11 UTC(1,203 KB)

English / 原文

[Submitted on 2 Jun 2026]

Title:Vision-Language Models are Fragile Multilingual Associators

View a PDF of the paper titled Vision-Language Models are Fragile Multilingual Associators, by Ritabrata Chakraborty and 4 other authors

View PDF HTML (experimental)

Abstract:Vision-language models must associate visual entities with textual attributes. Whether these associations or concept bindings remain stable when the language of the input changes is unexplored. We introduce M$^2$BIND, a benchmark varying the language of the context and query across multiple languages. We evaluate binding both extrinsically through task performance metrics and intrinsically through causal interventions. We find that binding is not language-invariant: cross-family and cross-script settings trigger significant binding collapse, with the model's internal binding computation shifting to later layers and losing causal strength. Closely related languages preserve associations comparatively better. In a broader sense, our findings indicate how VLMs deployed globally in multilingual settings cannot be assumed to maintain the same association quality observed in monolingual evaluation.

Submission history

From: Ritabrata Chakraborty [

view email

]

[v1]

Tue, 2 Jun 2026 19:59:11 UTC (1,203 KB)