אני לא מחסיר אותך, אבל אני כן: אמינות ההסבר העצמי של חסרונם של מודלים ויז'ואלי-לשוניים

תקציר מקורי באנגליתarXiv:2609.07596v1 Announce Type: new Abstract: Vision-language models are increasingly used in settings where some input modalities may be unavailable, yet we know little about whether they can faithfully explain how such missing information affects their own predictions. We introduce an interventional protocol for evaluating self-explanations of modality dynamics: models state what each modality alone would support, whether restoring a missing modality would change their answer, and whether the available evidence is sufficient; we then execute the corresponding modality intervention and compare these claims with the model's realized behavior. We evaluate eight open-weight VLMs from two model families across four tasks spanning complementary and isomorphic text-image settings and a multi-