כתבה
arXiv cs.LG ·
Emergent Object Binding Has a Finite Spatial Horizon
תקציר מקורי באנגליתarXiv:2610.00006v1 Announce Type: cross Abstract: Pretrained Vision Transformers encode whether two image patches belong to the same object. This IsSameObject signal is decodable from frozen patch embeddings at high accuracy, which suggests that object binding emerges from self-supervised pretraining alone. We show that this single accuracy number hides the structure of the signal. Binding is local: the probability that two patches of the same object are decoded as bound falls off monotonically with the distance between them and levels off at a nonzero floor, a falloff well described by an exponential with a finite length scale. This decay holds across object sizes, across three families of probe, on both ADE20K and COCO, and across DINO and CLIP backbones, which indicates that it is a pro
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית