כתבה
arXiv cs.AI ·
מסך רק פעם אחת
Screening Is Enough
אנו מציגים screening, שיטה למאפיין קבוע של דומיות חיפוש-מפתח. screening
תקציר מקורי באנגליתarXiv:2604.01178v4 Announce Type: replace-cross Abstract: We call query--key relevance absolute when its values lie on a fixed bounded scale, depend on neither competing keys nor sequence length, require no sequence-length-dependent calibration, and can all be zero. To realize this notion, we introduce screening, whose explicit threshold transforms bounded query--key similarities into relevance values, enabling exact rejection, empty selection, and direct inspection on a common scale. In a controlled comparison of 12 attention mechanisms on a matched Transformer backbone, only screening maintains both low long-context perplexity and robust retrieval beyond the training context; notably, it does so without inference-time scaling. Building on screening, we introduce Multiscreen, a language-m
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית