כתבה
arXiv cs.LG ·
אורקלי תקציר
Specification Oracles
דגם שפה משמש כאורקל תקציר קצר ומצומצם
תקציר מקורי באנגליתarXiv:2609.13415v1 Announce Type: new Abstract: Specifications face a basic tradeoff: leave details out, and important questions go unanswered; record every detail separately, and the specification becomes large and prolix. We investigate whether a language model can serve as a compact, living specification oracle by learning facts about a target and answering questions about it directly. We compare two ways of storing the learned facts: external text notes and changes to the model's weights. Across four families of 596-fact worlds and two Qwen2.5 model sizes, weight-only oracles benefited substantially more from structure: with the 7B model, their accuracy integrated across storage capacities was 18.5 percentage points higher on structured than unstructured worlds, compared with 1.1 point
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית