כתבה
arXiv cs.LG ·
AnyJev Technical Report
תקציר מקורי באנגליתarXiv:2610.00831v1 Announce Type: new Abstract: A typed decision is a choice among a fixed set of options, returned as a probability rather than as text. Systems that need typed decisions today use models trained for that purpose. This report describes AnyJev, which reads a typed decision from one prefill of a pretrained instruction-tuned language model. The readout restricts the next-token distribution at the answer position to the option tokens. It has two defects: the model assigns higher probability to some labels whatever the input, and to some positions in the option list. AnyJev corrects both with no gradient steps and no parameter changes: it divides out a label prior estimated from unlabelled inputs, and it averages log-probabilities over the K cyclic rotations of the option list.
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית