כתבה
arXiv cs.LG ·
The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning
תקציר מקורי באנגליתarXiv:2607.20952v1 Announce Type: new Abstract: Latent, or silent, reasoning lets language models carry out intermediate computation in continuous vector space instead of words, and is widely assumed to function as an internal scratchpad the model actively consults during inference. Whether that assumption survives reinforcement learning has not been tested directly: existing causal analyses of latent reasoning are confined to math and logic tasks, and compare a model's reliance on its thoughts within a single checkpoint, never before and after an RL stage. We train a chess-playing model through a staged latent-reasoning curriculum followed by reinforcement learning, and find legality climbs monotonically to 61% (from a 48% pre-RL baseline) while checkmate confabulation is eliminated entir
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית