כתבה
arXiv cs.LG ·
When Does Activation Steering Change What a Model Computes From?
תקציר מקורי באנגליתarXiv:2606.29522v2 Announce Type: replace Abstract: Activation steering can reliably change an agent's output by modifying its internal activations. Yet arriving at the same answer need not involve the same computation: behavioral equivalence does not imply mechanistic equivalence. We test whether an activation edit changes the state used in subsequent computation or biases that computation toward the desired output. In a controlled state-tracking task, trace supervision creates an editable register: changing its internal value makes the model apply the next operation to the edited state. We next ask whether widely used mean activation steering admits a similar interpretation: does steering recreate the internal configuration the model naturally uses when performing a task? If so, transpla
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית