פיצול פרמטרים: פיצול פרמטרים סקאלאבילי שנתמך על ידי מרחב הפעולה

תקציר מקורי באנגליתarXiv:2609.37731v2 Announce Type: replace Abstract: Activation space and parameter space provide complementary views of model computation. Activations represent information, while weights read, transform, and write that information. Yet existing interpretability methods largely study the two spaces separately, leaving the connection between represented information and parameter-level computation underexplored. We introduce Activation-Supported Parameter Decomposition (ASPD), which jointly decomposes activation and parameter spaces and grounds each learned weight component in the activation features it reads or writes. This grounding constrains otherwise non-unique parameter decompositions using the model's internal activations, while an internal reconstruction objective provides a local le