כתבה
arXiv cs.LG ·
Phases in a class of associative memories via hidden neurons
תקציר מקורי באנגליתarXiv:2609.10976v1 Announce Type: new Abstract: Associative memory in the Hopfield network is attractor dynamics in a disordered many-body system, and higher-order and exponential extensions turn its retrieval update into softmax attention. The polynomial and exponential regimes have been analyzed by different methods, with no common architecture in which to ask what fixes the storage scale. In this paper we study the bipartite architecture of Krotov and Hopfield, which we call the class $H$, whose model is fixed by a Lagrangian for each layer, taking the hidden neurons as the order parameter of retrieval. At polynomial load the replica method yields the replica-symmetric phase diagrams and closed-form capacities, and the crosstalk moment is common to Ising and spherical visible neurons, s
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית