כתבה
arXiv cs.LG ·
Gradient-Free Training of Spiking Neural Networks via Low-Rank Evolution Strategies
תקציר מקורי באנגליתarXiv:2605.30361v2 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) offer compelling energy efficiency on neuromorphic hardware, yet their training remains challenging because the discrete spike threshold is non-differentiable. Surrogate-gradient methods sidestep this by approximating the derivative, but they impose backpropagation infrastructure that is incompatible with on-chip learning. Evolution Strategies (\es) are a natural gradient-free alternative, yet their computational cost scales with the number of parameters, making them impractical for large weight matrices. We present a method for training SNNs using EGGROLL, a low-rank factorisation of ES perturbations that reduces per-generation memory from $\mathcal{O}(mn)$ to $\mathcal{O}(r(m{+}n))$. Combining EGGROL
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית