כתבה
arXiv cs.LG ·
הפעלות ספקטרליות רלוונטיות
Learnable Spectral Activations
הפעלות ספקטרליות רלוונטיות: פיצול יעיל של תדרים לשיפור אופטימיזציה של רשתות עצביות.
תקציר מקורי באנגליתarXiv:2610.07419v1 Announce Type: new Abstract: Implicit neural representations (INRs) are shaped by the spectral structure induced by their input encodings and activation functions. Existing methods improve fitting primarily by modifying which frequencies are available to the network, through coordinate encodings or periodic nonlinearities. However, frequency access is not the only bottleneck: signals with localized or spatially varying structure require the network to efficiently compose frequencies into multi-harmonic internal responses. We introduce learnable spectral activations (LSA), which replace fixed neuron-level nonlinearities with a residual truncated Fourier series whose harmonic amplitudes are learned during training. LSA does not expand the asymptotic function class. Instead
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית