כתבה
arXiv cs.LG ·
Parameter-Free Dynamic Regret for Online Convex Optimization under Heavy-Tailed Noise
תקציר מקורי באנגליתarXiv:2607.27073v1 Announce Type: new Abstract: We study online convex optimization (OCO) in non-stationary environments under heavy-tailed noise, where the stochastic gradient oracle admits only a finite $p$-th central moment for some $p \in (1, 2]$. While static regret is well-understood, achieving universal dynamic regret in a parameter-free manner remains an open challenge. We resolve this by proposing \textbf{HT-PAder}, a parameter-free algorithm combining restarted AdaGrad experts over a geometric pool of block lengths with a pathwise meta-algorithm, \textbf{AdaGrad-Hedge}, which requires no moment conditions on meta-losses. For a domain of diameter $D$, Lipschitz constant $G$, noise level $\sigma$, and comparator path length $P_T$, HT-PAder achieves an expected universal dynamic reg
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית