התאמה גאומטרית-מודעת-בייסיאן של פרמטרים-קצר-זמן-למידה על המניפולד שטיפל באמצעות Stein Variational Gradient Descent

תקציר מקורי באנגליתarXiv:2609.08354v1 Announce Type: new Abstract: Several geometry-aware approaches to low-rank adaptation have emerged for parameter-efficient fine-tuning of large pre-trained models. These methods aim to take full advantage of the geometric structure of low-rank manifolds for improving the efficiency in subspace utilization and reducing redundancy by enforcing orthogonality constraints during optimization. The strong empirical results of these techniques have motivated further study into whether predictions from such geometry-based adaptation methods could be overconfident. In this paper, we build on the singular value decomposition factorization of adapters to develop a framework based on Stein variational gradient descent (SVGD). In this formulation, the low-rank matrices are transported