יום רביעי, 7 באוקטובר 2026 LIVE
AI־INFO

כתבה arXiv cs.CL ·

השברת המראה: הפחתת העדפה-עצמית במדדי השוואה של LLM

Breaking the Mirror: Activation-Based Mitigation of Self-Preference in LLM Evaluators
מדדי השוואה של LLM סובלים מעדפה-עצמית, שאותה ניתן להפחית באמצעות וקטורי הנחיה.
תקציר מקורי באנגליתarXiv:2509.03647v3 Announce Type: replace Abstract: Large language models (LLMs) increasingly serve as automated evaluators, yet they suffer from "self-preference bias": a tendency to favor their own outputs over those of other models. This bias undermines fairness and reliability in evaluation pipelines, particularly for tasks like preference tuning and model routing. We investigate whether lightweight steering vectors can mitigate this problem at inference time without retraining. We introduce a curated dataset that distinguishes self-preference bias into justified examples of self-preference and unjustified examples of self-preference, and we construct steering vectors using two methods: Contrastive Activation Addition (CAA) and an optimization-based approach. Our results show that stee
קרא במקור המקורי