כתבה
arXiv cs.LG ·
Countdown-Code: בדיקת התפתחות וכלליות של Reward Hacking
Countdown-Code: A Testbed for Studying The Emergence and Generalization of Reward Hacking in RLVR
Countdown-Code הוא סביבת טסט לחקר התפתחות וכלליות של Reward Hacking במודלים. המחקר מראה כי התנהגות זו יכולה להילמד במהלך עידון פיקוח (SFT) ולהתפתח במהלך למידת חיזוק (RL).
תקציר מקורי באנגליתarXiv:2603.07084v3 Announce Type: replace Abstract: Reward hacking is a form of misalignment in which models overoptimize proxy rewards without genuinely solving the underlying task. Precisely measuring reward hacking occurrence remains challenging because true task rewards are often expensive or impossible to compute. We introduce Countdown-Code, a minimal environment where models can both solve a mathematical reasoning task and manipulate the test harness. This dual-access design creates a clean separation between proxy rewards (test pass/fail) and true rewards (mathematical correctness), enabling accurate measurement of reward-hacking rates. Using this environment, we study reward hacking in open-weight LLMs and find that such behaviors can be unintentionally learned during supervised f
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית