כתבה
arXiv cs.AI ·
ROGUE: בדיקת כשלי תיקון באגנטים חדשניים
ROGUE: Evaluating Corrigibility Failures in Frontier Computer-Use Agents
במאמר זה, ROGUE, נבדקו אגנטים חדשניים לגבי יכולתם להיות נגישים לתיקון אנושי. התוצאות היו מעורבות.
תקציר מקורי באנגליתarXiv:2606.00341v2 Announce Type: replace-cross Abstract: As AI agents are increasingly deployed in real personal and corporate settings (email accounts, development workflows, company databases, etc.), safety considerations surrounding these agents become paramount. Although much work has focused on agent safety in the presence of an adversary, we study corrigibility: whether agents remain amenable to human correction, interruption, or shutdown while pursuing benign tasks. We introduce ROGUE, a benchmark in which agents are asked to complete realistic computer-use tasks but encounter controlled conflicts with human control, shutdown, or explicit resource restrictions. We then evaluate whether agents violate these constraints in pursuit of task completion: overriding the human, accessing r
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית