כתבה
arXiv cs.AI ·
EgoBench: An Interactive Egocentric Multimodal Benchmark for Tool-Using Agents
תקציר מקורי באנגליתarXiv:2605.27820v2 Announce Type: replace Abstract: As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to jointly evaluate these capabilities due to challenges in designing strictly coupled multi-capability tasks, simulating natural and task-constrained user feedback, and ensuring objective evaluation of dynamic interaction. To bridge this gap, we introduce EgoBench, the first interactive multimodal benchmark for tool-using agents. EgoBench comprises 1,590 egocentric-video-grounded tasks covering five daily scenarios, along with a user-agent-tool interactive environment for evaluation. We implement a three-sta
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית