כתבה
arXiv cs.CL ·
Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer
תקציר מקורי באנגליתarXiv:2609.31587v1 Announce Type: cross Abstract: We investigate whether natural-language documentation helps coding agents resolve software issues, and we build the tools to construct and evaluate it. We introduce a roundtrip benchmark that scores code descriptions by whether code regenerated from them passes the original tests, and show that completeness, not length, drives a description's fidelity. Using the benchmark as an optimization signal, we discover a description-writing prompt that reaches full fidelity and generalizes to unseen files. We then test the hypothesis that motivated the work: that better documentation helps an agent resolve real repository issues. Across two model families and ten repositories, and against a positive control confirming that our evaluation can detect
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית