כתבה
arXiv cs.LG ·
KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systems
תקציר מקורי באנגליתarXiv:2609.34060v2 Announce Type: replace Abstract: Prompt-specialized multi-agent systems enable multiple agents to share a model while performing complementary roles to solve complex tasks. However, agent-specific prefixes change the KV cache generated for the same shared context, causing each agent to repeatedly prefill the growing context and construct a separate cache with high computation and memory overhead. Selective recomputation reduces this redundancy but still retains substantial model execution, while existing delta correction methods either support only recurring context relations or maintain memory-intensive online correction states for dynamically changing context. For first seen shared context, these methods also construct a reference cache outside the agent workflow, and
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית