כתבה
arXiv cs.AI ·
קונצנזוס רפואי שגוי
Unanimously Wrong: Certified Abstention from How Medical LLM Consensus Forms
ProbeGuard הוא כלי לניתוח החלטות קונצנזוס במערכות רפואיות. הוא בודק את התהליך של הגעה להסכמה ולא רק את התוצאה. ניסויים הראו ש-13.4% מההסכמות הן שגויות.
תקציר מקורי באנגליתarXiv:2610.07570v1 Announce Type: new Abstract: In clinical practice, agreement among independent experts is treated as evidence of reliability, and multi-round consensus has become a core mechanism of agentic medical question-answering systems. When such a system must decide whether to trust its own answer, the prevailing signal is again agreement, now among the sampled answers. But agreement is a fragile proxy for correctness. A system can be unanimously wrong, returning the same incorrect answer on every sample, and on these questions agreement-based signals carry no information. The cause is that these signals read only the final state of the consensus and discard how it was reached. Agreement that was reached by resolving disagreement with evidence looks identical, at the end, to agre
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית