Your LLM App Returned 200 OK. It Was Still Wrong. — Marina Petzel, Datadog

תקציר מקורי באנגליתLatency, errors, traffic and saturation tell you your app is up. They don't tell you if it's right. Marina Petzel, GenAI advocate at Datadog, explains why the classic golden signals are necessary but no longer enough for generative AI applications, and which metrics to add on top. She covers cost monitoring (token creep, model drift, uncached calls and tagging for cost attribution), safety monitoring (prompt injection, PII leakage, toxicity and jailbreaks) and quality monitoring (hallucination rate, relevance, user satisfaction, completeness and RAG retrieval quality). In this talk: • Four ways GenAI apps break traditional monitoring assumptions • Three hidden cost drivers and a four-level tagging strategy • Safety metrics and the thresholds to aim for • Five quality metrics, from hallucin