הפשטת LLM, אל תשמש: חיפוש ואישור ב-DoorDash — Raghav Saboo, DoorDash

תקציר מקורי באנגליתSearch for gluten-free pasta and a ranker trained on engagement may show you regular spaghetti, because it sells well. Raghav Saboo, Staff ML Engineer and Tech Lead for Search & Personalization at DoorDash, argues that the real bottleneck in marketplace discovery is semantic understanding, not engagement. As DoorDash grows into grocery, retail, pets and gifting across billions of store-level items, it uses LLMs to understand what items mean and what shoppers actually intend. His core pattern: do the expensive LLM reasoning once, offline, and then distill it into small, fast models for serving. He covers four building blocks. The first is LLM-generated relevance labels, which improved retrieval NDCG by 2.3%. The second is semantic IDs, a learned taxonomy of the catalog that raised ranking M