ראיית דיבור: למידת דינמיקות ארטיקולטוריות נראות להנחיית תנועה 3D של פנים לפי דיבור

תקציר מקורי באנגליתarXiv:2609.30517v1 Announce Type: cross Abstract: Recent progress in speech-driven 3D facial animation has improved vertex-level reconstruction quality, but speech-consistent visible articulation remains difficult. This is because speech production follows structured and constrained articulators' coordination and the mapping from acoustics to motion is inherently one-to-many. Motivated by the structured patterns of visible articulation, we propose a novel articulation-aware framework that models visible speech through directional articulatory motions and composes them into surface-consistent 3D facial motion. To represent visible articulation with three directional articulatory motions, spreading, opening, and protrusion, we propose a Speech--Articulatory Memory (SAM) that captures the cor