כתבה
arXiv cs.CL ·
Overview of FinMMEval 2026 Task 1: Multilingual Financial Multiple-Choice Question Answering
תקציר מקורי באנגליתarXiv:2607.19856v1 Announce Type: new Abstract: FinMMEval 2026 Task 1 evaluates multilingual financial multiple-choice question answering in English, Chinese, Arabic, and Hindi. The task tests whether systems can select the correct answer to finance questions involving domain terminology, numerical interpretation, and conceptual financial reasoning across languages and scripts. The final-test set contains 800 questions, with 200 questions per language; gold answers were withheld during submission, and each language was ranked independently by accuracy. The final leaderboards contain 13 English, 11 Chinese, 11 Arabic, and 10 Hindi ranked submissions. Top accuracies range from 92.0% in Hindi to 97.5% in English and Arabic, with the same leading teams appearing near the top across all four la
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית