כתבה
arXiv cs.CL ·
SiDiaC-v.2.0: קורפוס דיאכרוני סינהלה גרסה 2.0
SiDiaC-v.2.0: Sinhala Diachronic Corpus Version 2.0
קורפוס דיאכרוני סינהלה גדול ומקיף ביותר, כולל 229,000 מילים מ-185 יצירות ספרותיות.
תקציר מקורי באנגליתarXiv:2603.10861v2 Announce Type: replace Abstract: SiDiaC-v.2.0 is the largest comprehensive Sinhala Diachronic Corpus to date, covering a period from 1800 CE to 1955 CE in terms of publication dates, and a historical span from the 5th to the 20th century CE in terms of written dates. The corpus consists of 229k words across 185 literary works that underwent thorough filtering, preprocessing, and copyright compliance checks, followed by extensive post-processing. Additionally, a subset of 59 documents totalling 65k words was annotated based on their written dates. Texts from the National Library of Sri Lanka were selected from the SiDiaC-v.1.0 non-filtered list, which was digitised using Google Document AI OCR. This was followed by post-processing to correct formatting issues, address cod
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית