L3Cube-MahaPOS: A Marathi Part-of-Speech Tagging Dataset and BERT Models
- lab CatalyzeX
- lab DagsHub
- lab Gotit.pub
- lab Hugging Face
- lab ScienceCast
- lab alphaXiv
- lab arXivLabs
Researchers have released L3Cube-MahaPOS, a gold-standard part-of-speech tagging dataset for Marathi containing 32,354 manually annotated sentences, alongside benchmarks for six model families [1][2]. Marathi is spoken by over 83 million people and ranks among the top twenty most spoken languages worldwide, yet it remains severely under-resourced in annotated corpora and standardised evaluation benchmarks [1][2]. The language presents distinct computational challenges, including rich morphology, relatively free word order, a lack of capitalisation conventions, and pervasive code-mixing with Hindi and English [1][2]. The L3Cube-MahaPOS corpus was annotated entirely by a team of Marathi-proficient annotators following a 16-tag Universal Dependencies-aligned scheme [1][2]. A structured preprocessing pipeline covering Unicode normalisation, Devanagari-aware tokenisation, and noise filtering was applied to ensure label consistency across all data splits [1][2]. The sentences were drawn from news text [1][2]. The researchers benchmarked the dataset across six model families: HMM, CRF, BiLSTM, BiLSTM+CharCNN, MuRIL, and the Marathi-specific transformer MahaBERT-v2 [1][2]. The best-performing system achieved 88.67% token-level accuracy and a macro-F1 of 81.67% over 15 evaluated tag classes [1][2]. Part-of-speech tagging is a foundational natural language processing task that underpins machine translation, information extraction, and syntactic parsing [1][2]. The release of the dataset, annotation guidelines, and trained model checkpoints is intended to foster further research in Marathi NLP [1][2].
research-papermodel-releasebenchmark
Background sources we checked (6)
- arxiv.org ↗ Part-of-Speech (POS) tagging is a foundational NLP task underpinning machine translation, information extraction, and syntactic parsing. Despite Marathi being spoken by over 83 million people and ranking among the top twenty most spoken languages worldwide, it remains severely un…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- arxiv.org ↗ With the creation of new datasets, the question arises of whether the data in them is complementary to other datasets for training ML models (see recent reviews for a perspective of catalysts informatics22, 23, 24). This is especially important when consolidating data with a vari…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
- en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…
Sources
- export.arxiv.org — L3Cube-MahaPOS: A Marathi Part-of-Speech Tagging Dataset and BERT Models ↗