Paramanu: Compact and Competitive Monolingual Language Models for Low-Resource Morphologically Rich Indian Languages
Fuente:
arXiv
Saved in:
| Main Authors: | Niyogi, Mitodru, Gaussier, Eric, Bhattacharya, Arnab |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Ayn: A Tiny yet Competitive Indian Legal Language Model Pretrained from Scratch
by: Niyogi, Mitodru, et al.
Published: (2024)
by: Niyogi, Mitodru, et al.
Published: (2024)
PARAMANU-GANITA: Can Small Math Language Models Rival with Large Language Models on Mathematical Reasoning?
by: Niyogi, Mitodru, et al.
Published: (2024)
by: Niyogi, Mitodru, et al.
Published: (2024)
Neural Models for Source Code Synthesis and Completion
by: Niyogi, Mitodru
Published: (2024)
by: Niyogi, Mitodru
Published: (2024)
BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages
by: Maji, Subhadip, et al.
Published: (2026)
by: Maji, Subhadip, et al.
Published: (2026)
UrduLM: A Resource-Efficient Monolingual Urdu Language Model
by: Ali, Syed Muhammad, et al.
Published: (2026)
by: Ali, Syed Muhammad, et al.
Published: (2026)
Evaluating Modern Large Language Models on Low-Resource and Morphologically Rich Languages:A Cross-Lingual Benchmark Across Cantonese, Japanese, and Turkish
by: Xia, Chengxuan, et al.
Published: (2025)
by: Xia, Chengxuan, et al.
Published: (2025)
Introducing cosmosGPT: Monolingual Training for Turkish Language Models
by: Kesgin, H. Toprak, et al.
Published: (2024)
by: Kesgin, H. Toprak, et al.
Published: (2024)
Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models
by: Zhao, Zhixue, et al.
Published: (2024)
by: Zhao, Zhixue, et al.
Published: (2024)
Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning
by: Wei, Bin, et al.
Published: (2024)
by: Wei, Bin, et al.
Published: (2024)
H-Net++: Hierarchical Dynamic Chunking for Tokenizer-Free Language Modelling in Morphologically-Rich Languages
by: Zakershahrak, Mehrdad, et al.
Published: (2025)
by: Zakershahrak, Mehrdad, et al.
Published: (2025)
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages
by: Ruzzetti, Elena Sofia, et al.
Published: (2023)
by: Ruzzetti, Elena Sofia, et al.
Published: (2023)
UNITYAI-GUARD: Pioneering Toxicity Detection Across Low-Resource Indian Languages
by: Beniwal, Himanshu, et al.
Published: (2025)
by: Beniwal, Himanshu, et al.
Published: (2025)
Leveraging LLMs for Bangla Grammar Error Correction:Error Categorization, Synthetic Data, and Model Evaluation
by: Bhattacharyya, Pramit, et al.
Published: (2024)
by: Bhattacharyya, Pramit, et al.
Published: (2024)
Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
by: Mastrokostas, Charalampos, et al.
Published: (2026)
by: Mastrokostas, Charalampos, et al.
Published: (2026)
Bilingual Adaptation of Monolingual Foundation Models
by: Gosal, Gurpreet, et al.
Published: (2024)
by: Gosal, Gurpreet, et al.
Published: (2024)
Konkani LLM: Multi-Script Instruction Tuning and Evaluation for a Low-Resource Indian Language
by: Fernandes, Reuben Chagas, et al.
Published: (2026)
by: Fernandes, Reuben Chagas, et al.
Published: (2026)
Continual-learning for Modelling Low-Resource Languages from Large Language Models
by: K, Santosh Srinath, et al.
Published: (2026)
by: K, Santosh Srinath, et al.
Published: (2026)
IBPS: Indian Bail Prediction System
by: Srivastava, Puspesh Kumar, et al.
Published: (2025)
by: Srivastava, Puspesh Kumar, et al.
Published: (2025)
Unlocking the Potential of Model Merging for Low-Resource Languages
by: Tao, Mingxu, et al.
Published: (2024)
by: Tao, Mingxu, et al.
Published: (2024)
Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research
by: Zhong, Tianyang, et al.
Published: (2024)
by: Zhong, Tianyang, et al.
Published: (2024)
LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch
by: Pfister, Jan, et al.
Published: (2024)
by: Pfister, Jan, et al.
Published: (2024)
LangFIR: Discovering Sparse Language-Specific Features from Monolingual Data for Language Steering
by: Wong, Sing Hieng, et al.
Published: (2026)
by: Wong, Sing Hieng, et al.
Published: (2026)
Multimodal Large Language Models for Low-Resource Languages: A Case Study for Basque
by: Arana, Lukas, et al.
Published: (2025)
by: Arana, Lukas, et al.
Published: (2025)
A2TTS: TTS for Low Resource Indian Languages
by: Bhadoriya, Ayush Singh, et al.
Published: (2025)
by: Bhadoriya, Ayush Singh, et al.
Published: (2025)
NyayaAnumana & INLegalLlama: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision Analysis
by: Nigam, Shubham Kumar, et al.
Published: (2024)
by: Nigam, Shubham Kumar, et al.
Published: (2024)
Towards Better Monolingual Japanese Retrievers with Multi-Vector Models
by: Clavié, Benjamin
Published: (2023)
by: Clavié, Benjamin
Published: (2023)
Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation
by: Shandilya, Bhargav, et al.
Published: (2024)
by: Shandilya, Bhargav, et al.
Published: (2024)
Overview of the First Workshop on Language Models for Low-Resource Languages (LoResLM 2025)
by: Hettiarachchi, Hansi, et al.
Published: (2024)
by: Hettiarachchi, Hansi, et al.
Published: (2024)
LlamaTurk: Adapting Open-Source Generative Large Language Models for Low-Resource Language
by: Toraman, Cagri
Published: (2024)
by: Toraman, Cagri
Published: (2024)
Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review
by: McGiff, Josh, et al.
Published: (2025)
by: McGiff, Josh, et al.
Published: (2025)
Kakugo: Distillation of Low-Resource Languages into Small Language Models
by: Devine, Peter, et al.
Published: (2026)
by: Devine, Peter, et al.
Published: (2026)
Transformers for Low-Resource Languages: Is Féidir Linn!
by: Lankford, Séamus, et al.
Published: (2024)
by: Lankford, Séamus, et al.
Published: (2024)
Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation
by: Shu, Peng, et al.
Published: (2024)
by: Shu, Peng, et al.
Published: (2024)
LLMs for Translation: Historical, Low-Resourced Languages and Contemporary AI Models
by: Tekgurler, Merve
Published: (2025)
by: Tekgurler, Merve
Published: (2025)
Shona spaCy: A Morphological Analyzer for an Under-Resourced Bantu Language
by: Masoka, Happymore
Published: (2025)
by: Masoka, Happymore
Published: (2025)
One Instruction Does Not Fit All: How Well Do Embeddings Align Personas and Instructions in Low-Resource Indian Languages?
by: Shah, Arya, et al.
Published: (2026)
by: Shah, Arya, et al.
Published: (2026)
adaptMLLM: Fine-Tuning Multilingual Language Models on Low-Resource Languages with Integrated LLM Playgrounds
by: Lankford, Séamus, et al.
Published: (2024)
by: Lankford, Séamus, et al.
Published: (2024)
Distilling Monolingual and Crosslingual Word-in-Context Representations
by: Arase, Yuki, et al.
Published: (2024)
by: Arase, Yuki, et al.
Published: (2024)
Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models
by: Nigam, Shubham Kumar, et al.
Published: (2024)
by: Nigam, Shubham Kumar, et al.
Published: (2024)
VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models
by: Liu, Chonghan, et al.
Published: (2026)
by: Liu, Chonghan, et al.
Published: (2026)
Similar Items
-
Ayn: A Tiny yet Competitive Indian Legal Language Model Pretrained from Scratch
by: Niyogi, Mitodru, et al.
Published: (2024) -
PARAMANU-GANITA: Can Small Math Language Models Rival with Large Language Models on Mathematical Reasoning?
by: Niyogi, Mitodru, et al.
Published: (2024) -
Neural Models for Source Code Synthesis and Completion
by: Niyogi, Mitodru
Published: (2024) -
BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages
by: Maji, Subhadip, et al.
Published: (2026) -
UrduLM: A Resource-Efficient Monolingual Urdu Language Model
by: Ali, Syed Muhammad, et al.
Published: (2026)