Krutrim LLM: Multilingual Foundational Model for over a Billion People
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915169264730112 |
|---|---|
| author | Kallappa, Aditya Kamble, Palash Ravi, Abhinav Patidar, Akshat Dhruv, Vinayak Kumar, Deepak Awasthi, Raghav Manjunath, Arveti Gupta, Himanshu Agarwal, Shubham Ashish, Kumar Bhargava, Gautam Khatri, Chandra |
| author_facet | Kallappa, Aditya Kamble, Palash Ravi, Abhinav Patidar, Akshat Dhruv, Vinayak Kumar, Deepak Awasthi, Raghav Manjunath, Arveti Gupta, Himanshu Agarwal, Shubham Ashish, Kumar Bhargava, Gautam Khatri, Chandra |
| contents | India is a diverse society with unique challenges in developing AI systems, including linguistic diversity, oral traditions, data accessibility, and scalability. Existing foundation models are primarily trained on English, limiting their effectiveness for India's population. Indic languages comprise only 1 percent of Common Crawl corpora despite India representing 18 percent of the global population, leading to linguistic biases. Thousands of regional languages, dialects, and code mixing create additional representation challenges due to sparse training data.
We introduce Krutrim LLM, a 2 trillion token multilingual model designed for India's linguistic landscape. It incorporates the largest known Indic dataset, mitigating data scarcity and ensuring balanced performance across dialects. Krutrim outperforms or matches state-of-the-art models on Indic benchmarks while maintaining competitive English performance. Despite being significantly smaller in training flops, Krutrim LLM matches or exceeds models like LLAMA-2 on 10 out of 16 tasks, with an average score of 0.57 versus 0.55. This evidences Krutrim's flexible multilingual fluency across diverse linguistic contexts.
Krutrim is integrated with real-time search to improve factual accuracy in conversational AI applications. This enhances accessibility for over 1 billion users worldwide. Through intentional design choices addressing data imbalances, Krutrim LLM signifies meaningful progress in building ethical, globally representative AI models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_09642 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Krutrim LLM: Multilingual Foundational Model for over a Billion People Kallappa, Aditya Kamble, Palash Ravi, Abhinav Patidar, Akshat Dhruv, Vinayak Kumar, Deepak Awasthi, Raghav Manjunath, Arveti Gupta, Himanshu Agarwal, Shubham Ashish, Kumar Bhargava, Gautam Khatri, Chandra Computation and Language Artificial Intelligence India is a diverse society with unique challenges in developing AI systems, including linguistic diversity, oral traditions, data accessibility, and scalability. Existing foundation models are primarily trained on English, limiting their effectiveness for India's population. Indic languages comprise only 1 percent of Common Crawl corpora despite India representing 18 percent of the global population, leading to linguistic biases. Thousands of regional languages, dialects, and code mixing create additional representation challenges due to sparse training data. We introduce Krutrim LLM, a 2 trillion token multilingual model designed for India's linguistic landscape. It incorporates the largest known Indic dataset, mitigating data scarcity and ensuring balanced performance across dialects. Krutrim outperforms or matches state-of-the-art models on Indic benchmarks while maintaining competitive English performance. Despite being significantly smaller in training flops, Krutrim LLM matches or exceeds models like LLAMA-2 on 10 out of 16 tasks, with an average score of 0.57 versus 0.55. This evidences Krutrim's flexible multilingual fluency across diverse linguistic contexts. Krutrim is integrated with real-time search to improve factual accuracy in conversational AI applications. This enhances accessibility for over 1 billion users worldwide. Through intentional design choices addressing data imbalances, Krutrim LLM signifies meaningful progress in building ethical, globally representative AI models. |
| title | Krutrim LLM: Multilingual Foundational Model for over a Billion People |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2502.09642 |