Copertina

TextGram: Towards a better domain-adaptive pretraining

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hiwarkhedkar, Sharayu, Mittal, Saloni, Magdum, Vidula, Dhekane, Omkar, Joshi, Raviraj, Kale, Geetanjali, Ladkat, Arnav
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi
di: Mittal, Saloni, et al.
Pubblicazione: (2024)

Long Range Named Entity Recognition for Marathi Documents
di: Deshmukh, Pranita, et al.
Pubblicazione: (2024)

On Importance of Pruning and Distillation for Efficient Low Resource NLP
di: Mirashi, Aishwarya, et al.
Pubblicazione: (2024)

On Importance of Code-Mixed Embeddings for Hate Speech Identification
di: Jagdale, Shruti, et al.
Pubblicazione: (2024)

Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning
di: Khade, Omkar, et al.
Pubblicazione: (2024)

Towards Building Efficient Sentence BERT Models using Layer Pruning
di: Shelke, Anushka, et al.
Pubblicazione: (2024)

L3Cube-MahaEmotions: A Marathi Emotion Recognition Dataset with Synthetic Annotations using CoTR prompting and Large Language Models
di: Kowtal, Nidhi, et al.
Pubblicazione: (2025)

Topic Modeling in Marathi
di: Shinde, Sanket, et al.
Pubblicazione: (2025)

Universal Cross-Lingual Text Classification
di: Savant, Riya, et al.
Pubblicazione: (2024)

L3Cube-MahaSTS: A Marathi Sentence Similarity Dataset and Models
di: Mirashi, Aishwarya, et al.
Pubblicazione: (2025)

Curating Stopwords in Marathi: A TF-IDF Approach for Improved Text Analysis and Information Retrieval
di: Chavan, Rohan, et al.
Pubblicazione: (2024)

Non-Contextual BERT or FastText? A Comparative Analysis
di: Shanbhag, Abhay, et al.
Pubblicazione: (2024)

Leveraging Parameter Efficient Training Methods for Low Resource Text Classification: A Case Study in Marathi
di: Deshmukh, Pranita, et al.
Pubblicazione: (2024)

Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages
di: Deshpande, Tejas, et al.
Pubblicazione: (2024)

A Data Selection Approach for Enhancing Low Resource Machine Translation Using Cross-Lingual Sentence Representations
di: Kowtal, Nidhi, et al.
Pubblicazione: (2024)

L3Cube-MahaSum: A Comprehensive Dataset and BART Models for Abstractive Text Summarization in Marathi
di: Deshmukh, Pranita, et al.
Pubblicazione: (2024)

L3Cube-IndicNews: News-based Short Text and Long Document Classification Datasets in Indic Languages
di: Mirashi, Aishwarya, et al.
Pubblicazione: (2024)

Multilingual Open QA on the MIA Shared Task
di: Yarrabelly, Navya, et al.
Pubblicazione: (2025)

Self-Improving Pretraining: using post-trained models to pretrain better models
di: Tan, Ellen Xiaoqing, et al.
Pubblicazione: (2026)

Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languages
di: Rohera, Pritika, et al.
Pubblicazione: (2025)

Improving the Efficiency of Long Document Classification using Sentence Ranking Approach
di: Kokate, Prathamesh, et al.
Pubblicazione: (2025)

MahaParaphrase: A Marathi Paraphrase Detection Corpus and BERT-based Models
di: Jadhav, Suramya, et al.
Pubblicazione: (2025)

Evaluating the fairness of task-adaptive pretraining on unlabeled test data before few-shot text classification
di: Dubey, Kush
Pubblicazione: (2024)

Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognition
di: Shirke, Mayur, et al.
Pubblicazione: (2025)

On Limitations of LLM as Annotator for Low Resource Languages
di: Jadhav, Suramya, et al.
Pubblicazione: (2024)

IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic Languages
di: Endait, Sharvi, et al.
Pubblicazione: (2025)

On Importance of Layer Pruning for Smaller BERT Models and Low Resource Languages
di: Shirke, Mayur, et al.
Pubblicazione: (2025)

Efficient Zero-Shot Long Document Classification by Reducing Context Through Sentence Ranking
di: Kokate, Prathamesh, et al.
Pubblicazione: (2025)

L3Cube-IndicHeadline-ID: A Dataset for Headline Identification and Semantic Evaluation in Low-Resource Indian Languages
di: Tanksale, Nishant, et al.
Pubblicazione: (2025)

L3Cube-MahaSocialNER: A Social Media based Marathi NER Dataset and BERT models
di: Chaudhari, Harsh, et al.
Pubblicazione: (2023)

MahaSQuAD: Bridging Linguistic Divides in Marathi Question-Answering
di: Ghatage, Ruturaj, et al.
Pubblicazione: (2024)

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context
di: Rohera, Pritika, et al.
Pubblicazione: (2024)

Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages
di: Vaidya, Aatman, et al.
Pubblicazione: (2024)

Synthetic continued pretraining
di: Yang, Zitong, et al.
Pubblicazione: (2024)

Multi-Reference Preference Optimization for Large Language Models
di: Le, Hung, et al.
Pubblicazione: (2024)

A Fuzzy Evaluation of Sentence Encoders on Grooming Risk Classification
di: Bihani, Geetanjali, et al.
Pubblicazione: (2025)

The Reliability Paradox: Exploring How Shortcut Learning Undermines Language Model Calibration
di: Bihani, Geetanjali, et al.
Pubblicazione: (2024)

CultureGuard: Towards Culturally-Aware Dataset and Guard Model for Multilingual Safety Applications
di: Joshi, Raviraj, et al.
Pubblicazione: (2025)

Learning Shortcuts: On the Misleading Promise of NLU in Language Models
di: Bihani, Geetanjali, et al.
Pubblicazione: (2024)

Aligning Large Language Models to Low-Resource Languages through LLM-Based Selective Translation: A Systematic Study
di: Paul, Rakesh, et al.
Pubblicazione: (2025)