Cover Image

Language Model Adaptation to Specialized Domains through Selective Masking based on Genre and Topical Characteristics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Belfathi, Anas, Gallina, Ygor, Hernandez, Nicolas, Dufour, Richard, Monceaux, Laura
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Semantic Reranking at Inference Time for Hard Examples in Rhetorical Role Labeling
by: Belfathi, Anas, et al.
Published: (2026)

Coupling Local Context and Global Semantic Prototypes via a Hierarchical Architecture for Rhetorical Roles Labeling
by: Belfathi, Anas, et al.
Published: (2026)

Understanding Cross-Domain Adaptation in Low-Resource Topic Modeling
by: Akash, Pritom Saha, et al.
Published: (2025)

How Important Is Tokenization in French Medical Masked Language Models?
by: Labrak, Yanis, et al.
Published: (2024)

Compressing Language Models for Specialized Domains
by: Williams, Miles, et al.
Published: (2025)

CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisions
by: Jourdan, Leane, et al.
Published: (2024)

Text revision in Scientific Writing Assistance: An Overview
by: Jourdan, Léane, et al.
Published: (2023)

Identifying Reliable Evaluation Metrics for Scientific Text Revision
by: Jourdan, Léane, et al.
Published: (2025)

AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization
by: Afzal, Anum, et al.
Published: (2024)

Source-Free Domain Adaptation for Question Answering with Masked Self-training
by: Yin, M., et al.
Published: (2022)

ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction
by: Jourdan, Léane, et al.
Published: (2025)

Personalized Topic Selection Model for Topic-Grounded Dialogue
by: Fan, Shixuan, et al.
Published: (2024)

TAMUSA-Chat: A Domain-Adapted Large Language Model Conversational System for Research and Responsible Deployment
by: Alsmadi, Izzat, et al.
Published: (2026)

Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition
by: Bañeras-Roux, Thibault, et al.
Published: (2026)

Separating Style from Substance: Enhancing Cross-Genre Authorship Attribution through Data Selection and Presentation
by: Fincke, Steven, et al.
Published: (2024)

The Role of Natural Language Processing Tasks in Automatic Literary Character Network Construction
by: Amalvy, Arthur, et al.
Published: (2024)

Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modelling
by: Mu, Yida, et al.
Published: (2024)

Persistent Homology of Topic Networks for the Prediction of Reader Curiosity
by: Hopp, Manuel D. S., et al.
Published: (2025)

Beyond Tokens in Language Models: Interpreting Activations through Text Genre Chunks
by: Benito-Rodriguez, Éloïse, et al.
Published: (2025)

MOSAIC: Masked Objective with Selective Adaptation for In-domain Contrastive Learning
by: Pavlova, Vera, et al.
Published: (2025)

TopicGPT: A Prompt-based Topic Modeling Framework
by: Pham, Chau Minh, et al.
Published: (2023)

Hierarchical Graph Topic Modeling with Topic Tree-based Transformer
by: Zhang, Delvin Ce, et al.
Published: (2025)

MaskLID: Code-Switching Language Identification through Iterative Masking
by: Kargaran, Amir Hossein, et al.
Published: (2024)

BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
by: Labrak, Yanis, et al.
Published: (2024)

Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification
by: Faye, Géraud, et al.
Published: (2026)

Domain-Adaptation through Synthetic Data: Fine-Tuning Large Language Models for German Law
by: Bashir, Ali Hamza, et al.
Published: (2026)

Optimal Splitting of Language Models from Mixtures to Specialized Domains
by: Seto, Skyler, et al.
Published: (2026)

ESNLIR: A Spanish Multi-Genre Dataset with Causal Relationships
by: Portela, Johan R., et al.
Published: (2025)

SPILL: Domain-Adaptive Intent Clustering based on Selection and Pooling with Large Language Models
by: Lin, I-Fan, et al.
Published: (2025)

Automated Genre-Aware Article Scoring and Feedback Using Large Language Models
by: Wang, Chihang, et al.
Published: (2024)

An Empirical Analysis of Discrete Unit Representations in Speech Language Modeling Pre-training
by: Labrak, Yanis, et al.
Published: (2025)

Towards Transparency: Exploring LLM Trainings Datasets through Visual Topic Modeling and Semantic Frame
by: de Dampierre, Charles, et al.
Published: (2024)

A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks
by: Labrak, Yanis, et al.
Published: (2023)

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks
by: Loureiro, Manuel V., et al.
Published: (2023)

Improving Domain Adaptation through Extended-Text Reading Comprehension
by: Jiang, Ting, et al.
Published: (2024)

Fin-PRM: A Domain-Specialized Process Reward Model for Financial Reasoning in Large Language Models
by: Zhu, Jie, et al.
Published: (2025)

Neural Topic Modeling with Large Language Models in the Loop
by: Yang, Xiaohao, et al.
Published: (2024)

Comprehensive Evaluation of Large Language Models for Topic Modeling
by: Doi, Tomoki, et al.
Published: (2024)

Efficient Terminology Integration for LLM-based Translation in Specialized Domains
by: Kim, Sejoon, et al.
Published: (2024)

Enhancing Financial Domain Adaptation of Language Models via Model Augmentation
by: Tanabe, Kota, et al.
Published: (2024)