Copertina

From Macro to Micro: Probing Dataset Diversity in Language Model Fine-Tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Haoyu, Li, Xuhong, Dong, Yiming, Liu, Kun
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models
di: Bui, Nghia, et al.
Pubblicazione: (2025)

Micro-Macro Retrieval: Reducing Long-Form Hallucination in Large Language Models
di: Feng, Yujie, et al.
Pubblicazione: (2026)

Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment
di: Song, Feifan, et al.
Pubblicazione: (2024)

M-DaQ: Retrieving Samples with Multilingual Diversity and Quality for Instruction Fine-Tuning Datasets
di: Zhao, Chunguang, et al.
Pubblicazione: (2025)

The Effect of Language Diversity When Fine-Tuning Large Language Models for Translation
di: Stap, David, et al.
Pubblicazione: (2025)

From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Tasks
di: Ren, Qingyu, et al.
Pubblicazione: (2026)

Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification
di: Shui, Zeren, et al.
Pubblicazione: (2024)

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks
di: Luo, Ling, et al.
Pubblicazione: (2023)

GIFT: Guided Fine-Tuning and Transfer for Enhancing Instruction-Tuned Language Models
di: Ruan, Zhiwen, et al.
Pubblicazione: (2026)

The Granularity Axis: A Micro-to-Macro Latent Direction for Social Roles in Language Models
di: Qin, Chonghan, et al.
Pubblicazione: (2026)

Improving Linguistic Diversity of Large Language Models with Possibility Exploration Fine-Tuning
di: Mai, Long, et al.
Pubblicazione: (2024)

Enhancing Large Language Model Reasoning via Selective Critical Token Fine-Tuning
di: Ruan, Zhiwen, et al.
Pubblicazione: (2025)

SED-SFT: Selectively Encouraging Diversity in Supervised Fine-Tuning
di: Chen, Yijie, et al.
Pubblicazione: (2026)

LegiLM: A Fine-Tuned Legal Language Model for Data Compliance
di: Zhu, Linkai, et al.
Pubblicazione: (2024)

Safety-Aware Fine-Tuning of Large Language Models
di: Choi, Hyeong Kyu, et al.
Pubblicazione: (2024)

Tokenization Falling Short: On Subword Robustness in Large Language Models
di: Chai, Yekun, et al.
Pubblicazione: (2024)

Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
di: Xu, Qinwu, et al.
Pubblicazione: (2026)

Take the essence and discard the dross: A Rethinking on Data Selection for Fine-Tuning Large Language Models
di: Liu, Ziche, et al.
Pubblicazione: (2024)

Privacy-Preserving Parameter-Efficient Fine-Tuning for Large Language Model Services
di: Li, Yansong, et al.
Pubblicazione: (2023)

Gradual Learning: Optimizing Fine-Tuning with Partially Mastered Knowledge in Large Language Models
di: Li, Bozhou, et al.
Pubblicazione: (2024)

Fine-Tuning Language Models with Reward Learning on Policy
di: Lang, Hao, et al.
Pubblicazione: (2024)

HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
di: Peng, Qiwei, et al.
Pubblicazione: (2024)

FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Models
di: Gao, Yan, et al.
Pubblicazione: (2025)

Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding
di: Nguyen, Binh-Nguyen, et al.
Pubblicazione: (2025)

Natural Language Fine-Tuning
di: Liu, Jia, et al.
Pubblicazione: (2024)

HFT: Half Fine-Tuning for Large Language Models
di: Hui, Tingfeng, et al.
Pubblicazione: (2024)

Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models
di: Basem, Mohamed, et al.
Pubblicazione: (2024)

Synthetic Dataset Creation and Fine-Tuning of Transformer Models for Question Answering in Serbian
di: Cvetanović, Aleksa, et al.
Pubblicazione: (2024)

CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning
di: Yi, Biao, et al.
Pubblicazione: (2025)

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
di: Li, Dongyue, et al.
Pubblicazione: (2025)

Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
di: Ding, Yi, et al.
Pubblicazione: (2025)

NoveltyBench: Evaluating Language Models for Humanlike Diversity
di: Zhang, Yiming, et al.
Pubblicazione: (2025)

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning
di: Yang, Zhaorui, et al.
Pubblicazione: (2024)

Tuning Language Models for Robust Prediction of Diverse User Behaviors
di: Meng, Fanjin, et al.
Pubblicazione: (2025)

MVPBench: A Benchmark and Fine-Tuning Framework for Aligning Large Language Models with Diverse Human Values
di: Liang, Yao, et al.
Pubblicazione: (2025)

EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios
di: Xu, Bin, et al.
Pubblicazione: (2025)

Unified Defense for Large Language Models against Jailbreak and Fine-Tuning Attacks in Education
di: Yi, Xin, et al.
Pubblicazione: (2025)

Boosting Large Language Models with Mask Fine-Tuning
di: Zhang, Mingyuan, et al.
Pubblicazione: (2025)

SCHK-HTC: Sibling Contrastive Learning with Hierarchical Knowledge-Aware Prompt Tuning for Hierarchical Text Classification
di: Xiong, Ke, et al.
Pubblicazione: (2026)

Optimizing Psychological Counseling with Instruction-Tuned Large Language Models
di: Li, Wenjie, et al.
Pubblicazione: (2024)