Copertina

Rethinking Data Curation in LLM Training: Online Reweighting Offers Better Generalization than Offline Methods

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhao, Wanru, Chen, Yihong, Tang, Yuzhi, Ma, Wentao, Hu, Shengchao, Hu, Shell Xu, Iacob, Alex, Mehrotra, Abhinav, Lane, Nicholas D.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

CLUES: Collaborative High-Quality Data Selection for LLMs via Training Dynamics
di: Zhao, Wanru, et al.
Pubblicazione: (2025)

Photon: Federated LLM Pre-Training
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

Energy-Based Preference Model Offers Better Offline Alignment than the Bradley-Terry Preference Model
di: Hong, Yuzhong, et al.
Pubblicazione: (2024)

Larger Scale Offers Better Security in the Nakamoto-style Blockchain
di: Hu, Junjie
Pubblicazione: (2025)

LLM Unlearning via Neural Activation Redirection
di: Shen, William F., et al.
Pubblicazione: (2025)

SparsyFed: Sparse Adaptive Federated Training
di: Guastella, Adriano, et al.
Pubblicazione: (2025)

Worldwide Federated Training of Language Models
di: Iacob, Alex, et al.
Pubblicazione: (2024)

Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization
di: Fan, Ziqing, et al.
Pubblicazione: (2024)

Advancing AI-assisted Hardware Design with Hierarchical Decentralized Training and Personalized Inference-Time Optimization
di: Chen, Hao Mark, et al.
Pubblicazione: (2025)

Prompt Tuning with Diffusion for Few-Shot Pre-trained Policy Generalization
di: Hu, Shengchao, et al.
Pubblicazione: (2024)

Rethinking the Role of Dynamic Sparse Training for Scalable Deep Reinforcement Learning
di: Ma, Guozheng, et al.
Pubblicazione: (2025)

Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
di: Sani, Lorenzo, et al.
Pubblicazione: (2023)

FedAnchor: Enhancing Federated Semi-Supervised Learning with Label Contrastive Loss for Unlabeled Clients
di: Qiu, Xinchi, et al.
Pubblicazione: (2024)

Breaking Physical and Linguistic Borders: Multilingual Federated Prompt Tuning for Low-Resource Languages
di: Zhao, Wanru, et al.
Pubblicazione: (2025)

Steppe productivity
di: Tang, Wanru
Pubblicazione: (2026)

Beyond Scaling: Agents Are Heading to the Edge
di: Tian, Chunlin, et al.
Pubblicazione: (2026)

Reward Difference Optimization For Sample Reweighting In Offline RLHF
di: Wang, Shiqi, et al.
Pubblicazione: (2024)

Solving Continual Offline RL through Selective Weights Activation on Aligned Spaces
di: Hu, Jifeng, et al.
Pubblicazione: (2024)

HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning
di: Hu, Shengchao, et al.
Pubblicazione: (2024)

The Future of Large Language Model Pre-training is Federated
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

Q-value Regularized Transformer for Offline Reinforcement Learning
di: Hu, Shengchao, et al.
Pubblicazione: (2024)

SkillBrew: Multi-Objective Curation of Skill Banks for LLM Agents
di: Hu, Wentao, et al.
Pubblicazione: (2026)

Analytic Energy-Guided Policy Optimization for Offline Reinforcement Learning
di: Hu, Jifeng, et al.
Pubblicazione: (2025)

Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning
di: Wang, Fangxin, et al.
Pubblicazione: (2026)

Noise Consistency Training: A Native Approach for One-Step Generator in Learning Additional Controls
di: Luo, Yihong, et al.
Pubblicazione: (2025)

China’s Gas Development Strategies
di: Shell Centre

Autoguided Online Data Curation for Diffusion Model Training
di: Pais, Valeria, et al.
Pubblicazione: (2025)

Online Pre-Training for Offline-to-Online Reinforcement Learning
di: Shin, Yongjae, et al.
Pubblicazione: (2025)

Task-Aware Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning
di: Fan, Ziqing, et al.
Pubblicazione: (2024)

Response-Conditioned Parallel-to-Sequential Orchestration for Multi-Agent Systems
di: Tastan, Nurbek, et al.
Pubblicazione: (2026)

Conservative Offline Robot Policy Learning via Posterior-Transition Reweighting
di: Zhang, Wanpeng, et al.
Pubblicazione: (2026)

Demystifying Diffusion Objectives: Reweighted Losses are Better Variational Bounds
di: Shi, Jiaxin, et al.
Pubblicazione: (2025)

Enhancing Data Quality in Federated Fine-Tuning of Foundation Models
di: Zhao, Wanru, et al.
Pubblicazione: (2024)

MarcoPolo: A Zero-Permission Attack for Location Type Inference from the Magnetic Field using Mobile Devices
di: Perez, Beatrice, et al.
Pubblicazione: (2026)

Robust Online Selection with Uncertain Offer Acceptance
di: Perez-Salazar, Sebastian, et al.
Pubblicazione: (2021)

Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning?
di: Dai, Yang, et al.
Pubblicazione: (2024)

Combatting Dimensional Collapse in LLM Pre-Training Data via Diversified File Selection
di: Fan, Ziqing, et al.
Pubblicazione: (2025)

Quaternionic Reweighted Amplitude Flow for Phase Retrieval in Image Reconstruction
di: Hu, Ren, et al.
Pubblicazione: (2025)

Bayesian Design Principles for Offline-to-Online Reinforcement Learning
di: Hu, Hao, et al.
Pubblicazione: (2024)

Meta Co-Training: Two Views are Better than One
di: Rothenberger, Jay C., et al.
Pubblicazione: (2023)