Copertina

Adaptive Optimization for Enhanced Efficiency in Large-Scale Language Model Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Jiajing, Liu, Bingying, Liao, Xiaoxuan, Gao, Jia, Zheng, Hongye, Li, Yue
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models
di: Qi, Zhen, et al.
Pubblicazione: (2024)

Optimizing Large Language Models with an Enhanced LoRA Fine-Tuning Algorithm for Efficiency and Robustness in NLP Tasks
di: Hu, Jiacheng, et al.
Pubblicazione: (2024)

Research on Key Technologies for Cross-Cloud Federated Training of Large Language Models
di: Yang, Haowei, et al.
Pubblicazione: (2024)

Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function
di: Zheng, Hongye, et al.
Pubblicazione: (2024)

From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
di: Wu, Chao, et al.
Pubblicazione: (2025)

Unified Preference Optimization: Language Model Alignment Beyond the Preference Frontier
di: Badrinath, Anirudhan, et al.
Pubblicazione: (2024)

Large Language Model Agent for Hyper-Parameter Optimization
di: Liu, Siyi, et al.
Pubblicazione: (2024)

DR.GAP: Mitigating Bias in Large Language Models using Gender-Aware Prompting with Demonstration and Reasoning
di: Qiu, Hongye, et al.
Pubblicazione: (2025)

Transferable & Stealthy Ensemble Attacks: A Black-Box Jailbreaking Framework for Large Language Models
di: Yang, Yiqi, et al.
Pubblicazione: (2024)

MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization
di: Chen, Yuyan, et al.
Pubblicazione: (2024)

EfficientLLM: Efficiency in Large Language Models
di: Yuan, Zhengqing, et al.
Pubblicazione: (2025)

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models
di: Li, Jiaxuan, et al.
Pubblicazione: (2024)

Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization
di: Chen, Yile, et al.
Pubblicazione: (2025)

EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities
di: Li, Nian, et al.
Pubblicazione: (2023)

Scaling and Transferability of Annealing Strategies in Large Language Model Training
di: Wang, Siqi, et al.
Pubblicazione: (2025)

Adaptive Training Meets Progressive Scaling: Elevating Efficiency in Diffusion Models
di: Li, Wenhao, et al.
Pubblicazione: (2023)

Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training
di: Fang, Feiteng, et al.
Pubblicazione: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
di: Liao, Xiaoxuan, et al.
Pubblicazione: (2025)

STAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning
di: Huang, Zixiao, et al.
Pubblicazione: (2025)

Weights-Rotated Preference Optimization for Large Language Models
di: Yang, Chenxu, et al.
Pubblicazione: (2025)

Enhancing Large-Scale AI Training Efficiency: The C4 Solution for Real-Time Anomaly Detection and Communication Optimization
di: Dong, Jianbo, et al.
Pubblicazione: (2024)

Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models
di: Huang, Jia-Hong, et al.
Pubblicazione: (2024)

LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training
di: Liu, Ziwei, et al.
Pubblicazione: (2025)

Adaptive Content Restriction for Large Language Models via Suffix Optimization
di: Li, Yige, et al.
Pubblicazione: (2025)

Large Language Models to Enhance Bayesian Optimization
di: Liu, Tennison, et al.
Pubblicazione: (2024)

GAUSS: Benchmarking Structured Mathematical Skills for Large Language Models
di: Zhang, Yue, et al.
Pubblicazione: (2025)

Pruning Large Language Models with Semi-Structural Adaptive Sparse Training
di: Huang, Weiyu, et al.
Pubblicazione: (2024)

Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyond
di: Li, Qiyuan, et al.
Pubblicazione: (2025)

ACPO: Adaptive Curriculum Policy Optimization for Aligning Vision-Language Models in Complex Reasoning
di: Wang, Yunhao, et al.
Pubblicazione: (2025)

OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scale
di: AhmadiTeshnizi, Ali, et al.
Pubblicazione: (2024)

Contrastive Learning for Knowledge-Based Question Generation in Large Language Models
di: Zhang, Zhenhong, et al.
Pubblicazione: (2024)

Enhancing Conflict Resolution in Language Models via Abstract Argumentation
di: Li, Zhaoqun, et al.
Pubblicazione: (2024)

DISPO: Enhancing Training Efficiency and Stability in Reinforcement Learning for Large Language Model Mathematical Reasoning
di: Karaman, Batuhan K., et al.
Pubblicazione: (2026)

SASQ: Static Activation Scaling for Quantization-Aware Training in Large Language Models
di: Mao, Shizhuo, et al.
Pubblicazione: (2025)

A Survey of Scaling in Large Language Model Reasoning
di: Chen, Zihan, et al.
Pubblicazione: (2025)

A Visual Semantic Adaptive Watermark grounded by Prefix-Tuning for Large Vision-Language Model
di: Zheng, Qi, et al.
Pubblicazione: (2026)

Enhancing ID-based Recommendation with Large Language Models
di: Chen, Lei, et al.
Pubblicazione: (2024)

MatSciBench: Benchmarking the Reasoning Ability of Large Language Models in Materials Science
di: Zhang, Junkai, et al.
Pubblicazione: (2025)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
di: Fang, Zihan, et al.
Pubblicazione: (2024)

Learning to Substitute Words with Model-based Score Ranking
di: Liu, Hongye, et al.
Pubblicazione: (2025)