Image de couverture de livre

A Post-Training Enhanced Optimization Approach for Small Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Zhai, Keke
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Self-Evolved Preference Optimization for Enhancing Mathematical Reasoning in Small Language Models
par: Singh, Joykirat, et autres
Publié: (2025)

Mapping Post-Training Forgetting in Language Models at Scale
par: Harmon, Jackson, et autres
Publié: (2025)

Interactions Across Blocks in Post-Training Quantization of Large Language Models
par: Shabanovi, Khasmamad, et autres
Publié: (2024)

Towards a Unified View of Large Language Model Post-Training
par: Lv, Xingtai, et autres
Publié: (2025)

Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models
par: Zhang, Jun, et autres
Publié: (2025)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
par: Xiao, Guangxuan, et autres
Publié: (2022)

Is Training Data Quality or Quantity More Impactful to Small Language Model Performance?
par: Sajith, Aryan, et autres
Publié: (2024)

Readability $\ne$ Learnability: Rethinking the Role of Simplicity in Training Small Language Models
par: Lee, Ivan, et autres
Publié: (2025)

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
par: Pan, Rui, et autres
Publié: (2025)

Large Language Model Post-Training: A Unified View of Off-Policy and On-Policy Learning
par: Zhao, Shiwan, et autres
Publié: (2026)

APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
par: Guan, Ziyi, et autres
Publié: (2024)

PMPO: Probabilistic Metric Prompt Optimization for Small and Large Language Models
par: Zhao, Chenzhuo, et autres
Publié: (2025)

Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models
par: Zhou, Chenxi, et autres
Publié: (2025)

SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models
par: Yang, Yu, et autres
Publié: (2024)

Inverse Reinforcement Learning Meets Large Language Model Post-Training: Basics, Advances, and Opportunities
par: Sun, Hao, et autres
Publié: (2025)

Param$Δ$ for Direct Weight Mixing: Post-Train Large Language Model at Zero Cost
par: Cao, Sheng, et autres
Publié: (2025)

Sequence-level Large Language Model Training with Contrastive Preference Optimization
par: Feng, Zhili, et autres
Publié: (2025)

EVPO: Explained Variance Policy Optimization for Adaptive Critic Utilization in LLM Post-Training
par: Pan, Chengjun, et autres
Publié: (2026)

Optimizing Large Language Models for Turkish: New Methodologies in Corpus Selection and Training
par: Kesgin, H. Toprak, et autres
Publié: (2024)

Learning to Reason Efficiently with A* Post-Training
par: Opedal, Andreas, et autres
Publié: (2026)

Stacking Small Language Models for Generalizability
par: Liang, Laurence
Publié: (2024)

All Language Models Large and Small
par: Chen, Zhixun, et autres
Publié: (2024)

HAPO: Training Language Models to Reason Concisely via History-Aware Policy Optimization
par: Huang, Chengyu, et autres
Publié: (2025)

Recall-Extend Dynamics: Enhancing Small Language Models through Controlled Exploration and Refined Offline Integration
par: Guan, Zhong, et autres
Publié: (2025)

Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information
par: Wang, Yanshu, et autres
Publié: (2024)

Kakugo: Distillation of Low-Resource Languages into Small Language Models
par: Devine, Peter, et autres
Publié: (2026)

Small Language Models: Survey, Measurements, and Insights
par: Lu, Zhenyan, et autres
Publié: (2024)

Squat: Quant Small Language Models on the Edge
par: Shen, Xuan, et autres
Publié: (2024)

Towards Reasoning Ability of Small Language Models
par: Srivastava, Gaurav, et autres
Publié: (2025)

Hymba: A Hybrid-head Architecture for Small Language Models
par: Dong, Xin, et autres
Publié: (2024)

Small Language Models for Application Interactions: A Case Study
par: Li, Beibin, et autres
Publié: (2024)

A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratio
par: Xi, Ningyuan, et autres
Publié: (2024)

Are Small Language Models Ready to Compete with Large Language Models for Practical Applications?
par: Sinha, Neelabh, et autres
Publié: (2024)

AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling
par: Liu, Zihan, et autres
Publié: (2024)

P$^2$ Law: Scaling Law for Post-Training After Model Pruning
par: Chen, Xiaodong, et autres
Publié: (2024)

Training Language Models with Language Feedback at Scale
par: Scheurer, Jérémy, et autres
Publié: (2023)

DISPO: Enhancing Training Efficiency and Stability in Reinforcement Learning for Large Language Model Mathematical Reasoning
par: Karaman, Batuhan K., et autres
Publié: (2026)

Post-Training Sparse Attention with Double Sparsity
par: Yang, Shuo, et autres
Publié: (2024)

Training-free Ultra Small Model for Universal Sparse Reconstruction in Compressed Sensing
par: Tang, Chaoqing, et autres
Publié: (2025)

Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models
par: Hameed, Saad, et autres
Publié: (2025)