Image de couverture de livre

Scaling Laws for Downstream Task Performance of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Isik, Berivan, Ponomareva, Natalia, Hazimeh, Hussein, Paparas, Dimitris, Vassilvitskii, Sergei, Koyejo, Sanmi
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On Fairness of Low-Rank Adaptation of Large Models
par: Ding, Zhoujie, et autres
Publié: (2024)

Discovering Implicit Large Language Model Alignment Objectives
par: Chen, Edward, et autres
Publié: (2026)

Differentially Private Adaptation of Diffusion Models via Noisy Aggregated Embeddings
par: Peetathawatchai, Pura, et autres
Publié: (2024)

Quantifying the Importance of Data Alignment in Downstream Model Performance
par: Chawla, Krrish, et autres
Publié: (2025)

An Optimization Framework for Differentially Private Sparse Fine-Tuning
par: Makni, Mehdi, et autres
Publié: (2025)

Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
par: Schaeffer, Rylan, et autres
Publié: (2024)

Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check
par: Lourie, Nicholas, et autres
Publié: (2025)

Adaptive Compression in Federated Learning via Side Information
par: Isik, Berivan, et autres
Publié: (2023)

OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization
par: Meng, Xiang, et autres
Publié: (2024)

Private prediction for large-scale synthetic text generation
par: Amin, Kareem, et autres
Publié: (2024)

Scaling Laws for Predicting Downstream Performance in LLMs
par: Chen, Yangyi, et autres
Publié: (2024)

Reasoning Models Don't Just Think Longer, They Move Differently
par: Gjølbye, Anders, et autres
Publié: (2026)

The Magic Correlations: Understanding Knowledge Transfer from Pretraining to Supervised Fine-Tuning
par: Fan, Simin, et autres
Publié: (2026)

Towards Modeling Learner Performance with Large Language Models
par: Neshaei, Seyed Parsa, et autres
Publié: (2024)

Escaping Collapse: The Strength of Weak Data for Large Language Model Training
par: Amin, Kareem, et autres
Publié: (2025)

Why Do Safety Guardrails Degrade Across Languages?
par: Zhang, Max, et autres
Publié: (2026)

From Passive to Active Reasoning: Can Large Language Models Ask the Right Questions under Incomplete Information?
par: Zhou, Zhanke, et autres
Publié: (2025)

Pretraining Scaling Laws for Generative Evaluations of Language Models
par: Schaeffer, Rylan, et autres
Publié: (2025)

Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs
par: Panda, Ashwinee, et autres
Publié: (2024)

Logits are All We Need to Adapt Closed Models
par: Hiranandani, Gaurush, et autres
Publié: (2025)

DART: A Principled Approach to Adversarially Robust Unsupervised Domain Adaptation
par: Wang, Yunjuan, et autres
Publié: (2024)

Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?
par: Riabi, Arij, et autres
Publié: (2021)

Performance Law of Large Language Models
par: Wu, Chuhan, et autres
Publié: (2024)

Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training
par: Krajewski, Jakub, et autres
Publié: (2025)

Adapting Decoder-Based Language Models for Diverse Encoder Downstream Tasks
par: Suganthan, Paul, et autres
Publié: (2025)

Scaling Laws for Discriminative Classification in Large Language Models
par: Wyatte, Dean, et autres
Publié: (2024)

Rethinking Machine Unlearning for Large Language Models
par: Liu, Sijia, et autres
Publié: (2024)

Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data
par: Miranda, Brando, et autres
Publié: (2023)

Scalable Ensembling For Mitigating Reward Overoptimisation
par: Ahmed, Ahmed M., et autres
Publié: (2024)

FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom
par: He, Yuanqin, et autres
Publié: (2024)

Investigating Data Contamination for Pre-training Language Models
par: Jiang, Minhao, et autres
Publié: (2024)

Reliable and Efficient Amortized Model-based Evaluation
par: Truong, Sang, et autres
Publié: (2025)

Exploring the Impact of a Transformer's Latent Space Geometry on Downstream Task Performance
par: Marbut, Anna C., et autres
Publié: (2024)

Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models
par: Zhou, Chenxi, et autres
Publié: (2025)

Extracting books from production language models
par: Ahmed, Ahmed, et autres
Publié: (2026)

Scaling Laws for Post Training Quantized Large Language Models
par: Xu, Zifei, et autres
Publié: (2024)

Learning to Poison Large Language Models for Downstream Manipulation
par: Zhou, Xiangyu, et autres
Publié: (2024)

Exploring Scaling Laws for Local SGD in Large Language Model Training
par: He, Qiaozhi, et autres
Publié: (2024)

Predicting Task Performance with Context-aware Scaling Laws
par: Montgomery, Kyle, et autres
Publié: (2025)

Observational Scaling Laws and the Predictability of Language Model Performance
par: Ruan, Yangjun, et autres
Publié: (2024)