Image de couverture de livre

Training Dynamics of a 1.7B LLaMa Model: A Data-Efficient Approach

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Miles Q., Fung, Benjamin C. M., Huang, Shih-Chia
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On the Effectiveness of Incremental Training of Large Language Models
par: Li, Miles Q., et autres
Publié: (2024)

Benchmarking quantized LLaMa-based models on the Brazilian Secondary School Exam
par: Santos, Matheus L. O., et autres
Publié: (2023)

A Deep User Interface for Exploring LLaMa
par: Perumal, Divya, et autres
Publié: (2025)

LLaMa-SciQ: An Educational Chatbot for Answering Science MCQ
par: Allard, Marc-Antoine, et autres
Publié: (2024)

Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B
par: Zhang, Di, et autres
Publié: (2024)

Security Concerns for Large Language Models: A Survey
par: Li, Miles Q., et autres
Publié: (2025)

Evaluating LLMs for Quotation Attribution in Literary Texts: A Case Study of LLaMa3
par: Michel, Gaspard, et autres
Publié: (2024)

Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning
par: Huang, Shih-Cheng, et autres
Publié: (2022)

LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation
par: Chiang, Yuan, et autres
Publié: (2024)

Annotation-Efficient Vision-Language Model Adaptation to the Polish Language Using the LLaVA Framework
par: Statkiewicz, Grzegorz, et autres
Publié: (2026)

LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probing
par: Di Palma, Dario, et autres
Publié: (2025)

Resource-Efficient Fine-Tuning of LLaMA-3.2-3B for Medical Chain-of-Thought Reasoning
par: Mansha, Imran
Publié: (2025)

LLaDA2.0: Scaling Up Diffusion Language Models to 100B
par: Bie, Tiwei, et autres
Publié: (2025)

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
par: Zhang, Di, et autres
Publié: (2024)

Me LLaMA: Foundation Large Language Models for Medical Applications
par: Xie, Qianqian, et autres
Publié: (2024)

Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context Sparsification
par: Huang, Wenxuan, et autres
Publié: (2024)

Prompt Compression in Diffusion Large Language Models: Evaluating LLMLingua-2 on LLaDA
par: Huang, Sterling, et autres
Publié: (2026)

LLaDA-MoE: A Sparse MoE Diffusion Language Model
par: Zhu, Fengqi, et autres
Publié: (2025)

R&B: Domain Regrouping and Data Mixture Balancing for Efficient Foundation Model Training
par: Ge, Albert, et autres
Publié: (2025)

How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
par: Yuan, Fei, et autres
Publié: (2023)

LLaSA: Large Language and Structured Data Assistant
par: Xu, Yao, et autres
Publié: (2024)

AVG-LLaVA: An Efficient Large Multimodal Model with Adaptive Visual Granularity
par: Lan, Zhibin, et autres
Publié: (2024)

How to Train Data-Efficient LLMs
par: Sachdeva, Noveen, et autres
Publié: (2024)

Crowdsourcing with Enhanced Data Quality Assurance: An Efficient Approach to Mitigate Resource Scarcity Challenges in Training Large Language Models for Healthcare
par: Barai, P., et autres
Publié: (2024)

LLaMandement: Large Language Models for Summarization of French Legislative Proposals
par: Gesnouin, Joseph, et autres
Publié: (2024)

LLaMA Beyond English: An Empirical Study on Language Capability Transfer
par: Zhao, Jun, et autres
Publié: (2024)

Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models
par: Wu, Wei, et autres
Publié: (2026)

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
par: Hinck, Musashi, et autres
Publié: (2024)

DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs
par: Yu, Longxuan, et autres
Publié: (2026)

UltraLLaDA: Scaling the Context Length to 128K for Diffusion Large Language Models
par: He, Guangxin, et autres
Publié: (2025)

StatLLaMA: Multi-Stage training for domain-optimized statistical large language models
par: Zeng, Jing-Yi, et autres
Publié: (2025)

Unifying Structured Data as Graph for Data-to-Text Pre-Training
par: Li, Shujie, et autres
Publié: (2024)

"According to ...": Prompting Language Models Improves Quoting from Pre-Training Data
par: Weller, Orion, et autres
Publié: (2023)

HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models
par: Zhang, Wenqiao, et autres
Publié: (2024)

D$^3$: Dynamic Directional Graph-Constrained Data Scheduling for LLM Training
par: Xu, Yuanjian, et autres
Publié: (2026)

An Efficient and Precise Training Data Construction Framework for Process-supervised Reward Model in Mathematical Reasoning
par: Sun, Wei, et autres
Publié: (2025)

Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models
par: Tian, Junfeng, et autres
Publié: (2024)

Empowering Smaller Models: Tuning LLaMA and Gemma with Chain-of-Thought for Ukrainian Exam Tasks
par: Syromiatnikov, Mykyta, et autres
Publié: (2025)

Data Efficacy for Language Model Training
par: Dai, Yalun, et autres
Publié: (2025)

Adaptive Prompt Embedding Optimization for LLM Jailbreaking
par: Li, Miles Q., et autres
Publié: (2026)