Cover Image

TinyLlama: An Open-Source Small Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Peiyuan, Zeng, Guangtao, Wang, Tianduo, Lu, Wei
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LlamaTurk: Adapting Open-Source Generative Large Language Models for Low-Resource Language
by: Toraman, Cagri
Published: (2024)

Sailor: Open Language Models for South-East Asia
by: Dou, Longxu, et al.
Published: (2024)

Open Llama2 Model for the Lithuanian Language
by: Nakvosas, Artūras, et al.
Published: (2024)

TableLlama: Towards Open Large Generalist Models for Tables
by: Zhang, Tianshu, et al.
Published: (2023)

Regional Tiny Stories: Using Small Models to Compare Language Learning and Tokenizer Performance
by: Patil, Nirvan, et al.
Published: (2025)

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
by: Zheng, Yaowei, et al.
Published: (2024)

MiniLingua: A Small Open-Source LLM for European Languages
by: Aksenova, Anna, et al.
Published: (2025)

Mini-Giants: "Small" Language Models and Open Source Win-Win
by: Zhou, Zhengping, et al.
Published: (2023)

CareBot: A Pioneering Full-Process Open-Source Medical Language Model
by: Zhao, Lulu, et al.
Published: (2024)

TinyHelen's First Curriculum: Training and Evaluating Tiny Language Models in a Simpler Language Environment
by: Yang, Ke, et al.
Published: (2024)

Measuring Stability Beyond Accuracy in Small Open-Source Medical Large Language Models for Pediatric Endocrinology
by: D'Amario, Vanessa, et al.
Published: (2025)

MGH Radiology Llama: A Llama 3 70B Model for Radiology
by: Shi, Yucheng, et al.
Published: (2024)

OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
by: Wang, Jun, et al.
Published: (2024)

Classifying Cancer Stage with Open-Source Clinical Large Language Models
by: Chang, Chia-Hsuan, et al.
Published: (2024)

Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Models
by: Zhao, Lulu, et al.
Published: (2024)

Prompt Sensitivity and Answer Consistency of Small Open-Source Language Models for Clinical Question Answering in Low-Resource Healthcare
by: Hariprasad, Shravani
Published: (2026)

Evaluating from Benign to Dynamic Adversarial: A Squid Game for Large Language Models
by: Chen, Zijian, et al.
Published: (2025)

Lugha-Llama: Adapting Large Language Models for African Languages
by: Buzaaba, Happy, et al.
Published: (2025)

Llama-GENBA-10B: A Trilingual Large Language Model for German, English and Bavarian
by: Hoffmann, Michael, et al.
Published: (2025)

Tiny Reward Models
by: Pan, Sarah
Published: (2025)

LlamaCare: A Large Medical Language Model for Enhancing Healthcare Knowledge Sharing
by: Sun, Maojun
Published: (2024)

An Open Source Data Contamination Report for Large Language Models
by: Li, Yucheng, et al.
Published: (2023)

Investigating Bias Representations in Llama 2 Chat via Activation Steering
by: Lu, Dawn, et al.
Published: (2024)

Super Tiny Language Models
by: Hillier, Dylan, et al.
Published: (2024)

Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
by: Du, Xinrun, et al.
Published: (2024)

InfiR : Crafting Effective Small Language Models and Multimodal Small Language Models in Reasoning
by: Xie, Congkai, et al.
Published: (2025)

PlantDeBERTa: An Open Source Language Model for Plant Science
by: Khey, Hiba, et al.
Published: (2025)

The Llama 3 Herd of Models
by: Grattafiori, Aaron, et al.
Published: (2024)

Llama-Nemotron: Efficient Reasoning Models
by: Bercovich, Akhiad, et al.
Published: (2025)

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
by: DeepSeek-AI, et al.
Published: (2024)

AuditWen:An Open-Source Large Language Model for Audit
by: Huang, Jiajia, et al.
Published: (2024)

BanglaLlama: LLaMA for Bangla Language
by: Zehady, Abdullah Khan, et al.
Published: (2024)

Selecting Language Models for Social Science: Start Small, Start Open, and Validate
by: Stoltz, Dustin S., et al.
Published: (2026)

DharmaOCR: Specialized Small Language Models for Structured OCR that outperform Open-Source and Commercial Baselines
by: Cardoso, Gabriel Pimenta de Freitas, et al.
Published: (2026)

Vikhr: The Family of Open-Source Instruction-Tuned Large Language Models for Russian
by: Nikolich, Aleksandr, et al.
Published: (2024)

Benchmarking Open-Source Large Language Models on Healthcare Text Classification Tasks
by: Guo, Yuting, et al.
Published: (2025)

Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance Classification
by: Cruickshank, Iain J., et al.
Published: (2023)

Fox-1: Open Small Language Model for Cloud and Edge
by: Hu, Zijian, et al.
Published: (2024)

Orchard: An Open-Source Agentic Modeling Framework
by: Peng, Baolin, et al.
Published: (2026)

Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment
by: Agarwalla, Abhinav, et al.
Published: (2024)