Cover Image

Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Du, Xinrun, Yu, Zhouliang, Gao, Songyang, Pan, Ding, Cheng, Yuyang, Ma, Ziyang, Yuan, Ruibin, Qu, Xingwei, Liu, Jiaheng, Zheng, Tianyu, Luo, Xinchen, Zhou, Guorui, Chen, Wenhu, Zhang, Ge
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Fine Line: Navigating Large Language Model Pretraining with Down-streaming Capability Analysis
by: Yang, Chen, et al.
Published: (2024)

Kun: Answer Polishment for Chinese Self-Alignment with Instruction Back-Translation
by: Zheng, Tianyu, et al.
Published: (2024)

CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
by: Zhang, Ge, et al.
Published: (2024)

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm
by: Liang, Yiming, et al.
Published: (2024)

Overview of the NLPCC 2024 Shared Task on Chinese Metaphor Generation
by: Qu, Xingwei, et al.
Published: (2024)

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values
by: P Team, et al.
Published: (2025)

MuPT: A Generative Symbolic Music Pretrained Transformer
by: Qu, Xingwei, et al.
Published: (2024)

Can MLLMs Understand the Deep Implication Behind Chinese Images?
by: Zhang, Chenhao, et al.
Published: (2024)

Steel-LLM:From Scratch to Open Source -- A Personal Journey in Building a Chinese-Centric LLM
by: Gu, Qingshui, et al.
Published: (2025)

CodeEditorBench: Evaluating Code Editing Capability of Large Language Models
by: Guo, Jiawei, et al.
Published: (2024)

Exploring the MBTI distribution among Chinese undergraduate physics students: the influence of family income on career trajectories
by: Bai, Songyang, et al.
Published: (2024)

OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision
by: Wei, Cong, et al.
Published: (2024)

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning
by: Bai, Yuelin, et al.
Published: (2024)

FuxiMT: Sparsifying Large Language Models for Chinese-Centric Multilingual Machine Translation
by: Zhu, Shaolin, et al.
Published: (2025)

CMDAG: A Chinese Metaphor Dataset with Annotated Grounds as CoT for Boosting Metaphor Generation
by: Shao, Yujie, et al.
Published: (2024)

CDSD: Chinese Dysarthria Speech Database
by: Wang, Yan, et al.
Published: (2023)

CDTP: A Large-Scale Chinese Data-Text Pair Dataset for Comprehensive Evaluation of Chinese LLMs
by: Wu, Chengwei, et al.
Published: (2025)

KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Tasks
by: Ma, Kaijing, et al.
Published: (2024)

ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation
by: Ren, Weiming, et al.
Published: (2024)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
by: LI, Yizhi, et al.
Published: (2024)

Aligning Instruction Tuning with Pre-training
by: Liang, Yiming, et al.
Published: (2025)

Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations
by: Sun, Jiaxing, et al.
Published: (2024)

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
by: Zhuang, Alex, et al.
Published: (2024)

COIG-Writer: A High-Quality Dataset for Chinese Creative Writing with Thought Processes
by: Li, Yunwen, et al.
Published: (2025)

ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark
by: Liu, Kangwei, et al.
Published: (2025)

Understanding by Reconstruction: Reversing the Software Development Process for LLM Pretraining
by: Zeng, Zhiyuan, et al.
Published: (2026)

MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces
by: Zheng, Tianyu, et al.
Published: (2024)

PoeTone: A Framework for Constrained Generation of Structured Chinese Songci with LLMs
by: Qu, Zhan, et al.
Published: (2025)

The performances of the Chinese and U.S. Large Language Models on the Topic of Chinese Culture
by: Liu, Feiyan, et al.
Published: (2026)

Judicial intelligent assistant system: Extracting events from Chinese divorce cases to detect disputes for the judge
by: Yuan Zhang, et al.
Published: (2024)

Marriage Discourse on Chinese Social Media: An LLM-assisted Analysis
by: Ye, Frank Tian-Fang, et al.
Published: (2025)

InternLM-Law: An Open Source Chinese Legal Large Language Model
by: Fei, Zhiwei, et al.
Published: (2024)

TypedCSIP: Typed Counterfactual Pretraining for Chinese Legislative Conflict Classification
by: Liu, Yao
Published: (2026)

AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model
by: Yan, Yongyu, et al.
Published: (2022)

KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation
by: Fang, Siyuan, et al.
Published: (2024)

The influence of Chinese culture and customs on the beliefs and health‐related behaviours of Chinese women with gestational diabetes mellitus: A qualitative study
by: Xiuwen Luo, et al.
Published: (2024)

Sigma-MoE-Tiny Technical Report
by: Hu, Qingguo, et al.
Published: (2025)

Libra: Large Chinese-based Safeguard for AI Content
by: Chen, Ziyang, et al.
Published: (2025)

Observing Micromotives and Macrobehavior of Large Language Models
by: Cheng, Yuyang, et al.
Published: (2024)

Chinese Court Simulation with LLM-Based Agent System
by: Zhang, Kaiyuan, et al.
Published: (2025)