Image de couverture de livre

Efficient Training of Robust Traditional Chinese LLaMA-1B on a Single Consumer GPU: Continual Pre-training, SFT, and DPO

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chih, Yu-Cheng, Duan, Ming-Tao, Hou, Yong-Hao
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
par: Zhu, Tong, et autres
Publié: (2024)

ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training
par: Dialameh, Maryam, et autres
Publié: (2025)

LLaMA Pro: Progressive LLaMA with Block Expansion
par: Wu, Chengyue, et autres
Publié: (2024)

Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
par: Cui, Yiming, et autres
Publié: (2023)

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
par: Qu, Xiaoye, et autres
Publié: (2024)

LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registration
par: Ma, Mingrui, et autres
Publié: (2024)

Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
par: Xia, Mengzhou, et autres
Publié: (2023)

Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection
par: Yu, Lei, et autres
Publié: (2025)

Adapting LLaMA Decoder to Vision Transformer
par: Wang, Jiahao, et autres
Publié: (2024)

PUMA: Secure Inference of LLaMA-7B in Five Minutes
par: Dong, Ye, et autres
Publié: (2023)

Tailored-LLaMA: Optimizing Few-Shot Learning in Pruned LLaMA Models with Task-Specific Prompts
par: Aftab, Danyal, et autres
Publié: (2024)

LogLLaMA: Transformer-based log anomaly detection with LLaMA
par: Yang, Zhuoyi, et autres
Publié: (2025)

VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks
par: Chu, Xiangxiang, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain
par: Gema, Aryo Pradipta, et autres
Publié: (2023)

BanglaLlama: LLaMA for Bangla Language
par: Zehady, Abdullah Khan, et autres
Publié: (2024)

LLaMA-XR: A Novel Framework for Radiology Report Generation using LLaMA and QLoRA Fine Tuning
par: Jahangir, Md. Zihad Bin, et autres
Publié: (2025)

LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probing
par: Di Palma, Dario, et autres
Publié: (2025)

Llamazip: Leveraging LLaMA for Lossless Text Compression and Training Dataset Detection
par: Dréano, Sören, et autres
Publié: (2025)

Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Features
par: Lee, Jewon, et autres
Publié: (2025)

How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
par: Yuan, Fei, et autres
Publié: (2023)

Multimodal Medical Disease Classification with LLaMA II
par: Gapp, Christian, et autres
Publié: (2024)

LLaMA Beyond English: An Empirical Study on Language Capability Transfer
par: Zhao, Jun, et autres
Publié: (2024)

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning
par: Cheng, Zebang, et autres
Publié: (2024)

Amharic LLaMA and LLaVA: Multimodal LLMs for Low Resource Languages
par: Andersland, Michael
Publié: (2024)

LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models
par: Sarah, Anthony, et autres
Publié: (2024)

360-LLaMA-Factory: Plug & Play Sequence Parallelism for Long Post-Training
par: Zou, Haosheng, et autres
Publié: (2025)

Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
par: Chen, Nuo, et autres
Publié: (2023)

Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study
par: Ma, Chi, et autres
Publié: (2024)

Faster Speech-LLaMA Inference with Multi-token Prediction
par: Raj, Desh, et autres
Publié: (2024)

Evaluating LLaMA 3.2 for Software Vulnerability Detection
par: Gonçalves, José, et autres
Publié: (2025)

LLaMA-Based Models for Aspect-Based Sentiment Analysis
par: Šmíd, Jakub, et autres
Publié: (2025)

The Uniqueness of LLaMA3-70B Series with Per-Channel Quantization
par: Qin, Minghai
Publié: (2024)

Me LLaMA: Foundation Large Language Models for Medical Applications
par: Xie, Qianqian, et autres
Publié: (2024)

Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT
par: Du, Shaoshuai, et autres
Publié: (2025)

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
par: Zhang, Renrui, et autres
Publié: (2023)

MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
par: Yeo, Jeong Hun, et autres
Publié: (2025)

Dia-LLaMA: Towards Large Language Model-driven CT Report Generation
par: Chen, Zhixuan, et autres
Publié: (2024)

LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement
par: Kang, Boyi, et autres
Publié: (2025)

What If We Recaption Billions of Web Images with LLaMA-3?
par: Li, Xianhang, et autres
Publié: (2024)

EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuning
par: Xing, Bohao, et autres
Publié: (2024)