Copertina

360-LLaMA-Factory: Plug & Play Sequence Parallelism for Long Post-Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zou, Haosheng, Lv, Xiaowei, Jia, Shousheng, Li, Lin, Gong, Xiaochun, Zhang, Xiangzheng
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training
di: Dialameh, Maryam, et al.
Pubblicazione: (2025)

LogLLaMA: Transformer-based log anomaly detection with LLaMA
di: Yang, Zhuoyi, et al.
Pubblicazione: (2025)

LLaMA Pro: Progressive LLaMA with Block Expansion
di: Wu, Chengyue, et al.
Pubblicazione: (2024)

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
di: Qu, Xiaoye, et al.
Pubblicazione: (2024)

Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyond
di: Wen, Liang, et al.
Pubblicazione: (2025)

BanglaLlama: LLaMA for Bangla Language
di: Zehady, Abdullah Khan, et al.
Pubblicazione: (2024)

Llamazip: Leveraging LLaMA for Lossless Text Compression and Training Dataset Detection
di: Dréano, Sören, et al.
Pubblicazione: (2025)

Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain
di: Gema, Aryo Pradipta, et al.
Pubblicazione: (2023)

Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
di: Cui, Yiming, et al.
Pubblicazione: (2023)

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
di: Zhu, Tong, et al.
Pubblicazione: (2024)

Light-IF: Endowing LLMs with Generalizable Reasoning via Preview and Self-Checking for Complex Instruction Following
di: Wang, Chenyang, et al.
Pubblicazione: (2025)

Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
di: Chen, Nuo, et al.
Pubblicazione: (2023)

Enhancing Document-Level Question Answering via Multi-Hop Retrieval-Augmented Generation with LLaMA 3
di: Huang, Xinyue, et al.
Pubblicazione: (2025)

Shortened LLaMA: Depth Pruning for Large Language Models with Comparison of Retraining Methods
di: Kim, Bo-Kyeong, et al.
Pubblicazione: (2024)

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference
di: Kavehzadeh, Parsa, et al.
Pubblicazione: (2023)

Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
di: Xia, Mengzhou, et al.
Pubblicazione: (2023)

Amharic LLaMA and LLaVA: Multimodal LLMs for Low Resource Languages
di: Andersland, Michael
Pubblicazione: (2024)

I Have No Mouth, and I Must Rhyme: Uncovering Internal Phonetic Representations in LLaMA 3.2
di: McLaughlin, Oliver, et al.
Pubblicazione: (2025)

LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probing
di: Di Palma, Dario, et al.
Pubblicazione: (2025)

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
di: Zhang, Renrui, et al.
Pubblicazione: (2023)

How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
di: Yuan, Fei, et al.
Pubblicazione: (2023)

LLaMA-Based Models for Aspect-Based Sentiment Analysis
di: Šmíd, Jakub, et al.
Pubblicazione: (2025)

LLaMA based Punctuation Restoration With Forward Pass Only Decoding
di: Pang, Yutong, et al.
Pubblicazione: (2024)

Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT
di: Du, Shaoshuai, et al.
Pubblicazione: (2025)

LLaMA Beyond English: An Empirical Study on Language Capability Transfer
di: Zhao, Jun, et al.
Pubblicazione: (2024)

Me LLaMA: Foundation Large Language Models for Medical Applications
di: Xie, Qianqian, et al.
Pubblicazione: (2024)

LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction
di: Zou, Bo, et al.
Pubblicazione: (2024)

An empirical study of LLaMA3 quantization: from LLMs to MLLMs
di: Huang, Wei, et al.
Pubblicazione: (2024)

LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models
di: Wang, Zhengyi, et al.
Pubblicazione: (2024)

LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement
di: Kang, Boyi, et al.
Pubblicazione: (2025)

The Role of Model Architecture and Scale in Predicting Molecular Properties: Insights from Fine-Tuning RoBERTa, BART, and LLaMA
di: Youngmin, Lee, et al.
Pubblicazione: (2024)

Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study
di: Ma, Chi, et al.
Pubblicazione: (2024)

What If We Recaption Billions of Web Images with LLaMA-3?
di: Li, Xianhang, et al.
Pubblicazione: (2024)

LLaMA-Omni: Seamless Speech Interaction with Large Language Models
di: Fang, Qingkai, et al.
Pubblicazione: (2024)

ChatGPT vs Gemini vs LLaMA on Multilingual Sentiment Analysis
di: Buscemi, Alessio, et al.
Pubblicazione: (2024)

Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasets
di: Azime, Israel Abebe, et al.
Pubblicazione: (2024)

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
di: Zhang, Di, et al.
Pubblicazione: (2024)

The impact of fine tuning in LLaMA on hallucinations for named entity extraction in legal documentation
di: Vargas, Francisco, et al.
Pubblicazione: (2025)

VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models
di: Liu, Chonghan, et al.
Pubblicazione: (2026)

LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registration
di: Ma, Mingrui, et al.
Pubblicazione: (2024)