Copertina

Vi-Mistral-X: Building a Vietnamese Language Model with Advanced Continual Pre-training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Vo, James
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Cultural Bridge by Bahnaric-Vietnamese Translation Using Transfer Learning of Sequence-To-Sequence Pre-training Language Model
di: Dat, Phan Tran Minh, et al.
Pubblicazione: (2025)

ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models
di: Nguyen, Duy Vu Minh, et al.
Pubblicazione: (2026)

Efficient Continual Pre-training for Building Domain Specific Large Language Models
di: Xie, Yong, et al.
Pubblicazione: (2023)

PhoGPT: Generative Pre-training for Vietnamese
di: Nguyen, Dat Quoc, et al.
Pubblicazione: (2023)

ViTHSD: Exploiting Hatred by Targets for Hate Speech Detection on Vietnamese Social Media Texts
di: Vo, Cuong Nhat, et al.
Pubblicazione: (2024)

ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark
di: Nguyen, Tung X., et al.
Pubblicazione: (2026)

ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models
di: Nguyen, Trong-Hieu, et al.
Pubblicazione: (2024)

ViHERMES: A Graph-Grounded Multihop Question Answering Benchmark and System for Vietnamese Healthcare Regulations
di: Nguyen, Long S. T., et al.
Pubblicazione: (2026)

Examining Forgetting in Continual Pre-training of Aligned Large Language Models
di: Li, Chen-An, et al.
Pubblicazione: (2024)

GreenMind: A Next-Generation Vietnamese Large Language Model for Structured and Logical Reasoning
di: Tung, Luu Quy, et al.
Pubblicazione: (2025)

Combining Entropy and Matrix Nuclear Norm for Enhanced Evaluation of Language Models
di: Vo, James
Pubblicazione: (2024)

ViLegalNLI: Natural Language Inference for Vietnamese Legal Texts
di: Duong, Nhung Thi-Hong, et al.
Pubblicazione: (2026)

ViBidirectionMT-Eval: Machine Translation for Vietnamese-Chinese and Vietnamese-Lao language pair
di: Tran, Hong-Viet, et al.
Pubblicazione: (2025)

Transformer Layer Injection: A Novel Approach for Efficient Upscaling of Large Language Models
di: Vo, James
Pubblicazione: (2024)

Stable Language Model Pre-training by Reducing Embedding Variability
di: Chung, Woojin, et al.
Pubblicazione: (2024)

ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterances
di: Do, Huy Ba, et al.
Pubblicazione: (2025)

ViSpeechFormer: A Phonemic Approach for Vietnamese Automatic Speech Recognition
di: Nguyen, Khoa Anh, et al.
Pubblicazione: (2026)

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
di: Zhu, Tong, et al.
Pubblicazione: (2024)

Vintern-1B: An Efficient Multimodal Large Language Model for Vietnamese
di: Doan, Khang T., et al.
Pubblicazione: (2024)

Improving Vietnamese-English Medical Machine Translation
di: Vo, Nhu, et al.
Pubblicazione: (2024)

Large Malaysian Language Model Based on Mistral for Enhanced Local Language Understanding
di: Zolkepli, Husein, et al.
Pubblicazione: (2024)

DSC2025 -- ViHallu Challenge: Detecting Hallucination in Vietnamese LLMs
di: Nguyen, Anh Thi-Hoang, et al.
Pubblicazione: (2026)

Construction of Domain-specified Japanese Large Language Model for Finance through Continual Pre-training
di: Hirano, Masanori, et al.
Pubblicazione: (2024)

ViWikiFC: Fact-Checking for Vietnamese Wikipedia-Based Textual Knowledge Source
di: Le, Hung Tuan, et al.
Pubblicazione: (2024)

ViLexNorm: A Lexical Normalization Corpus for Vietnamese Social Media Text
di: Nguyen, Thanh-Nhi, et al.
Pubblicazione: (2024)

FreeTxt-Vi: A Benchmarked Vietnamese-English Toolkit for Segmentation, Sentiment, and Summarisation
di: Huy, Hung Nguyen, et al.
Pubblicazione: (2026)

ViMQ: A Vietnamese Medical Question Dataset for Healthcare Dialogue System Development
di: Huy, Ta Duc, et al.
Pubblicazione: (2023)

ViMMRC 2.0 -- Enhancing Machine Reading Comprehension on Vietnamese Literature Text
di: Luu, Son T., et al.
Pubblicazione: (2023)

ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer Model
di: Nguyen, Luan Thanh
Pubblicazione: (2024)

Efficient Continual Pre-training of LLMs for Low-resource Languages
di: Nag, Arijit, et al.
Pubblicazione: (2024)

Simple and Scalable Strategies to Continually Pre-train Large Language Models
di: Ibrahim, Adam, et al.
Pubblicazione: (2024)

Scaling Agents via Continual Pre-training
di: Su, Liangcai, et al.
Pubblicazione: (2025)

ViMultiChoice: Toward a Method That Gives Explanation for Multiple-Choice Reading Comprehension in Vietnamese
di: Cao, Trung Tien, et al.
Pubblicazione: (2026)

AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages
di: Yu, Hao, et al.
Pubblicazione: (2026)

MELT: Materials-aware Continued Pre-training for Language Model Adaptation to Materials Science
di: Kim, Junho, et al.
Pubblicazione: (2024)

Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors
di: Ma, Shengkun, et al.
Pubblicazione: (2024)

Development of Cognitive Intelligence in Pre-trained Language Models
di: Shah, Raj Sanjay, et al.
Pubblicazione: (2024)

ViGoEmotions: A Benchmark Dataset For Fine-grained Emotion Detection on Vietnamese Texts
di: Tran, Hung Quang, et al.
Pubblicazione: (2026)

Metadata Conditioning Accelerates Language Model Pre-training
di: Gao, Tianyu, et al.
Pubblicazione: (2025)

Evaluating Discourse Cohesion in Pre-trained Language Models
di: He, Jie, et al.
Pubblicazione: (2025)