Breeze-7B Technical Report

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hsu, Chan-Jan, Liu, Chang-Le, Liao, Feng-Ting, Hsu, Po-Chun, Chen, Yi-Chang, Shiu, Da-Shan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917629289037824
author Hsu, Chan-Jan
Liu, Chang-Le
Liao, Feng-Ting
Hsu, Po-Chun
Chen, Yi-Chang
Shiu, Da-Shan
author_facet Hsu, Chan-Jan
Liu, Chang-Le
Liao, Feng-Ting
Hsu, Po-Chun
Chen, Yi-Chang
Shiu, Da-Shan
contents Breeze-7B is an open-source language model based on Mistral-7B, designed to address the need for improved language comprehension and chatbot-oriented capabilities in Traditional Chinese. This technical report provides an overview of the additional pretraining, finetuning, and evaluation stages for the Breeze-7B model. The Breeze-7B family of base and chat models exhibits good performance on language comprehension and chatbot-oriented tasks, reaching the top in several benchmarks among models comparable in its complexity class.
format Preprint
id arxiv_https___arxiv_org_abs_2403_02712
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Breeze-7B Technical Report
Hsu, Chan-Jan
Liu, Chang-Le
Liao, Feng-Ting
Hsu, Po-Chun
Chen, Yi-Chang
Shiu, Da-Shan
Computation and Language
Breeze-7B is an open-source language model based on Mistral-7B, designed to address the need for improved language comprehension and chatbot-oriented capabilities in Traditional Chinese. This technical report provides an overview of the additional pretraining, finetuning, and evaluation stages for the Breeze-7B model. The Breeze-7B family of base and chat models exhibits good performance on language comprehension and chatbot-oriented tasks, reaching the top in several benchmarks among models comparable in its complexity class.
title Breeze-7B Technical Report
topic Computation and Language
url https://arxiv.org/abs/2403.02712