ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Hailin, Jiao, Fangkai, Li, Xingxuan, Qin, Chengwei, Ravaut, Mathieu, Zhao, Ruochen, Xiong, Caiming, Joty, Shafiq
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913195804852224
author Chen, Hailin
Jiao, Fangkai
Li, Xingxuan
Qin, Chengwei
Ravaut, Mathieu
Zhao, Ruochen
Xiong, Caiming
Joty, Shafiq
author_facet Chen, Hailin
Jiao, Fangkai
Li, Xingxuan
Qin, Chengwei
Ravaut, Mathieu
Zhao, Ruochen
Xiong, Caiming
Joty, Shafiq
contents Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning from human feedback, it showed that a model could answer human questions and follow instructions on a broad panel of tasks. Following this success, interests in LLMs have intensified, with new LLMs flourishing at frequent interval across academia and industry, including many start-ups focused on LLMs. While closed-source LLMs (e.g., OpenAI's GPT, Anthropic's Claude) generally outperform their open-source counterparts, the progress on the latter has been rapid with claims of achieving parity or even better on certain tasks. This has crucial implications not only on research but also on business. In this work, on the first anniversary of ChatGPT, we provide an exhaustive overview of this success, surveying all tasks where an open-source LLM has claimed to be on par or better than ChatGPT.
format Preprint
id arxiv_https___arxiv_org_abs_2311_16989
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
Chen, Hailin
Jiao, Fangkai
Li, Xingxuan
Qin, Chengwei
Ravaut, Mathieu
Zhao, Ruochen
Xiong, Caiming
Joty, Shafiq
Computation and Language
Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning from human feedback, it showed that a model could answer human questions and follow instructions on a broad panel of tasks. Following this success, interests in LLMs have intensified, with new LLMs flourishing at frequent interval across academia and industry, including many start-ups focused on LLMs. While closed-source LLMs (e.g., OpenAI's GPT, Anthropic's Claude) generally outperform their open-source counterparts, the progress on the latter has been rapid with claims of achieving parity or even better on certain tasks. This has crucial implications not only on research but also on business. In this work, on the first anniversary of ChatGPT, we provide an exhaustive overview of this success, surveying all tasks where an open-source LLM has claimed to be on par or better than ChatGPT.
title ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
topic Computation and Language
url https://arxiv.org/abs/2311.16989