ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913195804852224 |
|---|---|
| author | Chen, Hailin Jiao, Fangkai Li, Xingxuan Qin, Chengwei Ravaut, Mathieu Zhao, Ruochen Xiong, Caiming Joty, Shafiq |
| author_facet | Chen, Hailin Jiao, Fangkai Li, Xingxuan Qin, Chengwei Ravaut, Mathieu Zhao, Ruochen Xiong, Caiming Joty, Shafiq |
| contents | Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning from human feedback, it showed that a model could answer human questions and follow instructions on a broad panel of tasks. Following this success, interests in LLMs have intensified, with new LLMs flourishing at frequent interval across academia and industry, including many start-ups focused on LLMs. While closed-source LLMs (e.g., OpenAI's GPT, Anthropic's Claude) generally outperform their open-source counterparts, the progress on the latter has been rapid with claims of achieving parity or even better on certain tasks. This has crucial implications not only on research but also on business. In this work, on the first anniversary of ChatGPT, we provide an exhaustive overview of this success, surveying all tasks where an open-source LLM has claimed to be on par or better than ChatGPT. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_16989 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? Chen, Hailin Jiao, Fangkai Li, Xingxuan Qin, Chengwei Ravaut, Mathieu Zhao, Ruochen Xiong, Caiming Joty, Shafiq Computation and Language Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning from human feedback, it showed that a model could answer human questions and follow instructions on a broad panel of tasks. Following this success, interests in LLMs have intensified, with new LLMs flourishing at frequent interval across academia and industry, including many start-ups focused on LLMs. While closed-source LLMs (e.g., OpenAI's GPT, Anthropic's Claude) generally outperform their open-source counterparts, the progress on the latter has been rapid with claims of achieving parity or even better on certain tasks. This has crucial implications not only on research but also on business. In this work, on the first anniversary of ChatGPT, we provide an exhaustive overview of this success, surveying all tasks where an open-source LLM has claimed to be on par or better than ChatGPT. |
| title | ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2311.16989 |