CodeGemma: Open Code Models Based on Gemma
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913397252030464 |
|---|---|
| author | CodeGemma Team Zhao, Heri Hui, Jeffrey Howland, Joshua Nguyen, Nam Zuo, Siqi Hu, Andrea Choquette-Choo, Christopher A. Shen, Jingyue Kelley, Joe Bansal, Kshitij Vilnis, Luke Wirth, Mateo Michel, Paul Choy, Peter Joshi, Pratik Kumar, Ravin Hashmi, Sarmad Agrawal, Shubham Gong, Zhitao Fine, Jane Warkentin, Tris Hartman, Ale Jakse Ni, Bin Korevec, Kathy Schaefer, Kelly Huffman, Scott |
| author_facet | CodeGemma Team Zhao, Heri Hui, Jeffrey Howland, Joshua Nguyen, Nam Zuo, Siqi Hu, Andrea Choquette-Choo, Christopher A. Shen, Jingyue Kelley, Joe Bansal, Kshitij Vilnis, Luke Wirth, Mateo Michel, Paul Choy, Peter Joshi, Pratik Kumar, Ravin Hashmi, Sarmad Agrawal, Shubham Gong, Zhitao Fine, Jane Warkentin, Tris Hartman, Ale Jakse Ni, Bin Korevec, Kathy Schaefer, Kelly Huffman, Scott |
| contents | This paper introduces CodeGemma, a collection of specialized open code models built on top of Gemma, capable of a variety of code and natural language generation tasks. We release three model variants. CodeGemma 7B pretrained (PT) and instruction-tuned (IT) variants have remarkably resilient natural language understanding, excel in mathematical reasoning, and match code capabilities of other open models. CodeGemma 2B is a state-of-the-art code completion model designed for fast code infilling and open-ended generation in latency-sensitive settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11409 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CodeGemma: Open Code Models Based on Gemma CodeGemma Team Zhao, Heri Hui, Jeffrey Howland, Joshua Nguyen, Nam Zuo, Siqi Hu, Andrea Choquette-Choo, Christopher A. Shen, Jingyue Kelley, Joe Bansal, Kshitij Vilnis, Luke Wirth, Mateo Michel, Paul Choy, Peter Joshi, Pratik Kumar, Ravin Hashmi, Sarmad Agrawal, Shubham Gong, Zhitao Fine, Jane Warkentin, Tris Hartman, Ale Jakse Ni, Bin Korevec, Kathy Schaefer, Kelly Huffman, Scott Computation and Language Artificial Intelligence This paper introduces CodeGemma, a collection of specialized open code models built on top of Gemma, capable of a variety of code and natural language generation tasks. We release three model variants. CodeGemma 7B pretrained (PT) and instruction-tuned (IT) variants have remarkably resilient natural language understanding, excel in mathematical reasoning, and match code capabilities of other open models. CodeGemma 2B is a state-of-the-art code completion model designed for fast code infilling and open-ended generation in latency-sensitive settings. |
| title | CodeGemma: Open Code Models Based on Gemma |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2406.11409 |