Cross-Language Assessment of Mathematical Capability of ChatGPT
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929348421877760 |
|---|---|
| author | Sathe, Gargi Shamraj, Aneesh Surve, Aditya Patil, Nahush Saxena, Kumkum |
| author_facet | Sathe, Gargi Shamraj, Aneesh Surve, Aditya Patil, Nahush Saxena, Kumkum |
| contents | This paper presents an evaluation of the mathematical capability of ChatGPT across diverse languages like Hindi, Gujarati, and Marathi. ChatGPT, based on GPT-3.5 by OpenAI, has garnered significant attention for its natural language understanding and generation abilities. However, its performance in solving mathematical problems across multiple natural languages remains a comparatively unexplored area, especially in regional Indian languages. In this paper, we explore those capabilities as well as using chain-of-thought prompting to figure out if it increases the accuracy of responses as much as it does in the English language and provide insights into the current limitations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_11264 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Cross-Language Assessment of Mathematical Capability of ChatGPT Sathe, Gargi Shamraj, Aneesh Surve, Aditya Patil, Nahush Saxena, Kumkum Computation and Language Machine Learning This paper presents an evaluation of the mathematical capability of ChatGPT across diverse languages like Hindi, Gujarati, and Marathi. ChatGPT, based on GPT-3.5 by OpenAI, has garnered significant attention for its natural language understanding and generation abilities. However, its performance in solving mathematical problems across multiple natural languages remains a comparatively unexplored area, especially in regional Indian languages. In this paper, we explore those capabilities as well as using chain-of-thought prompting to figure out if it increases the accuracy of responses as much as it does in the English language and provide insights into the current limitations. |
| title | Cross-Language Assessment of Mathematical Capability of ChatGPT |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2405.11264 |