The Effect of Scripts and Formats on LLM Numeracy
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918298971537408 |
|---|---|
| author | Reddy, Varshini Schmidt, Craig W. Ebner, Seth Wiemerslage, Adam Pinter, Yuval Tanner, Chris |
| author_facet | Reddy, Varshini Schmidt, Craig W. Ebner, Seth Wiemerslage, Adam Pinter, Yuval Tanner, Chris |
| contents | Large language models (LLMs) have achieved impressive proficiency in basic arithmetic, rivaling human-level performance on standard numerical tasks. However, little attention has been given to how these models perform when numerical expressions deviate from the prevailing conventions present in their training corpora. In this work, we investigate numerical reasoning across a wide range of numeral scripts and formats. We show that LLM accuracy drops substantially when numerical inputs are rendered in underrepresented scripts or formats, despite the underlying mathematical reasoning being identical. We further demonstrate that targeted prompting strategies, such as few-shot prompting and explicit numeral mapping, can greatly narrow this gap. Our findings highlight an overlooked challenge in multilingual numerical reasoning and provide actionable insights for working with LLMs to reliably interpret, manipulate, and generate numbers across diverse numeral scripts and formatting styles. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_15251 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | The Effect of Scripts and Formats on LLM Numeracy Reddy, Varshini Schmidt, Craig W. Ebner, Seth Wiemerslage, Adam Pinter, Yuval Tanner, Chris Computation and Language Large language models (LLMs) have achieved impressive proficiency in basic arithmetic, rivaling human-level performance on standard numerical tasks. However, little attention has been given to how these models perform when numerical expressions deviate from the prevailing conventions present in their training corpora. In this work, we investigate numerical reasoning across a wide range of numeral scripts and formats. We show that LLM accuracy drops substantially when numerical inputs are rendered in underrepresented scripts or formats, despite the underlying mathematical reasoning being identical. We further demonstrate that targeted prompting strategies, such as few-shot prompting and explicit numeral mapping, can greatly narrow this gap. Our findings highlight an overlooked challenge in multilingual numerical reasoning and provide actionable insights for working with LLMs to reliably interpret, manipulate, and generate numbers across diverse numeral scripts and formatting styles. |
| title | The Effect of Scripts and Formats on LLM Numeracy |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.15251 |