T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908554023141376 |
|---|---|
| author | Zhang, Jie Pan, Changzai Wei, Kaiwen Xiong, Sishi Zhao, Yu Li, Xiangyu Peng, Jiaxin Gu, Xiaoyan Yang, Jian Chang, Wenhan Wu, Zhenhe Zhong, Jiang Song, Shuangyong Li, Yongxiang Li, Xuelong |
| author_facet | Zhang, Jie Pan, Changzai Wei, Kaiwen Xiong, Sishi Zhao, Yu Li, Xiangyu Peng, Jiaxin Gu, Xiaoyan Yang, Jian Chang, Wenhan Wu, Zhenhe Zhong, Jiang Song, Shuangyong Li, Yongxiang Li, Xuelong |
| contents | Extensive research has been conducted to explore the capabilities of large language models (LLMs) in table reasoning. However, the essential task of transforming tables information into reports remains a significant challenge for industrial applications. This task is plagued by two critical issues: 1) the complexity and diversity of tables lead to suboptimal reasoning outcomes; and 2) existing table benchmarks lack the capacity to adequately assess the practical application of this task. To fill this gap, we propose the table-to-report task and construct a bilingual benchmark named T2R-bench, where the key information flow from the tables to the reports for this task. The benchmark comprises 457 industrial tables, all derived from real-world scenarios and encompassing 19 industry domains as well as 4 types of industrial tables. Furthermore, we propose an evaluation criteria to fairly measure the quality of report generation. The experiments on 25 widely-used LLMs reveal that even state-of-the-art models like Deepseek-R1 only achieves performance with 62.71 overall score, indicating that LLMs still have room for improvement on T2R-bench. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_19813 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables Zhang, Jie Pan, Changzai Wei, Kaiwen Xiong, Sishi Zhao, Yu Li, Xiangyu Peng, Jiaxin Gu, Xiaoyan Yang, Jian Chang, Wenhan Wu, Zhenhe Zhong, Jiang Song, Shuangyong Li, Yongxiang Li, Xuelong Computation and Language Extensive research has been conducted to explore the capabilities of large language models (LLMs) in table reasoning. However, the essential task of transforming tables information into reports remains a significant challenge for industrial applications. This task is plagued by two critical issues: 1) the complexity and diversity of tables lead to suboptimal reasoning outcomes; and 2) existing table benchmarks lack the capacity to adequately assess the practical application of this task. To fill this gap, we propose the table-to-report task and construct a bilingual benchmark named T2R-bench, where the key information flow from the tables to the reports for this task. The benchmark comprises 457 industrial tables, all derived from real-world scenarios and encompassing 19 industry domains as well as 4 types of industrial tables. Furthermore, we propose an evaluation criteria to fairly measure the quality of report generation. The experiments on 25 widely-used LLMs reveal that even state-of-the-art models like Deepseek-R1 only achieves performance with 62.71 overall score, indicating that LLMs still have room for improvement on T2R-bench. |
| title | T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2508.19813 |