Order Doesn't Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914143047516160 |
|---|---|
| author | He, Qianxi He, Qianyu Liang, Jiaqing Xiao, Yanghua Zhou, Weikang Sun, Zeye Yu, Fei |
| author_facet | He, Qianxi He, Qianyu Liang, Jiaqing Xiao, Yanghua Zhou, Weikang Sun, Zeye Yu, Fei |
| contents | Logical reasoning is essential for large language models (LLMs) to ensure accurate and coherent inference. However, LLMs struggle with reasoning order variations and fail to generalize across logically equivalent transformations. LLMs often rely on fixed sequential patterns rather than true logical understanding. To address this issue, we introduce an order-centric data augmentation framework based on commutativity in logical reasoning. We first randomly shuffle independent premises to introduce condition order augmentation. For reasoning steps, we construct a directed acyclic graph (DAG) to model dependencies between steps, which allows us to identify valid reorderings of steps while preserving logical correctness. By leveraging order-centric augmentations, models can develop a more flexible and generalized reasoning process. Finally, we conduct extensive experiments across multiple logical reasoning benchmarks, demonstrating that our method significantly enhances LLMs' reasoning performance and adaptability to diverse logical structures. We release our codes and augmented data in https://github.com/qianxiHe147/Order-Centric-Data-Augmentation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19907 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Order Doesn't Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation He, Qianxi He, Qianyu Liang, Jiaqing Xiao, Yanghua Zhou, Weikang Sun, Zeye Yu, Fei Computation and Language Artificial Intelligence Logical reasoning is essential for large language models (LLMs) to ensure accurate and coherent inference. However, LLMs struggle with reasoning order variations and fail to generalize across logically equivalent transformations. LLMs often rely on fixed sequential patterns rather than true logical understanding. To address this issue, we introduce an order-centric data augmentation framework based on commutativity in logical reasoning. We first randomly shuffle independent premises to introduce condition order augmentation. For reasoning steps, we construct a directed acyclic graph (DAG) to model dependencies between steps, which allows us to identify valid reorderings of steps while preserving logical correctness. By leveraging order-centric augmentations, models can develop a more flexible and generalized reasoning process. Finally, we conduct extensive experiments across multiple logical reasoning benchmarks, demonstrating that our method significantly enhances LLMs' reasoning performance and adaptability to diverse logical structures. We release our codes and augmented data in https://github.com/qianxiHe147/Order-Centric-Data-Augmentation. |
| title | Order Doesn't Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2502.19907 |