Beyond Fast and Slow: Cognitive-Inspired Elastic Reasoning for Large Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hu, Jinwu, Yang, Dongjin, Bian, Langyu, Wen, Zhiquan, Wang, Yufeng, Chen, Yaofo, Xiao, Bin, Li, Yuanqing, Tan, Mingkui
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917210987954176
author Hu, Jinwu
Yang, Dongjin
Bian, Langyu
Wen, Zhiquan
Wang, Yufeng
Chen, Yaofo
Xiao, Bin
Li, Yuanqing
Tan, Mingkui
author_facet Hu, Jinwu
Yang, Dongjin
Bian, Langyu
Wen, Zhiquan
Wang, Yufeng
Chen, Yaofo
Xiao, Bin
Li, Yuanqing
Tan, Mingkui
contents Large language models (LLMs) have demonstrated impressive performance across various language tasks. However, existing LLM reasoning strategies mainly rely on the LLM itself with fast or slow mode (like o1 thinking) and thus struggle to balance reasoning efficiency and accuracy across queries of varying difficulties. In this paper, we propose Cognitive-Inspired Elastic Reasoning (CogER), a framework inspired by human hierarchical reasoning that dynamically selects the most suitable reasoning strategy for each query. Specifically, CogER first assesses the complexity of incoming queries and assigns them to one of several predefined levels, each corresponding to a tailored processing strategy, thereby addressing the challenge of unobservable query difficulty. To achieve automatic strategy selection, we model the process as a Markov Decision Process and train a CogER-Agent using reinforcement learning. The agent is guided by a reward function that balances solution quality and computational cost, ensuring resource-efficient reasoning. Moreover, for queries requiring external tools, we introduce Cognitive Tool-Assisted Reasoning, which enables the LLM to autonomously invoke external tools within its chain-of-thought. Extensive experiments demonstrate that CogER outperforms state-of-the-art Test-Time scaling methods, achieving at least a 13% relative improvement in average exact match on In-Domain tasks and an 8% relative gain on Out-of-Domain tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2512_15089
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Beyond Fast and Slow: Cognitive-Inspired Elastic Reasoning for Large Language Models
Hu, Jinwu
Yang, Dongjin
Bian, Langyu
Wen, Zhiquan
Wang, Yufeng
Chen, Yaofo
Xiao, Bin
Li, Yuanqing
Tan, Mingkui
Artificial Intelligence
Large language models (LLMs) have demonstrated impressive performance across various language tasks. However, existing LLM reasoning strategies mainly rely on the LLM itself with fast or slow mode (like o1 thinking) and thus struggle to balance reasoning efficiency and accuracy across queries of varying difficulties. In this paper, we propose Cognitive-Inspired Elastic Reasoning (CogER), a framework inspired by human hierarchical reasoning that dynamically selects the most suitable reasoning strategy for each query. Specifically, CogER first assesses the complexity of incoming queries and assigns them to one of several predefined levels, each corresponding to a tailored processing strategy, thereby addressing the challenge of unobservable query difficulty. To achieve automatic strategy selection, we model the process as a Markov Decision Process and train a CogER-Agent using reinforcement learning. The agent is guided by a reward function that balances solution quality and computational cost, ensuring resource-efficient reasoning. Moreover, for queries requiring external tools, we introduce Cognitive Tool-Assisted Reasoning, which enables the LLM to autonomously invoke external tools within its chain-of-thought. Extensive experiments demonstrate that CogER outperforms state-of-the-art Test-Time scaling methods, achieving at least a 13% relative improvement in average exact match on In-Domain tasks and an 8% relative gain on Out-of-Domain tasks.
title Beyond Fast and Slow: Cognitive-Inspired Elastic Reasoning for Large Language Models
topic Artificial Intelligence
url https://arxiv.org/abs/2512.15089