Puzzle Solving using Reasoning of Large Language Models: A Survey
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918108877291520 |
|---|---|
| author | Giadikiaroglou, Panagiotis Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos |
| author_facet | Giadikiaroglou, Panagiotis Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos |
| contents | Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning tasks. This survey leverages a unique taxonomy -- dividing puzzles into rule-based and rule-less categories -- to critically assess LLMs through various methodologies, including prompting techniques, neuro-symbolic approaches, and fine-tuning. Through a critical review of relevant datasets and benchmarks, we assess LLMs' performance, identifying significant challenges in complex puzzle scenarios. Our findings highlight the disparity between LLM capabilities and human-like reasoning, particularly in those requiring advanced logical inference. The survey underscores the necessity for novel strategies and richer datasets to advance LLMs' puzzle-solving proficiency and contribute to AI's logical reasoning and creative problem-solving advancements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_11291 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Puzzle Solving using Reasoning of Large Language Models: A Survey Giadikiaroglou, Panagiotis Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos Computation and Language Artificial Intelligence Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning tasks. This survey leverages a unique taxonomy -- dividing puzzles into rule-based and rule-less categories -- to critically assess LLMs through various methodologies, including prompting techniques, neuro-symbolic approaches, and fine-tuning. Through a critical review of relevant datasets and benchmarks, we assess LLMs' performance, identifying significant challenges in complex puzzle scenarios. Our findings highlight the disparity between LLM capabilities and human-like reasoning, particularly in those requiring advanced logical inference. The survey underscores the necessity for novel strategies and richer datasets to advance LLMs' puzzle-solving proficiency and contribute to AI's logical reasoning and creative problem-solving advancements. |
| title | Puzzle Solving using Reasoning of Large Language Models: A Survey |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2402.11291 |