Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.00086 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909980878176256 |
|---|---|
| author | Gao, Xiang Yao, Yuguang Zhang, Qi Dong, Kaiwen Baidya, Avinash Guo, Ruocheng Hasson, Hilaf Das, Kamalika |
| author_facet | Gao, Xiang Yao, Yuguang Zhang, Qi Dong, Kaiwen Baidya, Avinash Guo, Ruocheng Hasson, Hilaf Das, Kamalika |
| contents | Large language models (LLMs) often struggle to use tools reliably in domain-specific settings, where APIs may be idiosyncratic, under-documented, or tailored to private workflows. This highlights the need for effective adaptation to task-specific tools. We propose RIMRULE, a neuro-symbolic approach for LLM adaptation based on dynamic rule injection. Compact, interpretable rules are distilled from failure traces and injected into the prompt during inference to improve task performance. These rules are proposed by the LLM itself and consolidated using a Minimum Description Length (MDL) objective that favors generality and conciseness. Each rule is stored in both natural language and a structured symbolic form, supporting efficient retrieval at inference time. Experiments on tool-use benchmarks show that this approach improves accuracy on both seen and unseen tools without modifying LLM weights. It outperforms prompting-based adaptation methods and complements finetuning. Moreover, rules learned from one LLM can be reused to improve others, including long reasoning LLMs, highlighting the portability of symbolic knowledge across architectures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_00086 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning Gao, Xiang Yao, Yuguang Zhang, Qi Dong, Kaiwen Baidya, Avinash Guo, Ruocheng Hasson, Hilaf Das, Kamalika Computation and Language Large language models (LLMs) often struggle to use tools reliably in domain-specific settings, where APIs may be idiosyncratic, under-documented, or tailored to private workflows. This highlights the need for effective adaptation to task-specific tools. We propose RIMRULE, a neuro-symbolic approach for LLM adaptation based on dynamic rule injection. Compact, interpretable rules are distilled from failure traces and injected into the prompt during inference to improve task performance. These rules are proposed by the LLM itself and consolidated using a Minimum Description Length (MDL) objective that favors generality and conciseness. Each rule is stored in both natural language and a structured symbolic form, supporting efficient retrieval at inference time. Experiments on tool-use benchmarks show that this approach improves accuracy on both seen and unseen tools without modifying LLM weights. It outperforms prompting-based adaptation methods and complements finetuning. Moreover, rules learned from one LLM can be reused to improve others, including long reasoning LLMs, highlighting the portability of symbolic knowledge across architectures. |
| title | RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.00086 |