Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhou, Tianyang, Chen, Wenbo, Liang, Pierre Jinghong, Akoglu, Leman
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914611625721856
author Zhou, Tianyang
Chen, Wenbo
Liang, Pierre Jinghong
Akoglu, Leman
author_facet Zhou, Tianyang
Chen, Wenbo
Liang, Pierre Jinghong
Akoglu, Leman
contents LLMs have advanced text classification, yet existing paradigms face a trade-off: supervised (label only) fine-tuning is scalable but offers limited reasoning on complex text and lacks broader model transparency, while discrete prompt optimization offers human-readable instructions but struggles with performance and scalability. We introduce eXTC (eXplainable Text Classifier) with three progressive stages: (1) learning a Standard Operating Procedure (SOP, or rulebook) in natural language via a new Structured Prompt Optimization algorithm; (2) SOP-grounded reasoning distillation from a large teacher LLM into a compact LM; and (3) expanding reasoning capabilities beyond the initial SOP via reinforcement learning. This design enables eXTC to provide (i) fast inference via a compact LM, with (ii) inference-time local reasoning traces, alongside a global, modular explanation of its learned domain rules, while (iii) significantly outperforming existing paradigms across diverse benchmarks in both classification performance and explanation quality, with stage-by-stage gains.
format Preprint
id arxiv_https___arxiv_org_abs_2605_29076
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text
Zhou, Tianyang
Chen, Wenbo
Liang, Pierre Jinghong
Akoglu, Leman
Computation and Language
Artificial Intelligence
Machine Learning
I.2.7; I.2.6
LLMs have advanced text classification, yet existing paradigms face a trade-off: supervised (label only) fine-tuning is scalable but offers limited reasoning on complex text and lacks broader model transparency, while discrete prompt optimization offers human-readable instructions but struggles with performance and scalability. We introduce eXTC (eXplainable Text Classifier) with three progressive stages: (1) learning a Standard Operating Procedure (SOP, or rulebook) in natural language via a new Structured Prompt Optimization algorithm; (2) SOP-grounded reasoning distillation from a large teacher LLM into a compact LM; and (3) expanding reasoning capabilities beyond the initial SOP via reinforcement learning. This design enables eXTC to provide (i) fast inference via a compact LM, with (ii) inference-time local reasoning traces, alongside a global, modular explanation of its learned domain rules, while (iii) significantly outperforming existing paradigms across diverse benchmarks in both classification performance and explanation quality, with stage-by-stage gains.
title Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text
topic Computation and Language
Artificial Intelligence
Machine Learning
I.2.7; I.2.6
url https://arxiv.org/abs/2605.29076