ACT: Agentic Classification Tree

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Grari, Vincent, Arni, Tim, Laugel, Thibault, Lamprier, Sylvain, Zou, James, Detyniecki, Marcin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908938013769728
author Grari, Vincent
Arni, Tim
Laugel, Thibault
Lamprier, Sylvain
Zou, James
Detyniecki, Marcin
author_facet Grari, Vincent
Arni, Tim
Laugel, Thibault
Lamprier, Sylvain
Zou, James
Detyniecki, Marcin
contents When used in high-stakes settings, AI systems are expected to produce decisions that are transparent, interpretable and auditable, a requirement increasingly expected by regulations. Decision trees such as CART provide clear and verifiable rules, but they are restricted to structured tabular data and cannot operate directly on unstructured inputs such as text. In practice, large language models (LLMs) are widely used for such data, yet prompting strategies such as chain-of-thought or prompt optimization still rely on free-form reasoning, limiting their ability to ensure trustworthy behaviors. We present the Agentic Classification Tree (ACT), which extends decision-tree methodology to unstructured inputs by formulating each split as a natural-language question, refined through impurity-based evaluation and LLM feedback via TextGrad. Experiments on text benchmarks show that ACT matches or surpasses prompting-based baselines while producing transparent and interpretable decision paths.
format Preprint
id arxiv_https___arxiv_org_abs_2509_26433
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ACT: Agentic Classification Tree
Grari, Vincent
Arni, Tim
Laugel, Thibault
Lamprier, Sylvain
Zou, James
Detyniecki, Marcin
Machine Learning
Artificial Intelligence
When used in high-stakes settings, AI systems are expected to produce decisions that are transparent, interpretable and auditable, a requirement increasingly expected by regulations. Decision trees such as CART provide clear and verifiable rules, but they are restricted to structured tabular data and cannot operate directly on unstructured inputs such as text. In practice, large language models (LLMs) are widely used for such data, yet prompting strategies such as chain-of-thought or prompt optimization still rely on free-form reasoning, limiting their ability to ensure trustworthy behaviors. We present the Agentic Classification Tree (ACT), which extends decision-tree methodology to unstructured inputs by formulating each split as a natural-language question, refined through impurity-based evaluation and LLM feedback via TextGrad. Experiments on text benchmarks show that ACT matches or surpasses prompting-based baselines while producing transparent and interpretable decision paths.
title ACT: Agentic Classification Tree
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2509.26433