GPTree: Towards Explainable Decision-Making via LLM-powered Decision Trees

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xiong, Sichao, Ihlamur, Yigit, Alican, Fuat, Yin, Aaron Ontoyin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912116941783040
author Xiong, Sichao
Ihlamur, Yigit
Alican, Fuat
Yin, Aaron Ontoyin
author_facet Xiong, Sichao
Ihlamur, Yigit
Alican, Fuat
Yin, Aaron Ontoyin
contents Traditional decision tree algorithms are explainable but struggle with non-linear, high-dimensional data, limiting its applicability in complex decision-making. Neural networks excel at capturing complex patterns but sacrifice explainability in the process. In this work, we present GPTree, a novel framework combining explainability of decision trees with the advanced reasoning capabilities of LLMs. GPTree eliminates the need for feature engineering and prompt chaining, requiring only a task-specific prompt and leveraging a tree-based structure to dynamically split samples. We also introduce an expert-in-the-loop feedback mechanism to further enhance performance by enabling human intervention to refine and rebuild decision paths, emphasizing the harmony between human expertise and machine intelligence. Our decision tree achieved a 7.8% precision rate for identifying "unicorn" startups at the inception stage of a startup, surpassing gpt-4o with few-shot learning as well as the best human decision-makers (3.1% to 5.6%).
format Preprint
id arxiv_https___arxiv_org_abs_2411_08257
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GPTree: Towards Explainable Decision-Making via LLM-powered Decision Trees
Xiong, Sichao
Ihlamur, Yigit
Alican, Fuat
Yin, Aaron Ontoyin
Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
Traditional decision tree algorithms are explainable but struggle with non-linear, high-dimensional data, limiting its applicability in complex decision-making. Neural networks excel at capturing complex patterns but sacrifice explainability in the process. In this work, we present GPTree, a novel framework combining explainability of decision trees with the advanced reasoning capabilities of LLMs. GPTree eliminates the need for feature engineering and prompt chaining, requiring only a task-specific prompt and leveraging a tree-based structure to dynamically split samples. We also introduce an expert-in-the-loop feedback mechanism to further enhance performance by enabling human intervention to refine and rebuild decision paths, emphasizing the harmony between human expertise and machine intelligence. Our decision tree achieved a 7.8% precision rate for identifying "unicorn" startups at the inception stage of a startup, surpassing gpt-4o with few-shot learning as well as the best human decision-makers (3.1% to 5.6%).
title GPTree: Towards Explainable Decision-Making via LLM-powered Decision Trees
topic Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2411.08257