JoLT: Joint Probabilistic Predictions on Tabular Data Using LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912233999564800 |
|---|---|
| author | Shysheya, Aliaksandra Bronskill, John Requeima, James Siddiqui, Shoaib Ahmed Gonzalez, Javier Duvenaud, David Turner, Richard E. |
| author_facet | Shysheya, Aliaksandra Bronskill, John Requeima, James Siddiqui, Shoaib Ahmed Gonzalez, Javier Duvenaud, David Turner, Richard E. |
| contents | We introduce a simple method for probabilistic predictions on tabular data based on Large Language Models (LLMs) called JoLT (Joint LLM Process for Tabular data). JoLT uses the in-context learning capabilities of LLMs to define joint distributions over tabular data conditioned on user-specified side information about the problem, exploiting the vast repository of latent problem-relevant knowledge encoded in LLMs. JoLT defines joint distributions for multiple target variables with potentially heterogeneous data types without any data conversion, data preprocessing, special handling of missing data, or model training, making it accessible and efficient for practitioners. Our experiments show that JoLT outperforms competitive methods on low-shot single-target and multi-target tabular classification and regression tasks. Furthermore, we show that JoLT can automatically handle missing data and perform data imputation by leveraging textual side information. We argue that due to its simplicity and generality, JoLT is an effective approach for a wide variety of real prediction problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_11877 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | JoLT: Joint Probabilistic Predictions on Tabular Data Using LLMs Shysheya, Aliaksandra Bronskill, John Requeima, James Siddiqui, Shoaib Ahmed Gonzalez, Javier Duvenaud, David Turner, Richard E. Machine Learning We introduce a simple method for probabilistic predictions on tabular data based on Large Language Models (LLMs) called JoLT (Joint LLM Process for Tabular data). JoLT uses the in-context learning capabilities of LLMs to define joint distributions over tabular data conditioned on user-specified side information about the problem, exploiting the vast repository of latent problem-relevant knowledge encoded in LLMs. JoLT defines joint distributions for multiple target variables with potentially heterogeneous data types without any data conversion, data preprocessing, special handling of missing data, or model training, making it accessible and efficient for practitioners. Our experiments show that JoLT outperforms competitive methods on low-shot single-target and multi-target tabular classification and regression tasks. Furthermore, we show that JoLT can automatically handle missing data and perform data imputation by leveraging textual side information. We argue that due to its simplicity and generality, JoLT is an effective approach for a wide variety of real prediction problems. |
| title | JoLT: Joint Probabilistic Predictions on Tabular Data Using LLMs |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2502.11877 |