Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhou, Jin Peng, Staats, Charles, Li, Wenda, Szegedy, Christian, Weinberger, Kilian Q., Wu, Yuhuai
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909152201146368
author Zhou, Jin Peng
Staats, Charles
Li, Wenda
Szegedy, Christian
Weinberger, Kilian Q.
Wu, Yuhuai
author_facet Zhou, Jin Peng
Staats, Charles
Li, Wenda
Szegedy, Christian
Weinberger, Kilian Q.
Wu, Yuhuai
contents Large language models (LLM), such as Google's Minerva and OpenAI's GPT families, are becoming increasingly capable of solving mathematical quantitative reasoning problems. However, they still make unjustified logical and computational errors in their reasoning steps and answers. In this paper, we leverage the fact that if the training corpus of LLMs contained sufficiently many examples of formal mathematics (e.g. in Isabelle, a formal theorem proving environment), they can be prompted to translate i.e. autoformalize informal mathematical statements into formal Isabelle code -- which can be verified automatically for internal consistency. This provides a mechanism to automatically reject solutions whose formalized versions are inconsistent within themselves or with the formalized problem statement. We evaluate our method on GSM8K, MATH and MultiArith datasets and demonstrate that our approach provides a consistently better heuristic than vanilla majority voting -- the previously best method to identify correct answers, by more than 12% on GSM8K. In our experiments it improves results consistently across all datasets and LLM model sizes. The code can be found at https://github.com/jinpz/dtv.
format Preprint
id arxiv_https___arxiv_org_abs_2403_18120
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization
Zhou, Jin Peng
Staats, Charles
Li, Wenda
Szegedy, Christian
Weinberger, Kilian Q.
Wu, Yuhuai
Artificial Intelligence
Computation and Language
Machine Learning
Large language models (LLM), such as Google's Minerva and OpenAI's GPT families, are becoming increasingly capable of solving mathematical quantitative reasoning problems. However, they still make unjustified logical and computational errors in their reasoning steps and answers. In this paper, we leverage the fact that if the training corpus of LLMs contained sufficiently many examples of formal mathematics (e.g. in Isabelle, a formal theorem proving environment), they can be prompted to translate i.e. autoformalize informal mathematical statements into formal Isabelle code -- which can be verified automatically for internal consistency. This provides a mechanism to automatically reject solutions whose formalized versions are inconsistent within themselves or with the formalized problem statement. We evaluate our method on GSM8K, MATH and MultiArith datasets and demonstrate that our approach provides a consistently better heuristic than vanilla majority voting -- the previously best method to identify correct answers, by more than 12% on GSM8K. In our experiments it improves results consistently across all datasets and LLM model sizes. The code can be found at https://github.com/jinpz/dtv.
title Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization
topic Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2403.18120