LIFT: Last-Mile Fine-Tuning for Table Explicitation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khaitan, Divij, Tiwari, Ashish
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913123067232256
author Khaitan, Divij
Tiwari, Ashish
author_facet Khaitan, Divij
Tiwari, Ashish
contents We propose last-mile fine-tuning, or Lift, a pipeline in which a pre-trained large language model extracts an initial table from unstructured clipboard text, and a fine-tuned small language model (1B-24B parameters SLM) repairs errors in the extracted table. On a benchmark of 2,596 tables from three datasets, Lift matches or exceeds end-to-end SLM fine-tuning on tree-edit-distance-based similarity (TEDS) metric while requiring as little as 1,000 training examples - where it outperforms end-to-end fine-tuning by up to 0.144 TEDS points. We term this approach last-mile fine-tuning and show it also more robust to input format variability. Comparisons with self-debug and end-to-end fine-tuning approaches show that last-mile fine-tuning provides an attractive option when training data is limited or when robustness to input variation is sought without compromising on accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2605_13424
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LIFT: Last-Mile Fine-Tuning for Table Explicitation
Khaitan, Divij
Tiwari, Ashish
Machine Learning
Computation and Language
We propose last-mile fine-tuning, or Lift, a pipeline in which a pre-trained large language model extracts an initial table from unstructured clipboard text, and a fine-tuned small language model (1B-24B parameters SLM) repairs errors in the extracted table. On a benchmark of 2,596 tables from three datasets, Lift matches or exceeds end-to-end SLM fine-tuning on tree-edit-distance-based similarity (TEDS) metric while requiring as little as 1,000 training examples - where it outperforms end-to-end fine-tuning by up to 0.144 TEDS points. We term this approach last-mile fine-tuning and show it also more robust to input format variability. Comparisons with self-debug and end-to-end fine-tuning approaches show that last-mile fine-tuning provides an attractive option when training data is limited or when robustness to input variation is sought without compromising on accuracy.
title LIFT: Last-Mile Fine-Tuning for Table Explicitation
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2605.13424