Cover Image

Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tanna, Aditya, Bouarour, Nassim, Bouadi, Mohamed, Sankarapu, Vinay kumar, Seth, Pratinav
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Distilling Tabular Foundation Models for Structured Health Data
by: Tanna, Aditya, et al.
Published: (2026)

Ensembling Tabular Foundation Models - A Diversity Ceiling And A Calibration Trap
by: Tanna, Aditya, et al.
Published: (2026)

Data Presentation Over Architecture: Resampling Strategies for Credit Risk Prediction with Tabular Foundation Models
by: Tanna, Aditya, et al.
Published: (2026)

Orion-Bix: Bi-Axial Attention for Tabular In-Context Learning
by: Bouadi, Mohamed, et al.
Published: (2025)

Orion-MSP: Multi-Scale Sparse Attention for Tabular In-Context Learning
by: Bouadi, Mohamed, et al.
Published: (2025)

TabTune: A Unified Library for Inference and Fine-Tuning Tabular Foundation Models
by: Tanna, Aditya, et al.
Published: (2025)

Shaping the Prior: How Synthetic Task Distributions Determine Tabular Foundation Model Quality
by: Bouadi, Mohamed, et al.
Published: (2026)

Exploring Fine-Tuning for Tabular Foundation Models
by: Tanna, Aditya, et al.
Published: (2026)

Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands
by: Seth, Pratinav, et al.
Published: (2026)

Bridging the Gap in XAI-Why Reliable Metrics Matter for Explainability and Compliance
by: Seth, Pratinav, et al.
Published: (2025)

Interpretability as Alignment: Making Internal Understanding a Design Principle
by: Sengupta, Aadit, et al.
Published: (2025)

DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models
by: Sankarapu, Vinay Kumar, et al.
Published: (2024)

xai_evals : A Framework for Evaluating Post-Hoc Local Explanation Methods
by: Seth, Pratinav, et al.
Published: (2025)

Interpretability-Aware Pruning for Efficient Medical Image Analysis
by: Malik, Nikita, et al.
Published: (2025)

Forgetting That Sticks: Quantization-Permanent Unlearning via Circuit Attribution
by: Sadhu, Saisab, et al.
Published: (2026)

Beyond KL Divergence: Policy Optimization with Flexible Bregman Divergences for LLM Reasoning
by: Yuan, Rui, et al.
Published: (2026)

Microeconomic Foundations of Multi-Agent Learning
by: Helou, Nassim
Published: (2026)

Beyond Uniform Credit: Causal Credit Assignment for Policy Optimization
by: Khandoga, Mykola, et al.
Published: (2026)

Leveraging Knowlegde Graphs for Interpretable Feature Generation
by: Bouadi, Mohamed, et al.
Published: (2024)

$C$-$ΔΘ$: Circuit-Restricted Weight Arithmetic for Selective Refusal
by: Kasliwal, Aditya, et al.
Published: (2026)

UTBoost: Gradient Boosted Decision Trees for Uplift Modeling
by: Gao, Junjie, et al.
Published: (2023)

Supervised Score-Based Modeling by Gradient Boosting
by: Zhao, Changyuan, et al.
Published: (2024)

A Rectification-Based Approach for Distilling Boosted Trees into Decision Trees
by: Audemard, Gilles, et al.
Published: (2025)

SecureBoost+: Large Scale and High-Performance Vertical Federated Gradient Boosting Decision Tree
by: Fan, Tao, et al.
Published: (2021)

Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regression
by: Acero, Fernando, et al.
Published: (2024)

Gradient Boosting Reinforcement Learning
by: Fuhrer, Benjamin, et al.
Published: (2024)

Distilling Time Series Foundation Models for Efficient Forecasting
by: Li, Yuqi, et al.
Published: (2026)

TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models
by: Ye, Rongye, et al.
Published: (2026)

Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model
by: Liu, Zichang, et al.
Published: (2024)

Data-Efficient Symbolic Regression via Foundation Model Distillation
by: Ying, Wangyang, et al.
Published: (2025)

Fine-tuning Pocket-Aware Diffusion Models via Denoising Policy Optimization
by: Xue, Yuan, et al.
Published: (2026)

AXIL: Exact Instance Attribution for Gradient Boosting
by: Geertsema, Paul, et al.
Published: (2023)

From Entropy to Calibrated Uncertainty: Training Language Models to Reason About Uncertainty
by: Jenane, Azza, et al.
Published: (2026)

XGrad: Boosting Gradient-Based Optimizers With Weight Prediction
by: Guan, Lei, et al.
Published: (2023)

Gradient Boosting within a Single Attention Layer
by: Sargolzaei, Saleh
Published: (2026)

FPBoost: Fully Parametric Gradient Boosting for Survival Analysis
by: Archetti, Alberto, et al.
Published: (2024)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
by: Lu, Weigang, et al.
Published: (2024)

Foundation Model of Electronic Medical Records for Adaptive Risk Estimation
by: Renc, Pawel, et al.
Published: (2025)

Gradient Boosting Trees and Large Language Models for Tabular Data Few-Shot Learning
by: Huertas, Carlos
Published: (2024)

Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
by: Duan, Hanyu, et al.
Published: (2025)