Saved in:
Bibliographic Details
Main Authors: Herrmann, Nina, Stenkamp, Jan, Karic, Benjamin, Oehmcke, Stefan, Gieseke, Fabian
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.26557
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Deploying machine learning models on compute-constrained devices has become a key building block of modern IoT applications. In this work, we present a compression scheme for boosted decision trees, addressing the growing need for lightweight machine learning models. Specifically, we provide techniques for training compact boosted decision tree ensembles that exhibit a reduced memory footprint by rewarding, among other things, the reuse of features and thresholds during training. Our experimental evaluation shows that models achieved the same performance with a compression ratio of 4-16x compared to LightGBM models using an adapted training process and an alternative memory layout. Once deployed, the corresponding IoT devices can operate independently of constant communication or external energy supply, and, thus, autonomously, requiring only minimal computing power and energy. This capability opens the door to a wide range of IoT applications, including remote monitoring, edge analytics, and real-time decision making in isolated or power-limited environments.