On-device Training: A First Overview on Existing Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Shuai, Voigt, Thiemo, Ko, JeongGil, Rahimian, Fatemeh
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913513203564544
author Zhu, Shuai
Voigt, Thiemo
Ko, JeongGil
Rahimian, Fatemeh
author_facet Zhu, Shuai
Voigt, Thiemo
Ko, JeongGil
Rahimian, Fatemeh
contents The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed the design and development of various intelligent systems over wide application domains. While most existing machine learning models require large memory and computing power, efforts have been made to deploy some models on resource-constrained devices as well. A majority of the early application systems focused on exploiting the inference capabilities of ML and DL models, where data captured from different mobile and embedded sensing components are processed through these models for application goals such as classification and segmentation. More recently, the concept of exploiting the mobile and embedded computing resources for ML/DL model training has gained attention, as such capabilities allow (i) the training of models via local data without the need to share data over wireless links, thus enabling privacy-preserving computation by design, (ii) model personalization and environment adaptation, and (ii) deployment of accurate models in remote and hardly accessible locations without stable internet connectivity. This work targets to summarize and analyze state-of-the-art systems research that allows such on-device model training capabilities and provide a survey of on-device training from a systems perspective.
format Preprint
id arxiv_https___arxiv_org_abs_2212_00824
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle On-device Training: A First Overview on Existing Systems
Zhu, Shuai
Voigt, Thiemo
Ko, JeongGil
Rahimian, Fatemeh
Machine Learning
The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed the design and development of various intelligent systems over wide application domains. While most existing machine learning models require large memory and computing power, efforts have been made to deploy some models on resource-constrained devices as well. A majority of the early application systems focused on exploiting the inference capabilities of ML and DL models, where data captured from different mobile and embedded sensing components are processed through these models for application goals such as classification and segmentation. More recently, the concept of exploiting the mobile and embedded computing resources for ML/DL model training has gained attention, as such capabilities allow (i) the training of models via local data without the need to share data over wireless links, thus enabling privacy-preserving computation by design, (ii) model personalization and environment adaptation, and (ii) deployment of accurate models in remote and hardly accessible locations without stable internet connectivity. This work targets to summarize and analyze state-of-the-art systems research that allows such on-device model training capabilities and provide a survey of on-device training from a systems perspective.
title On-device Training: A First Overview on Existing Systems
topic Machine Learning
url https://arxiv.org/abs/2212.00824