Reliable edge machine learning hardware for scientific applications

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Baldi, Tommaso, Campos, Javier, Hawks, Ben, Ngadiuba, Jennifer, Tran, Nhan, Diaz, Daniel, Duarte, Javier, Kastner, Ryan, Meza, Andres, Quinnan, Melissa, Weng, Olivia, Geniesse, Caleb, Gholami, Amir, Mahoney, Michael W., Loncar, Vladimir, Harris, Philip, Agar, Joshua, Qin, Shuyu
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913407017418752
author Baldi, Tommaso
Campos, Javier
Hawks, Ben
Ngadiuba, Jennifer
Tran, Nhan
Diaz, Daniel
Duarte, Javier
Kastner, Ryan
Meza, Andres
Quinnan, Melissa
Weng, Olivia
Geniesse, Caleb
Gholami, Amir
Mahoney, Michael W.
Loncar, Vladimir
Harris, Philip
Agar, Joshua
Qin, Shuyu
author_facet Baldi, Tommaso
Campos, Javier
Hawks, Ben
Ngadiuba, Jennifer
Tran, Nhan
Diaz, Daniel
Duarte, Javier
Kastner, Ryan
Meza, Andres
Quinnan, Melissa
Weng, Olivia
Geniesse, Caleb
Gholami, Amir
Mahoney, Michael W.
Loncar, Vladimir
Harris, Philip
Agar, Joshua
Qin, Shuyu
contents Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2406_19522
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reliable edge machine learning hardware for scientific applications
Baldi, Tommaso
Campos, Javier
Hawks, Ben
Ngadiuba, Jennifer
Tran, Nhan
Diaz, Daniel
Duarte, Javier
Kastner, Ryan
Meza, Andres
Quinnan, Melissa
Weng, Olivia
Geniesse, Caleb
Gholami, Amir
Mahoney, Michael W.
Loncar, Vladimir
Harris, Philip
Agar, Joshua
Qin, Shuyu
Machine Learning
Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery.
title Reliable edge machine learning hardware for scientific applications
topic Machine Learning
url https://arxiv.org/abs/2406.19522