H3PIMAP: A Heterogeneity-Aware Multi-Objective DNN Mapping Framework on Electronic-Photonic Processing-in-Memory Architectures

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yin, Ziang, Poonia, Aashish, Bommana, Ashish Reddy, Zhao, Xinyu, Hojati, Zahra, Chen, Tianlong, Chakrabarty, Krishnendu, Firouzi, Farshad, Zhang, Jeff, Gu, Jiaqi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911370481500160
author Yin, Ziang
Poonia, Aashish
Bommana, Ashish Reddy
Zhao, Xinyu
Hojati, Zahra
Chen, Tianlong
Chakrabarty, Krishnendu
Firouzi, Farshad
Zhang, Jeff
Gu, Jiaqi
author_facet Yin, Ziang
Poonia, Aashish
Bommana, Ashish Reddy
Zhao, Xinyu
Hojati, Zahra
Chen, Tianlong
Chakrabarty, Krishnendu
Firouzi, Farshad
Zhang, Jeff
Gu, Jiaqi
contents The future of artificial intelligence (AI) acceleration demands a paradigm shift beyond the limitations of purely electronic or photonic architectures. Photonic analog computing delivers unmatched speed and parallelism but struggles with data movement, robustness, and precision, while electronic processing-in-memory (PIM) enables energy-efficient computing by co-locating storage and computation but suffers from endurance and reconfiguration constraints, limiting it to static weight mapping. Neither approach alone achieves the balance needed for adaptive, efficient AI. To break this impasse, we study a hybrid electronic-photonic-PIM computing architecture and introduce H3PIMAP, a heterogeneity-aware mapping framework that seamlessly orchestrates workloads across electronic and optical tiers. By optimizing workload partitioning through a two-stage multi-objective exploration method, H3PIMAP harnesses light speed for high-throughput operations and PIM efficiency for memory-bound tasks. In system-level evaluations, H3PIMAP delivers a 3.32x latency reduction across language and vision models and, on large language models, achieves 77.0% lower latency with 14.6% lower energy at matched quality, outperforming homogeneous and naive mapping strategies. This proposed framework lays the foundation for hybrid AI accelerators, bridging the gap between electronic and photonic computation for next-generation efficiency and scalability.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07778
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle H3PIMAP: A Heterogeneity-Aware Multi-Objective DNN Mapping Framework on Electronic-Photonic Processing-in-Memory Architectures
Yin, Ziang
Poonia, Aashish
Bommana, Ashish Reddy
Zhao, Xinyu
Hojati, Zahra
Chen, Tianlong
Chakrabarty, Krishnendu
Firouzi, Farshad
Zhang, Jeff
Gu, Jiaqi
Hardware Architecture
Emerging Technologies
The future of artificial intelligence (AI) acceleration demands a paradigm shift beyond the limitations of purely electronic or photonic architectures. Photonic analog computing delivers unmatched speed and parallelism but struggles with data movement, robustness, and precision, while electronic processing-in-memory (PIM) enables energy-efficient computing by co-locating storage and computation but suffers from endurance and reconfiguration constraints, limiting it to static weight mapping. Neither approach alone achieves the balance needed for adaptive, efficient AI. To break this impasse, we study a hybrid electronic-photonic-PIM computing architecture and introduce H3PIMAP, a heterogeneity-aware mapping framework that seamlessly orchestrates workloads across electronic and optical tiers. By optimizing workload partitioning through a two-stage multi-objective exploration method, H3PIMAP harnesses light speed for high-throughput operations and PIM efficiency for memory-bound tasks. In system-level evaluations, H3PIMAP delivers a 3.32x latency reduction across language and vision models and, on large language models, achieves 77.0% lower latency with 14.6% lower energy at matched quality, outperforming homogeneous and naive mapping strategies. This proposed framework lays the foundation for hybrid AI accelerators, bridging the gap between electronic and photonic computation for next-generation efficiency and scalability.
title H3PIMAP: A Heterogeneity-Aware Multi-Objective DNN Mapping Framework on Electronic-Photonic Processing-in-Memory Architectures
topic Hardware Architecture
Emerging Technologies
url https://arxiv.org/abs/2503.07778