Why Should the Server Do It All?: A Scalable, Versatile, and Model-Agnostic Framework for Server-Light DNN Inference over Massively Distributed Clients via Training-Free Intermediate Feature Compression

Documenti analoghi

• Range Asymmetric Numeral Systems-Based Lightweight Intermediate Feature Compression for Split Computing of Deep Neural Networks
  di: Sung, Mingyu, et al.
  Pubblicazione: (2025)
• Memory- and Latency-Constrained Inference of Large Language Models via Adaptive Split Computing
  di: Sung, Mingyu, et al.
  Pubblicazione: (2025)
• No Pose Estimation? No Problem: Pose-Agnostic and Instance-Aware Test-Time Adaptation for Monocular Depth Estimation
  di: Sung, Mingyu, et al.
  Pubblicazione: (2025)
• H2-Cache: A Novel Hierarchical Dual-Stage Cache for High-Performance Acceleration of Generative Diffusion Models
  di: Sung, Mingyu, et al.
  Pubblicazione: (2025)
• Beyond Inference: Performance Analysis of DNN Server Overheads for Computer Vision
  di: AbouElhamayed, Ahmed F., et al.
  Pubblicazione: (2024)