Copertina

Systematic Optimization of Real-Time Diffusion Model Inference on Apple M3 Ultra

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Ochiai, Yoichi
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A Survey on Inference Optimization Techniques for Mixture of Experts Models
di: Liu, Jiacheng, et al.
Pubblicazione: (2024)

Enhancing Cluster Scheduling in HPC: A Continuous Transfer Learning for Real-Time Optimization
di: Sliwko, Leszek, et al.
Pubblicazione: (2025)

Metal-Sci: A Scientific Compute Benchmark for Evolutionary LLM Kernel Search on Apple Silicon
di: Gallego, Víctor
Pubblicazione: (2026)

EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge
di: Mounesan, Motahare, et al.
Pubblicazione: (2024)

Enhancing Large-Scale AI Training Efficiency: The C4 Solution for Real-Time Anomaly Detection and Communication Optimization
di: Dong, Jianbo, et al.
Pubblicazione: (2024)

Distributed Graph Neural Network Inference With Just-In-Time Compilation For Industry-Scale Graphs
di: Wu, Xiabao, et al.
Pubblicazione: (2025)

SwiftDiffusion: Efficient Diffusion Model Serving with Add-on Modules
di: Li, Suyi, et al.
Pubblicazione: (2024)

Accelerating MoE Model Inference with Expert Sharding
di: Balmau, Oana, et al.
Pubblicazione: (2025)

EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism
di: Chen, Yanxi, et al.
Pubblicazione: (2023)

Meta-Learning for Speeding Up Large Model Inference in Decentralized Environments
di: Yang, Yuzhe, et al.
Pubblicazione: (2024)

Hermes: Memory-Efficient Pipeline Inference for Large Models on Edge Devices
di: Han, Xueyuan, et al.
Pubblicazione: (2024)

Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
di: Li, Yang, et al.
Pubblicazione: (2025)

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
di: Yao, Jinghan, et al.
Pubblicazione: (2024)

FSD-Inference: Fully Serverless Distributed Inference with Scalable Cloud Communication
di: Oakley, Joe, et al.
Pubblicazione: (2024)

Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
di: Yao, Jinghan, et al.
Pubblicazione: (2024)

Semantic Parallelism: Redefining Efficient MoE Inference via Model-Data Co-Scheduling
di: Li, Yan, et al.
Pubblicazione: (2025)

Stochastic Sparse Attention for Memory-Bound Inference
di: Lee, Kyle, et al.
Pubblicazione: (2026)

Leyline: KV Cache Directives for Agentic Inference
di: Ma, Bole, et al.
Pubblicazione: (2026)

Lodestar: An Online-Learning LLM Inference Router
di: Lim, Gangmuk, et al.
Pubblicazione: (2026)

Symbiosis: Multi-Adapter Inference and Fine-Tuning
di: Gupta, Saransh, et al.
Pubblicazione: (2025)

Niyama : Breaking the Silos of LLM Inference Serving
di: Goel, Kanishk, et al.
Pubblicazione: (2025)

On Evaluating Performance of LLM Inference Serving Systems
di: Agrawal, Amey, et al.
Pubblicazione: (2025)

Context Parallelism for Scalable Million-Token Inference
di: Yang, Amy, et al.
Pubblicazione: (2024)

Frontier: Towards Comprehensive and Accurate LLM Inference Simulation
di: Feng, Yicheng, et al.
Pubblicazione: (2026)

Frontier: Simulating the Next Generation of LLM Inference Systems
di: Feng, Yicheng, et al.
Pubblicazione: (2025)

PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices
di: Liu, Yangyijian, et al.
Pubblicazione: (2025)

Inference Offloading for Cost-Sensitive Binary Classification at the Edge
di: Moothedath, Vishnu Narayanan, et al.
Pubblicazione: (2025)

GPU-Accelerated Optimization of Transformer-Based Neural Networks for Real-Time Inference
di: Mukherjee, Soutrik, et al.
Pubblicazione: (2026)

SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment
di: Zhu, Wenqiao, et al.
Pubblicazione: (2025)

LLM-42: Enabling Determinism in LLM Inference with Verified Speculation
di: Gond, Raja, et al.
Pubblicazione: (2026)

MatKV: Trading Compute for Flash Storage in LLM Inference
di: Shin, Kun-Woo, et al.
Pubblicazione: (2025)

Adaptive Active Inference Agents for Heterogeneous and Lifelong Federated Learning
di: Danilenka, Anastasiya, et al.
Pubblicazione: (2024)

Characterizing Mobile SoC for Accelerating Heterogeneous LLM Inference
di: Chen, Le, et al.
Pubblicazione: (2025)

Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
di: Liu, Jing, et al.
Pubblicazione: (2025)

SplitZip: Ultra Fast Lossless KV Compression for Disaggregated LLM Serving
di: Guo, Yipin, et al.
Pubblicazione: (2026)

Federated Learning for Collaborative Inference Systems: The Case of Early Exit Networks
di: Kaplan, Caelin, et al.
Pubblicazione: (2024)

FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
di: Ye, Zihao, et al.
Pubblicazione: (2025)

A Parallel Alternative for Energy-Efficient Neural Network Training and Inferencing
di: Seal, Sudip K., et al.
Pubblicazione: (2025)

Serving Heterogeneous LoRA Adapters in Distributed LLM Inference Systems
di: Jaiswal, Shashwat, et al.
Pubblicazione: (2025)

Context-Aware Inference via Performance Forecasting in Decentralized Learning Networks
di: Pfeffer, Joel, et al.
Pubblicazione: (2025)