Image de couverture de livre

Anatomizing Deep Learning Inference in Web Browsers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Qipeng, Jiang, Shiqi, Chen, Zhenpeng, Cao, Xu, Li, Yuanchun, Li, Aoyu, Ma, Yun, Cao, Ting, Liu, Xuanzhe
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Performance
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ShadowNPU: System and Algorithm Co-design for NPU-Centric On-Device LLM Inference
par: Yin, Wangsong, et autres
Publié: (2025)

Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
par: Maczan, Jędrzej
Publié: (2026)

Forecasting GPU Performance for Deep Learning Training and Inference
par: Lee, Seonho, et autres
Publié: (2024)

FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models
par: Shao, Zishan, et autres
Publié: (2025)

PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation
par: An, Zihao, et autres
Publié: (2025)

Neuralink: Fast LLM Inference on Smartphones with Neuron Co-Activation Linking
par: Wang, Tuowei, et autres
Publié: (2024)

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference
par: Holmes, Connor, et autres
Publié: (2024)

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation
par: Li, Jianhui, et autres
Publié: (2023)

lm-Meter: Unveiling Runtime Inference Latency for On-Device Language Models
par: Wang, Haoxin, et autres
Publié: (2025)

KVDirect: Distributed Disaggregated LLM Inference
par: Chen, Shiyang, et autres
Publié: (2024)

Tabular and Deep Reinforcement Learning for Gittins Index
par: Dhankhar, Harshit, et autres
Publié: (2024)

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach
par: Zhang, Yijia, et autres
Publié: (2024)

CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing
par: Zheng, Wenhao, et autres
Publié: (2025)

Greener Deep Reinforcement Learning: Analysis of Energy and Carbon Efficiency Across Atari Benchmarks
par: Gardner, Jason, et autres
Publié: (2025)

An Inquiry into Datacenter TCO for LLM Inference with FP8
par: Kim, Jiwoo, et autres
Publié: (2025)

Ragged Paged Attention: A High-Performance and Flexible LLM Inference Kernel for TPU
par: Jiang, Jevin, et autres
Publié: (2026)

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels
par: Wang, Han, et autres
Publié: (2026)

An Efficient Hybrid Sparse Attention with CPU-GPU Parallelism for Long-Context Inference
par: Yao, Feiyu, et autres
Publié: (2026)

MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference
par: Chu, Kexin, et autres
Publié: (2026)

Towards A Flexible Accuracy-Oriented Deep Learning Module Inference Latency Prediction Framework for Adaptive Optimization Algorithms
par: Shen, Jingran, et autres
Publié: (2023)

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

GreenServ: Energy-Efficient Context-Aware Dynamic Routing for Multi-Model LLM Inference
par: Ziller, Thomas, et autres
Publié: (2026)

DF-GNN: Dynamic Fusion Framework for Attention Graph Neural Networks on GPUs
par: Liu, Jiahui, et autres
Publié: (2024)

MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
par: Xue, Leyang, et autres
Publié: (2024)

Fairness in Serving Large Language Models
par: Sheng, Ying, et autres
Publié: (2023)

Memory Analysis on the Training Course of DeepSeek Models
par: Zhang, Ping, et autres
Publié: (2025)

PrETi: Predicting Execution Time in Early Stage with LLVM and Machine Learning
par: Xu, Risheng, et autres
Publié: (2025)

CEBench: A Benchmarking Toolkit for the Cost-Effectiveness of LLM Pipelines
par: Sun, Wenbo, et autres
Publié: (2024)

Efficient Reinforcement Learning for Routing Jobs in Heterogeneous Queueing Systems
par: Jali, Neharika, et autres
Publié: (2024)

A Structure-Aware Framework for Learning Device Placements on Computation Graphs
par: Duan, Shukai, et autres
Publié: (2024)

VDTuner: Automated Performance Tuning for Vector Data Management Systems
par: Yang, Tiannuo, et autres
Publié: (2024)

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference
par: Chu, Kexin, et autres
Publié: (2025)

CoFormer: Collaborating with Heterogeneous Edge Devices for Scalable Transformer Inference
par: Xu, Guanyu, et autres
Publié: (2025)

Cloud Computing Energy Consumption Prediction Based on Kernel Extreme Learning Machine Algorithm Improved by Vector Weighted Average Algorithm
par: Wang, Yuqing, et autres
Publié: (2025)

FlashSVD v1.5: Making Low-Rank Transformers Inference Actually Fast
par: Wu, Wenhao, et autres
Publié: (2026)

Efficient Graph Knowledge Distillation from GNNs to Kolmogorov--Arnold Networks via Self-Attention Dynamic Sampling
par: Cui, Can, et autres
Publié: (2025)

ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
par: Wang, Liangyu, et autres
Publié: (2025)

Application Research On Real-Time Perception Of Device Performance Status
par: Wang, Zhe, et autres
Publié: (2024)

On the Sustainability of AI Inferences in the Edge
par: Sobhani, Ghazal, et autres
Publié: (2025)

Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems
par: Zhao, Yushang, et autres
Publié: (2025)