Image de couverture de livre

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jia, Fucheng, Jiang, Shiqi, Cao, Ting, Cui, Wei, Xia, Tianrui, Cao, Xu, Li, Yuanchun, Zhang, Deyu, Ren, Ju, Liu, Yunxin, Qiu, Lili, Yang, Mao
Format:	Preprint
Publié:	2023
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Anatomizing Deep Learning Inference in Web Browsers
par: Wang, Qipeng, et autres
Publié: (2024)

Scaling Up On-Device LLMs via Active-Weight Swapping Between DRAM and Flash
par: Jia, Fucheng, et autres
Publié: (2025)

A First Look At Efficient And Secure On-Device LLM Inference Against KV Leakage
par: Yang, Huan, et autres
Publié: (2024)

Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices
par: Li, Xiangyu, et autres
Publié: (2025)

ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaboration
par: Dai, Gaole, et autres
Publié: (2025)

Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment
par: Dai, Gaole, et autres
Publié: (2025)

AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management
par: Tian, Shizuo, et autres
Publié: (2025)

Bitnet.cpp: Efficient Edge Inference for Ternary LLMs
par: Wang, Jinheng, et autres
Publié: (2025)

EdgeFlex-Transformer: Transformer Inference for Edge Devices
par: Mohammad, Shoaib, et autres
Publié: (2025)

Sculptor: Empowering LLMs with Cognitive Agency via Active Context Management
par: Li, Mo, et autres
Publié: (2025)

EdgeShard: Efficient LLM Inference via Collaborative Edge Computing
par: Zhang, Mingjin, et autres
Publié: (2024)

Matryoshka: Optimization of Dynamic Diverse Quantum Chemistry Systems via Elastic Parallelism Transformation
par: Wang, Tuowei, et autres
Publié: (2024)

AdaNav: Adaptive Reasoning with Uncertainty for Vision-Language Navigation
par: Ding, Xin, et autres
Publié: (2025)

OxyGen: Unified KV Cache Management for VLA Inference under Multi-Task Parallelism
par: Li, Xiangyu, et autres
Publié: (2026)

SpinFlow: A Physics-Informed Spin Field Framework for Traffic Phase Inference and Transition Detection
par: Deng, Haopeng, et autres
Publié: (2026)

Threshold Neuron: A Brain-inspired Artificial Neuron for Efficient On-device Inference
par: Zheng, Zihao, et autres
Publié: (2024)

Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment
par: Dai, Shenghong, et autres
Publié: (2024)

Browser Fingerprint Detection and Anti-Tracking
par: Lin, Kaitong, et autres
Publié: (2025)

EdgeOAR: Real-time Online Action Recognition On Edge Devices
par: Luo, Wei, et autres
Publié: (2024)

Region-based Content Enhancement for Efficient Video Analytics at the Edge
par: Wang, Weijun, et autres
Publié: (2024)

SwapNet: Efficient Swapping for DNN Inference on Edge AI Devices Beyond the Memory Budget
par: Wang, Kun, et autres
Publié: (2024)

Privacy-Aware Multi-Device Cooperative Edge Inference with Distributed Resource Bidding
par: Zhuang, Wenhao, et autres
Publié: (2024)

GenAI at the Edge: Comprehensive Survey on Empowering Edge Devices
par: Navardi, Mozhgan, et autres
Publié: (2025)

Infer-EDGE: Dynamic DNN Inference Optimization in 'Just-in-time' Edge-AI Implementations
par: Mounesan, Motahare, et autres
Publié: (2025)

KVShare: An LLM Service System with Efficient and Effective Multi-Tenant KV Cache Reuse
par: Yang, Huan, et autres
Publié: (2025)

Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
par: Wang, Xubin, et autres
Publié: (2025)

Recall: Empowering Multimodal Embedding for Edge Devices
par: Cai, Dongqi, et autres
Publié: (2024)

ResPanDiff: Diffusion Model for Pansharpening by Inferring Residual Inference
par: Cao, Shiqi, et autres
Publié: (2025)

Image is All You Need to Empower Large-scale Diffusion Models for In-Domain Generation
par: Cao, Pu, et autres
Publié: (2023)

Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence
par: Zeng, Liekang, et autres
Publié: (2024)

Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers
par: Cao, Jin, et autres
Publié: (2024)

Enhancing Ultra-Low-Bit Quantization of Large Language Models Through Saliency-Aware Partial Retraining
par: Cao, Deyu, et autres
Publié: (2025)

WebLLM: A High-Performance In-Browser LLM Inference Engine
par: Ruan, Charlie F., et autres
Publié: (2024)

Safe Multi-Agent Deep Reinforcement Learning for Privacy-Aware Edge-Device Collaborative DNN Inference
par: Wang, Hong, et autres
Publié: (2026)

Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMs
par: Li, Yunxin, et autres
Publié: (2023)

AVA: Towards Agentic Video Analytics with Vision Language Models
par: Yan, Yuxuan, et autres
Publié: (2025)

PracMHBench: Re-evaluating Model-Heterogeneous Federated Learning Based on Practical Edge Device Constraints
par: Guo, Yuanchun, et autres
Publié: (2025)

TENET: An Efficient Sparsity-Aware LUT-Centric Architecture for Ternary LLM Inference On Edge
par: Huang, Zhirui, et autres
Publié: (2025)

Optimizing Antenna Coding for Pixel Antenna Empowered SISO-OFDM Systems
par: Qiao, Tianrui, et autres
Publié: (2026)

Efficient Partitioning Vision Transformer on Edge Devices for Distributed Inference
par: Liu, Xiang, et autres
Publié: (2024)