Cover Image

A First Look At Efficient And Secure On-Device LLM Inference Against KV Leakage

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Huan, Zhang, Deyu, Zhao, Yudong, Li, Yuanchun, Liu, Yunxin
Format:	Preprint
Published:	2024
Subjects:	Cryptography and Security Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A First Look at the Security Issues in the Model Context Protocol Ecosystem
by: Li, Xiaofan, et al.
Published: (2025)

RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage
by: Zhong, Peter Yong, et al.
Published: (2025)

Memory-Efficient and Secure DNN Inference on TrustZone-enabled Consumer IoT Devices
by: Xie, Xueshuo, et al.
Published: (2024)

ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection
by: Zhao, Wei, et al.
Published: (2026)

Burn-After-Use for Preventing Data Leakage through a Secure Multi-Tenant Architecture in Enterprise LLM
by: Zhang, Qiang, et al.
Published: (2026)

SecureRouter: Encrypted Routing for Efficient Secure Inference
by: Zhang, Yukuan, et al.
Published: (2026)

Mobile GUI Agents under Real-world Threats: Are We There Yet?
by: Liu, Guohong, et al.
Published: (2025)

MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents
by: Zhang, Dongsen, et al.
Published: (2025)

Nimbus: Secure and Efficient Two-Party Inference for Transformers
by: Li, Zhengyi, et al.
Published: (2024)

Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inference
by: Luo, Zhifan, et al.
Published: (2025)

Credential Leakage in LLM Agent Skills: A Large-Scale Empirical Study
by: Chen, Zhihao, et al.
Published: (2026)

AttackPilot: Autonomous Inference Attacks Against ML Services With LLM-Based Agents
by: Wu, Yixin, et al.
Published: (2025)

Membership Inference Attacks Against Vision-Language Models
by: Hu, Yuke, et al.
Published: (2025)

On the (In-)Security of the Shuffling Defense in the Transformer Secure Inference
by: Li, Zhengyi, et al.
Published: (2026)

Encrypted Prompt: Securing LLM Applications Against Unauthorized Actions
by: Chan, Shih-Han
Published: (2025)

VeriSplit: Secure and Practical Offloading of Machine Learning Inferences across IoT Devices
by: Zhang, Han, et al.
Published: (2024)

MPC-Minimized Secure LLM Inference
by: Rathee, Deevashwer, et al.
Published: (2024)

Evaluating Answer Leakage Robustness of LLM Tutors against Adversarial Student Attacks
by: Zhao, Jin, et al.
Published: (2026)

Towards Secure and Private AI: A Framework for Decentralized Inference
by: Zhang, Hongyang, et al.
Published: (2024)

SecMoE: Communication-Efficient Secure MoE Inference via Select-Then-Compute
by: Shen, Bowen, et al.
Published: (2026)

Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks
by: Chen, Sizhe, et al.
Published: (2025)

ENSI: Efficient Non-Interactive Secure Inference for Large Language Models
by: He, Zhiyu, et al.
Published: (2025)

Agent Audit: A Security Analysis System for LLM Agent Applications
by: Zhang, Haiyue, et al.
Published: (2026)

Towards Confidential and Efficient LLM Inference with Dual Privacy Protection
by: Yu, Honglan, et al.
Published: (2025)

Secure On-Device Video OOD Detection Without Backpropagation
by: Li, Shawn, et al.
Published: (2025)

Breaking Secure Aggregation: Label Leakage from Aggregated Gradients in Federated Learning
by: Wang, Zhibo, et al.
Published: (2024)

On the (In)Security of LLM App Stores
by: Hou, Xinyi, et al.
Published: (2024)

PathSeeker: Exploring LLM Security Vulnerabilities with a Reinforcement Learning-Based Jailbreak Approach
by: Lin, Zhihao, et al.
Published: (2024)

Autonomous LLM Agents & CTFs: A Second Look
by: Bouchari, Youness, et al.
Published: (2026)

Causality Laundering: Denial-Feedback Leakage in Tool-Calling LLM Agents
by: Chinaei, Mohammad Hossein
Published: (2026)

Information-Dense Reasoning for Efficient and Auditable Security Alert Triage
by: Zhao, Guangze, et al.
Published: (2025)

LLM Agents Should Employ Security Principles
by: Zhang, Kaiyuan, et al.
Published: (2025)

Tabula: Efficiently Computing Nonlinear Activation Functions for Secure Neural Network Inference
by: Lam, Maximilian, et al.
Published: (2022)

A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems
by: Wu, Fangzhou, et al.
Published: (2024)

Understanding Secret Leakage Risks in Code LLMs: A Tokenization Perspective
by: Chen, Meifang, et al.
Published: (2026)

Information Security Based on LLM Approaches: A Review
by: Gong, Chang, et al.
Published: (2025)

The Security Threat of Compressed Projectors in Large Vision-Language Models
by: Zhang, Yudong, et al.
Published: (2025)

Bidirectional Intention Inference Enhances LLMs' Defense Against Multi-Turn Jailbreak Attacks
by: Tong, Haibo, et al.
Published: (2025)

SafeGPT: Preventing Data Leakage and Unethical Outputs in Enterprise LLM Use
by: Desai, Pratyush, et al.
Published: (2026)

InfoDecom: Decomposing Information for Defending Against Privacy Leakage in Split Inference
by: Deng, Ruijun, et al.
Published: (2025)