Cover Image

Comet: A Communication-efficient and Performant Approximation for Private Transformer Inference

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Xiangrui, Zhang, Qiao, Ning, Rui, Xin, Chunsheng, Wu, Hongyi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity
by: Yan, Guang, et al.
Published: (2025)

Linearizing Models for Efficient yet Robust Private Inference
by: Sarkar, Sreetama, et al.
Published: (2024)

Private Collaborative Edge Inference via Over-the-Air Computation
by: Yilmaz, Selim F., et al.
Published: (2024)

Private-RAG: Answering Multiple Queries with LLMs while Keeping Your Data Private
by: Wu, Ruihan, et al.
Published: (2025)

DR-Encoder: Encode Low-rank Gradients with Random Prior for Large Language Models Differentially Privately
by: Wu, Huiwen, et al.
Published: (2024)

Trusted Machine Learning Models Unlock Private Inference for Problems Currently Infeasible with Cryptography
by: Shumailov, Ilia, et al.
Published: (2025)

RMSL: Weakly-Supervised Insider Threat Detection with Robust Multi-sphere Learning
by: Wang, Yang, et al.
Published: (2025)

LAN: Learning Adaptive Neighbors for Real-Time Insider Threat Detection
by: Cai, Xiangrui, et al.
Published: (2024)

Differentially Private Distributed Inference
by: Papachristou, Marios, et al.
Published: (2024)

FastQuery: Communication-efficient Embedding Table Query for Private LLM Inference
by: Lin, Chenqi, et al.
Published: (2024)

Improved Algorithms for Differentially Private Language Model Alignment
by: Chen, Keyu, et al.
Published: (2025)

Evaluating Differentially Private Generation of Domain-Specific Text
by: Sun, Yidan, et al.
Published: (2025)

CLASP: Training-Free LLM-Assisted Source Code Watermarking via Semantic-Preserving Transformations
by: Xu, Rui, et al.
Published: (2025)

Differentially Private Reinforcement Learning with Self-Play
by: Qiao, Dan, et al.
Published: (2024)

DP-TabICL: In-Context Learning with Differentially Private Tabular Data
by: Carey, Alycia N., et al.
Published: (2024)

Provable Differentially Private Computation of the Cross-Attention Mechanism
by: Ke, Yekun, et al.
Published: (2024)

Clustering and Median Aggregation Improve Differentially Private Inference
by: Amin, Kareem, et al.
Published: (2025)

Differentially Private Model Merging
by: Yin, Qichuan, et al.
Published: (2026)

Deep Efficient Private Neighbor Generation for Subgraph Federated Learning
by: Zhang, Ke, et al.
Published: (2024)

Challenges in Enabling Private Data Valuation
by: Fu, Yiwei, et al.
Published: (2026)

A Survey on Private Transformer Inference
by: Li, Yang, et al.
Published: (2024)

dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generation
by: Mahiou, Sofiane, et al.
Published: (2025)

Differentially Private Worst-group Risk Minimization
by: Zhou, Xinyu, et al.
Published: (2024)

Provable Privacy with Non-Private Pre-Processing
by: Hu, Yaxi, et al.
Published: (2024)

A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
by: Panda, Ashwinee, et al.
Published: (2022)

PrivCirNet: Efficient Private Inference via Block Circulant Transformation
by: Xu, Tianshi, et al.
Published: (2024)

Differentially Private Iterative Screening Rules for Linear Regression
by: Khanna, Amol, et al.
Published: (2025)

Differentially Private Deep Model-Based Reinforcement Learning
by: Rio, Alexandre, et al.
Published: (2024)

Differentially Private In-Context Learning with Nearest Neighbor Search
by: Koskela, Antti, et al.
Published: (2025)

PM-MOE: Mixture of Experts on Private Model Parameters for Personalized Federated Learning
by: Feng, Yu, et al.
Published: (2025)

On Membership Inference Attacks in Knowledge Distillation
by: Cui, Ziyao, et al.
Published: (2025)

TBDetector:Transformer-Based Detector for Advanced Persistent Threats with Provenance Graph
by: Wang, Nan, et al.
Published: (2023)

Winning the MIDST Challenge: New Membership Inference Attacks on Diffusion Models for Tabular Data Synthesis
by: Wu, Xiaoyu, et al.
Published: (2025)

Attribute Inference Attacks for Federated Regression Tasks
by: Diana, Francesco, et al.
Published: (2024)

A Multi-Dimensional Quality Scoring Framework for Decentralized LLM Inference with Proof of Quality
by: Tian, Arther, et al.
Published: (2026)

Private Transformer Inference in MLaaS: A Survey
by: Li, Yang, et al.
Published: (2025)

Differentially Private Synthetic Data Release for Topics API Outputs
by: Dick, Travis, et al.
Published: (2025)

Differentially Private Block-wise Gradient Shuffle for Deep Learning
by: Zagardo, David
Published: (2024)

Privacy Assessment of Federated Learning using Private Personalized Layers
by: Jourdan, Théo, et al.
Published: (2021)

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing
by: Piran, Fardin Jalil, et al.
Published: (2024)