Aggressive Compression Enables LLM Weight Theft

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Brown, Davis, Rivera, Juan-Pablo, Hendrycks, Dan, Mazeika, Mantas
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908746888773632
author Brown, Davis
Rivera, Juan-Pablo
Hendrycks, Dan
Mazeika, Mantas
author_facet Brown, Davis
Rivera, Juan-Pablo
Hendrycks, Dan
Mazeika, Mantas
contents As frontier AIs become more powerful and costly to develop, adversaries have increasing incentives to steal model weights by mounting exfiltration attacks. In this work, we consider exfiltration attacks where an adversary attempts to sneak model weights out of a datacenter over a network. While exfiltration attacks are multi-step cyber attacks, we demonstrate that a single factor, the compressibility of model weights, significantly heightens exfiltration risk for large language models (LLMs). We tailor compression specifically for exfiltration by relaxing decompression constraints and demonstrate that attackers could achieve 16x to 100x compression with minimal trade-offs, reducing the time it would take for an attacker to illicitly transmit model weights from the defender's server from months to days. Finally, we study defenses designed to reduce exfiltration risk in three distinct ways: making models harder to compress, making them harder to 'find,' and tracking provenance for post-attack analysis using forensic watermarks. While all defenses are promising, the forensic watermark defense is both effective and cheap, and therefore is a particularly attractive lever for mitigating weight-exfiltration risk.
format Preprint
id arxiv_https___arxiv_org_abs_2601_01296
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Aggressive Compression Enables LLM Weight Theft
Brown, Davis
Rivera, Juan-Pablo
Hendrycks, Dan
Mazeika, Mantas
Cryptography and Security
Artificial Intelligence
Machine Learning
As frontier AIs become more powerful and costly to develop, adversaries have increasing incentives to steal model weights by mounting exfiltration attacks. In this work, we consider exfiltration attacks where an adversary attempts to sneak model weights out of a datacenter over a network. While exfiltration attacks are multi-step cyber attacks, we demonstrate that a single factor, the compressibility of model weights, significantly heightens exfiltration risk for large language models (LLMs). We tailor compression specifically for exfiltration by relaxing decompression constraints and demonstrate that attackers could achieve 16x to 100x compression with minimal trade-offs, reducing the time it would take for an attacker to illicitly transmit model weights from the defender's server from months to days. Finally, we study defenses designed to reduce exfiltration risk in three distinct ways: making models harder to compress, making them harder to 'find,' and tracking provenance for post-attack analysis using forensic watermarks. While all defenses are promising, the forensic watermark defense is both effective and cheap, and therefore is a particularly attractive lever for mitigating weight-exfiltration risk.
title Aggressive Compression Enables LLM Weight Theft
topic Cryptography and Security
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2601.01296