Cascade: Token-Sharded Private LLM Inference

Documenti analoghi

• An Attack to Break Permutation-Based Private Third-Party Inference Schemes for LLMs
  di: Thomas, Rahul, et al.
  Pubblicazione: (2025)
• Privacy-Preserving Mechanisms Enable Cheap Verifiable Inference of LLMs
  di: Pal, Arka, et al.
  Pubblicazione: (2026)
• vTune: Verifiable Fine-Tuning for LLMs Through Backdooring
  di: Zhang, Eva, et al.
  Pubblicazione: (2024)
• Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actions
  di: Pal, Arka, et al.
  Pubblicazione: (2025)
• AERO: Entropy-Guided Framework for Private LLM Inference
  di: Jha, Nandan Kumar, et al.
  Pubblicazione: (2024)