Dataset distillation for memorized data: Soft labels can leak held-out teacher knowledge

Documenti analoghi

• Counting in Small Transformers: The Delicate Interplay between Attention and Feed-Forward Layers
  di: Behrens, Freya, et al.
  Pubblicazione: (2024)
• A phase transition between positional and semantic learning in a solvable model of dot-product attention
  di: Cui, Hugo, et al.
  Pubblicazione: (2024)
• Dynamical Cavity Method for Hypergraphs and its Application to Quenches in the k-XOR-SAT Problem
  di: Maier, Aude, et al.
  Pubblicazione: (2024)
• Counting and Hardness-of-Finding Fixed Points in Cellular Automata on Random Graphs
  di: Koller, Cédric, et al.
  Pubblicazione: (2024)
• Dynamical Phase Transitions in Graph Cellular Automata
  di: Behrens, Freya, et al.
  Pubblicazione: (2023)