Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing

Documenti analoghi

• Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model
  di: Khona, Mikail, et al.
  Pubblicazione: (2024)
• Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
  di: Ramesh, Rahul, et al.
  Pubblicazione: (2023)
• Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task
  di: Okawa, Maya, et al.
  Pubblicazione: (2023)
• ICLR: In-Context Learning of Representations
  di: Park, Core Francisco, et al.
  Pubblicazione: (2024)
• Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space
  di: Park, Core Francisco, et al.
  Pubblicazione: (2024)