Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval

Documenti analoghi

• Making Retrieval-Augmented Language Models Robust to Irrelevant Context
  di: Yoran, Ori, et al.
  Pubblicazione: (2023)
• Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors
  di: Amos, Ido, et al.
  Pubblicazione: (2023)
• Large Language Models for Psycholinguistic Plausibility Pretesting
  di: Amouyal, Samuel Joseph, et al.
  Pubblicazione: (2024)
• MLP Memory: A Retriever-Pretrained Memory for Large Language Models
  di: Wei, Rubin, et al.
  Pubblicazione: (2025)
• From Loops to Oops: Fallback Behaviors of Language Models Under Uncertainty
  di: Ivgi, Maor, et al.
  Pubblicazione: (2024)