Cover Image

Repetitions are not all alike: distinct mechanisms sustain repetition in language models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mahaut, Matéo, Franzon, Francesca
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Referential communication in heterogeneous communities of pre-trained visual deep networks
by: Mahaut, Matéo, et al.
Published: (2023)

The emergence of numerical representations in communicating artificial agents
by: Mihai, Daniela, et al.
Published: (2026)

Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators
by: Mahaut, Matéo, et al.
Published: (2024)

A quantitative analysis of semantic information in deep representations of text and images
by: Acevedo, Santiago, et al.
Published: (2025)

Evil twins are not that evil: Qualitative insights into machine-generated prompts
by: Rakotonirina, Nathanaël Carraz, et al.
Published: (2024)

Repetition Improves Language Model Embeddings
by: Springer, Jacob Mitchell, et al.
Published: (2024)

Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA
by: Gor, Maharshi, et al.
Published: (2024)

Datasets, Documents, and Repetitions: The Practicalities of Unequal Data Quality
by: Fang, Alex, et al.
Published: (2025)

Principles of semantic and functional efficiency in grammatical patterning
by: Cheng, Emily, et al.
Published: (2024)

Aligning language models with human preferences
by: Korbak, Tomasz
Published: (2024)

Evaluating language models as risk scores
by: Cruz, André F., et al.
Published: (2024)

Watermarking Needs Input Repetition Masking
by: Khachaturov, David, et al.
Published: (2025)

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models
by: Paech, Samuel, et al.
Published: (2025)

Amortizing intractable inference in large language models
by: Hu, Edward J., et al.
Published: (2023)

Prompt Repetition Improves Non-Reasoning LLMs
by: Leviathan, Yaniv, et al.
Published: (2025)

A mean teacher algorithm for unlearning of language models
by: Klochkov, Yegor
Published: (2025)

Visualizing token importance for black-box language models
by: Rauba, Paulius, et al.
Published: (2025)

Perturbed examples reveal invariances shared by language models
by: Rawal, Ruchit, et al.
Published: (2023)

Do language models plan ahead for future tokens?
by: Wu, Wilson, et al.
Published: (2024)

Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editing
by: Wang, Weichuan, et al.
Published: (2024)

The language of time: a language model perspective on time-series foundation models
by: Xie, Yi, et al.
Published: (2025)

Prompt reinforcing for long-term planning of large language models
by: Lin, Hsien-Chin, et al.
Published: (2025)

Machine-generated text detection prevents language model collapse
by: Drayson, George, et al.
Published: (2025)

Retrieval Backward Attention without Additional Training: Enhance Embeddings of Large Language Models via Repetition
by: Duan, Yifei, et al.
Published: (2025)

Zero-shot generation of synthetic neurosurgical data with large language models
by: Barr, Austin A., et al.
Published: (2025)

How do language models learn facts? Dynamics, curricula and hallucinations
by: Zucchet, Nicolas, et al.
Published: (2025)

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
by: Raposo, David, et al.
Published: (2024)

Anchor function: a type of benchmark functions for studying language models
by: Zhang, Zhongwang, et al.
Published: (2024)

Only relative ranks matter in weight-clustered large language models
by: Aizpurua, Borja, et al.
Published: (2026)

Simple linear attention language models balance the recall-throughput tradeoff
by: Arora, Simran, et al.
Published: (2024)

Just read twice: closing the recall gap for recurrent language models
by: Arora, Simran, et al.
Published: (2024)

Representation in large language models
by: Yetman, Cameron
Published: (2025)

B-score: Detecting biases in large language models using response history
by: Vo, An, et al.
Published: (2025)

The SMeL Test: A simple benchmark for media literacy in language models
by: Ahdritz, Gustaf, et al.
Published: (2025)

Leveraging large language models for structured information extraction from pathology reports
by: Balasubramanian, Jeya Balaji, et al.
Published: (2025)

ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography
by: Ahrens, Lara, et al.
Published: (2025)

Question answering system of bridge design specification based on large language model
by: Zhang, Leye, et al.
Published: (2024)

Linear representations in language models can change dramatically over a conversation
by: Lampinen, Andrew Kyle, et al.
Published: (2026)

DataComp-LM: In search of the next generation of training sets for language models
by: Li, Jeffrey, et al.
Published: (2024)

The representation landscape of few-shot learning and fine-tuning in large language models
by: Doimo, Diego, et al.
Published: (2024)