Cover Image

Mitigating Memorization In Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sakarvadia, Mansi, Ajith, Aswathy, Khan, Arham, Hudson, Nathaniel, Geniesse, Caleb, Chard, Kyle, Yang, Yaoqing, Foster, Ian, Mahoney, Michael W.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models
by: Sakarvadia, Mansi, et al.
Published: (2023)

Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey
by: Khan, Arham, et al.
Published: (2024)

Topology-Aware Knowledge Propagation in Decentralized Learning
by: Sakarvadia, Mansi, et al.
Published: (2025)

The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators
by: Sakarvadia, Mansi, et al.
Published: (2025)

Towards Interpreting Language Models: A Case Study in Multi-Hop Reasoning
by: Sakarvadia, Mansi
Published: (2024)

Combining Language and Graph Models for Semi-structured Information Extraction on the Web
by: Hong, Zhi, et al.
Published: (2024)

LSHBloom: Memory-efficient, Extreme-scale Document Deduplication
by: Khan, Arham, et al.
Published: (2024)

Evaluating Loss Landscapes from a Topology Perspective
by: Xie, Tiankai, et al.
Published: (2024)

Pruning as a Defense: Reducing Memorization in Large Language Models
by: Gupta, Mansi, et al.
Published: (2025)

Empowering Scientific Workflows with Federated Agents
by: Kamatar, Alok, et al.
Published: (2025)

SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluation
by: Wan, Yuwei, et al.
Published: (2024)

Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision
by: Hudson, Nathaniel, et al.
Published: (2024)

Agentic Discovery: Closing the Loop with Cooperative Agents
by: Pauloski, J. Gregory, et al.
Published: (2025)

Assessing and Mitigating Data Memorization Risks in Fine-Tuned Large Language Models
by: Ramakrishnan, Badrinath, et al.
Published: (2025)

Beyond Memorization: Assessing Semantic Generalization in Large Language Models Using Phrasal Constructions
by: Scivetti, Wesley, et al.
Published: (2025)

Visualizing Loss Functions as Topological Landscape Profiles
by: Geniesse, Caleb, et al.
Published: (2024)

Removing Watermarks with Partial Regeneration using Semantic Information
by: Tallam, Krti, et al.
Published: (2025)

Arithmetic with Language Models: from Memorization to Computation
by: Maltoni, Davide, et al.
Published: (2023)

Memorization in Fine-Tuned Large Language Models
by: Savine, Danil
Published: (2025)

Memorizing Documents with Guidance in Large Language Models
by: Park, Bumjin, et al.
Published: (2024)

Landscaper: Understanding Loss Landscapes Through Multi-Dimensional Topological Analysis
by: Chen, Jiaqing, et al.
Published: (2026)

Detecting Memorization in Large Language Models
by: Slonski, Eduardo
Published: (2024)

Undesirable Memorization in Large Language Models: A Survey
by: Satvaty, Ali, et al.
Published: (2024)

Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implications
by: Li, Anran, et al.
Published: (2025)

Exploring Memorization in Fine-tuned Language Models
by: Zeng, Shenglai, et al.
Published: (2023)

Generalization or Memorization? Brittleness Testing for Chess-Trained Language Models
by: Tang, Ethan
Published: (2026)

A Multi-Perspective Analysis of Memorization in Large Language Models
by: Chen, Bowen, et al.
Published: (2024)

Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models
by: Cao, Boxi, et al.
Published: (2023)

Impact of Fine-Tuning Methods on Memorization in Large Language Models
by: Hou, Jie, et al.
Published: (2025)

Beyond Memorization: The Challenge of Random Memory Access in Language Models
by: Zhu, Tongyao, et al.
Published: (2024)

From Correlation to Cause: A Five-Stage Methodology for Feature Analysis in Transformer Language Models
by: Munigety, Caleb
Published: (2026)

Towards Better Generalization in Open-Domain Question Answering by Mitigating Context Memorization
by: Zhang, Zixuan, et al.
Published: (2024)

Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
by: Prashanth, USVSN Sai, et al.
Published: (2024)

Mitigating Unintended Memorization with LoRA in Federated Learning for LLMs
by: Bossy, Thierry, et al.
Published: (2025)

Data Compressibility Quantifies LLM Memorization
by: Huang, Yizhan, et al.
Published: (2025)

Private Memorization Editing: Turning Memorization into a Defense to Strengthen Data Privacy in Large Language Models
by: Ruzzetti, Elena Sofia, et al.
Published: (2025)

Addressing Reproducibility Challenges in HPC with Continuous Integration
by: Hayot-Sasson, Valérie, et al.
Published: (2025)

Hierarchical Memorization in Large Language Models: Evidence from Citation Generation
by: Niimi, Junichiro
Published: (2025)

The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
by: Hong, Yihuai, et al.
Published: (2025)

An Evaluation on Large Language Model Outputs: Discourse and Memorization
by: de Wynter, Adrian, et al.
Published: (2023)