Copertina

Memorization in In-Context Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Golchin, Shahriar, Surdeanu, Mihai, Bethard, Steven, Blanco, Eduardo, Riloff, Ellen
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models
di: Golchin, Shahriar, et al.
Pubblicazione: (2023)

Time Travel in LLMs: Tracing Data Contamination in Large Language Models
di: Golchin, Shahriar, et al.
Pubblicazione: (2023)

Say Less, Mean More: Leveraging Pragmatics in Retrieval-Augmented Generation
di: Riaz, Haris, et al.
Pubblicazione: (2025)

Towards Compute-Optimal Many-Shot In-Context Learning
di: Golchin, Shahriar, et al.
Pubblicazione: (2025)

Intent Laundering: AI Safety Datasets Are Not What They Seem
di: Golchin, Shahriar, et al.
Pubblicazione: (2026)

ELLEN: Extremely Lightly Supervised Learning For Efficient Named Entity Recognition
di: Riaz, Haris, et al.
Pubblicazione: (2024)

How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark
di: Yang, Minglai, et al.
Pubblicazione: (2025)

Bridging the Long-Tail Gap: Robust Retrieval-Augmented Relation Completion via Multi-Stage Paraphrase Infusion
di: Alam, Fahmida, et al.
Pubblicazione: (2026)

AlignSAE: Concept-Aligned Sparse Autoencoders
di: Yang, Minglai, et al.
Pubblicazione: (2025)

Detecting Memorization in Large Language Models
di: Slonski, Eduardo
Pubblicazione: (2024)

Titans: Learning to Memorize at Test Time
di: Behrouz, Ali, et al.
Pubblicazione: (2024)

Enhancing Transformer RNNs with Multiple Temporal Perspectives
di: Dumitru, Razvan-Gabriel, et al.
Pubblicazione: (2024)

To Memorize or to Retrieve: Scaling Laws for RAG-Considerate Pretraining
di: Singh, Karan, et al.
Pubblicazione: (2026)

HU at SemEval-2024 Task 8A: Can Contrastive Learning Learn Embeddings to Detect Machine-Generated Text?
di: Dipta, Shubhashis Roy, et al.
Pubblicazione: (2024)

Mitigating Unintended Memorization with LoRA in Federated Learning for LLMs
di: Bossy, Thierry, et al.
Pubblicazione: (2025)

Mitigating Memorization In Language Models
di: Sakarvadia, Mansi, et al.
Pubblicazione: (2024)

A Lightweight Explainable Guardrail for Prompt Safety
di: Islam, Md Asiful, et al.
Pubblicazione: (2026)

Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination
di: Wu, Mingqi, et al.
Pubblicazione: (2025)

CopySpec: Accelerating LLMs with Speculative Copy-and-Paste Without Compromising Quality
di: Dumitru, Razvan-Gabriel, et al.
Pubblicazione: (2025)

Quantifying In-Context Reasoning Effects and Memorization Effects in LLMs
di: Lou, Siyu, et al.
Pubblicazione: (2024)

Memorization Dynamics of Fill-in-the-Middle Pretraining
di: von Arx, Tobias, et al.
Pubblicazione: (2026)

Memorization: A Close Look at Books
di: Ma, Iris, et al.
Pubblicazione: (2025)

Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models
di: Bordt, Sebastian, et al.
Pubblicazione: (2024)

Exploring Memorization in Fine-tuned Language Models
di: Zeng, Shenglai, et al.
Pubblicazione: (2023)

From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples
di: Vacareanu, Robert, et al.
Pubblicazione: (2024)

An Evaluation on Large Language Model Outputs: Discourse and Memorization
di: de Wynter, Adrian, et al.
Pubblicazione: (2023)

Memorization vs. Reasoning: Updating LLMs with New Knowledge
di: Li, Aochong Oliver, et al.
Pubblicazione: (2025)

Skewed Memorization in Large Language Models: Quantification and Decomposition
di: Li, Hao, et al.
Pubblicazione: (2025)

Pruning as a Defense: Reducing Memorization in Large Language Models
di: Gupta, Mansi, et al.
Pubblicazione: (2025)

Unintended Memorization of Sensitive Information in Fine-Tuned Language Models
di: Szep, Marton, et al.
Pubblicazione: (2026)

Reconstructing Sepsis Trajectories from Clinical Case Reports using LLMs: the Textual Time Series Corpus for Sepsis
di: Noroozizadeh, Shahriar, et al.
Pubblicazione: (2025)

Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information
di: Li, Yingya, et al.
Pubblicazione: (2024)

Too Big to Think: Capacity, Memorization, and Generalization in Pre-Trained Transformers
di: Barron, Joshua, et al.
Pubblicazione: (2025)

Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis Prediction
di: Ma, Mingyu Derek, et al.
Pubblicazione: (2025)

Fuse to Forget: Bias Reduction and Selective Memorization through Model Fusion
di: Zaman, Kerem, et al.
Pubblicazione: (2023)

Is In-Context Learning Learning?
di: de Wynter, Adrian
Pubblicazione: (2025)

TLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis
di: Das, Spandan, et al.
Pubblicazione: (2024)

Grading Massive Open Online Courses Using Large Language Models
di: Golchin, Shahriar, et al.
Pubblicazione: (2024)

Large Language Models As MOOCs Graders
di: Golchin, Shahriar, et al.
Pubblicazione: (2024)

Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data
di: Wang, Xinyi, et al.
Pubblicazione: (2024)