Cover Image

Density estimation with LLMs: a geometric investigation of in-context learning trajectories

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Toni J. B., Boullé, Nicolas, Sarfati, Raphaël, Earls, Christopher J.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law
by: Liu, Toni J. B., et al.
Published: (2024)

Jacobian Scopes: token-level causal attributions in LLMs
by: Liu, Toni J. B., et al.
Published: (2026)

Text-Trained LLMs Can Zero-Shot Extrapolate PDE Dynamics, Revealing a Three-Stage In-Context Learning Mechanism
by: Bao, Jiajun, et al.
Published: (2025)

What's in a prompt? Language models encode literary style in prompt embeddings
by: Sarfati, Raphaël, et al.
Published: (2025)

Lines of Thought in Large Language Models
by: Sarfati, Raphaël, et al.
Published: (2024)

Fine-Tuning Discrete Diffusion Models with Policy Gradient Methods
by: Zekri, Oussama, et al.
Published: (2025)

Generalized Discrete Diffusion from Snapshots
by: Zekri, Oussama, et al.
Published: (2026)

The broader spectrum of in-context learning
by: Lampinen, Andrew Kyle, et al.
Published: (2024)

CausalLM is not optimal for in-context learning
by: Ding, Nan, et al.
Published: (2023)

Towards Universal and Black-Box Query-Response Only Attack on LLMs with QROA
by: Jawad, Hussein, et al.
Published: (2024)

Re-examining learning linear functions in context
by: Naim, Omar, et al.
Published: (2024)

Large Language Models as Markov Chains
by: Zekri, Oussama, et al.
Published: (2024)

Learning without training: The implicit dynamics of in-context learning
by: Dherin, Benoit, et al.
Published: (2025)

Aligning (Medical) LLMs for (Counterfactual) Fairness
by: Poulain, Raphael, et al.
Published: (2024)

In-context KV-Cache Eviction for LLMs via Attention-Gate
by: Zeng, Zihao, et al.
Published: (2024)

Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thought
by: Boppana, Siddharth, et al.
Published: (2026)

A Decomposition Perspective to Long-context Reasoning for LLMs
by: Xiao, Yanling, et al.
Published: (2026)

Bias patterns in the application of LLMs for clinical decision support: A comprehensive study
by: Poulain, Raphael, et al.
Published: (2024)

Bayesian scaling laws for in-context learning
by: Arora, Aryaman, et al.
Published: (2024)

Stories in Space: In-Context Learning Trajectories in Conceptual Belief Space
by: Bigelow, Eric, et al.
Published: (2026)

Breaking through the learning plateaus of in-context learning in Transformer
by: Fu, Jingwen, et al.
Published: (2023)

Tracing Computation Density in LLMs
by: Kervadec, Corentin, et al.
Published: (2026)

LLMs with in-context learning for Algorithmic Theoretical Physics
by: Hell, Anamaria, et al.
Published: (2026)

Scaling sparse feature circuit finding for in-context learning
by: Kharlapenko, Dmitrii, et al.
Published: (2025)

Why does in-context learning fail sometimes? Evaluating in-context learning on open and closed questions
by: Li, Xiang, et al.
Published: (2024)

Associative memory inspires improvements for in-context learning using a novel attention residual stream architecture
by: Burns, Thomas F, et al.
Published: (2024)

On the generalization of language models from in-context learning and finetuning: a controlled study
by: Lampinen, Andrew K., et al.
Published: (2025)

Sparse Attention across Multiple-context KV Cache
by: Cao, Ziyi, et al.
Published: (2025)

LLMs can learn self-restraint through iterative self-reflection
by: Piché, Alexandre, et al.
Published: (2024)

Scaling Efficient LLMs
by: Kausik, B. N.
Published: (2024)

Large language models reorganize representational geometry during in-context learning
by: Xiong, Hua-Dong, et al.
Published: (2026)

What is Wrong with Perplexity for Long-context Language Modeling?
by: Fang, Lizhe, et al.
Published: (2024)

Transformers are Universal In-context Learners
by: Furuya, Takashi, et al.
Published: (2024)

Active Task Disambiguation with LLMs
by: Kobalczyk, Katarzyna, et al.
Published: (2025)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
by: Arteaga, Gabriel Y., et al.
Published: (2024)

In-context Learning in Presence of Spurious Correlations
by: Harutyunyan, Hrayr, et al.
Published: (2024)

Guideline Learning for In-context Information Extraction
by: Pang, Chaoxu, et al.
Published: (2023)

In-context Learning and Gradient Descent Revisited
by: Deutch, Gilad, et al.
Published: (2023)

Towards Modular LLMs by Building and Reusing a Library of LoRAs
by: Ostapenko, Oleksiy, et al.
Published: (2024)

JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models
by: Arefa, et al.
Published: (2024)