Cover Image

The representation landscape of few-shot learning and fine-tuning in large language models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Doimo, Diego, Serra, Alessandro, Ansuini, Alessio, Cazzaniga, Alberto
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models
by: Serra, Alessandro Pietro, et al.
Published: (2024)

Persistent Topological Features in Large Language Models
by: Gardinazzi, Yuri, et al.
Published: (2024)

Head Pursuit: Probing Attention Specialization in Multimodal Transformers
by: Basile, Lorenzo, et al.
Published: (2025)

Emergent representations in networks trained with the Forward-Forward algorithm
by: Tosato, Niccolò, et al.
Published: (2023)

Zero-shot generation of synthetic neurosurgical data with large language models
by: Barr, Austin A., et al.
Published: (2025)

Deep literature reviews: an application of fine-tuned language models to migration research
by: Iacus, Stefano M., et al.
Published: (2025)

A comparative study of zero-shot inference with large language models and supervised modeling in breast cancer pathology classification
by: Sushil, Madhumita, et al.
Published: (2024)

Learning diverse attacks on large language models for robust red-teaming and safety tuning
by: Lee, Seanie, et al.
Published: (2024)

Complexity-aware fine-tuning
by: Goncharov, Andrey, et al.
Published: (2025)

Large language models reorganize representational geometry during in-context learning
by: Xiong, Hua-Dong, et al.
Published: (2026)

How does fine-tuning improve sensorimotor representations in large language models?
by: Wu, Minghua, et al.
Published: (2026)

Zero-shot data citation function classification using transformer-based large language models (LLMs)
by: Byers, Neil, et al.
Published: (2025)

Perturbation: A simple and efficient adversarial tracer for representation learning in language models
by: Rozner, Joshua, et al.
Published: (2026)

Amortizing intractable inference in large language models
by: Hu, Edward J., et al.
Published: (2023)

Blending adversarial training and representation-conditional purification via aggregation improves adversarial robustness
by: Ballarin, Emanuele, et al.
Published: (2023)

Representation in large language models
by: Yetman, Cameron
Published: (2025)

Replaying pre-training data improves fine-tuning
by: Kotha, Suhas, et al.
Published: (2026)

Rethinking harmless refusals when fine-tuning foundation models
by: Pop, Florin, et al.
Published: (2024)

Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals
by: Ortu, Francesco, et al.
Published: (2024)

Prompt reinforcing for long-term planning of large language models
by: Lin, Hsien-Chin, et al.
Published: (2025)

AI-AI Bias: large language models favor communications generated by large language models
by: Laurito, Walter, et al.
Published: (2024)

Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs
by: Zhong, Ziqian, et al.
Published: (2025)

Alignment faking in large language models
by: Greenblatt, Ryan, et al.
Published: (2024)

Evaluating the fairness of task-adaptive pretraining on unlabeled test data before few-shot text classification
by: Dubey, Kush
Published: (2024)

The Geometry of Tokens in Internal Representations of Large Language Models
by: Viswanathan, Karthik, et al.
Published: (2025)

Linear representations in language models can change dramatically over a conversation
by: Lampinen, Andrew Kyle, et al.
Published: (2026)

An unsupervised tour through the hidden pathways of deep neural networks
by: Doimo, Diego
Published: (2025)

Only relative ranks matter in weight-clustered large language models
by: Aizpurua, Borja, et al.
Published: (2026)

You can remove GPT2's LayerNorm by fine-tuning
by: Heimersheim, Stefan
Published: (2024)

LayerNorm: A key component in parameter-efficient fine-tuning
by: ValizadehAslani, Taha, et al.
Published: (2024)

Enhancing ASD detection accuracy: a combined approach of machine learning and deep learning models with natural language processing
by: Rubio-Martín, Sergio, et al.
Published: (2024)

Do different prompting methods yield a common task representation in language models?
by: Davidson, Guy, et al.
Published: (2025)

RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models
by: Najafi, Saeed, et al.
Published: (2024)

Long-form factuality in large language models
by: Wei, Jerry, et al.
Published: (2024)

Can large language models explore in-context?
by: Krishnamurthy, Akshay, et al.
Published: (2024)

Quantifying perturbation impacts for large language models
by: Rauba, Paulius, et al.
Published: (2024)

Question answering system of bridge design specification based on large language model
by: Zhang, Leye, et al.
Published: (2024)

B-score: Detecting biases in large language models using response history
by: Vo, An, et al.
Published: (2025)

Leveraging large language models for structured information extraction from pathology reports
by: Balasubramanian, Jeya Balaji, et al.
Published: (2025)

ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography
by: Ahrens, Lara, et al.
Published: (2025)