Image de couverture de livre

Improving Data and Parameter Efficiency of Neural Language Models Using Representation Analysis

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Jukić, Josip
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

From Robustness to Improved Generalization and Calibration in Pre-trained Language Models
par: Jukić, Josip, et autres
Publié: (2024)

Disentangling Latent Shifts of In-Context Learning with Weak Supervision
par: Jukić, Josip, et autres
Publié: (2024)

Context Parametrization with Compositional Adapters
par: Jukić, Josip, et autres
Publié: (2025)

Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
par: Dukić, David, et autres
Publié: (2025)

Out-of-Distribution Detection by Leveraging Between-Layer Transformation Smoothness
par: Jelenić, Fran, et autres
Publié: (2023)

Performance Trade-offs of Optimizing Small Language Models for E-Commerce
par: Licardo, Josip Tomo, et autres
Publié: (2025)

Improved Representation Steering for Language Models
par: Wu, Zhengxuan, et autres
Publié: (2025)

Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models
par: Zhang, Yunhao, et autres
Publié: (2024)

Improving the Efficiency of Visually Augmented Language Models
par: Ontalvilla, Paula, et autres
Publié: (2024)

Advancing Parameter Efficiency in Fine-tuning via Representation Editing
par: Wu, Muling, et autres
Publié: (2024)

Representational Analysis of Binding in Language Models
par: Dai, Qin, et autres
Publié: (2024)

ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model
par: Gu, Shuhao, et autres
Publié: (2024)

ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis
par: Tu, Zeao, et autres
Publié: (2024)

Improving Multilingual Language Models by Aligning Representations through Steering
par: Mahmoud, Omar, et autres
Publié: (2025)

ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalization
par: Shi, Yunxiao, et autres
Publié: (2024)

On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
par: Nowak, Franz, et autres
Publié: (2024)

On the Representational Capacity of Recurrent Neural Language Models
par: Nowak, Franz, et autres
Publié: (2023)

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
par: Zhu, Qi, et autres
Publié: (2024)

Improving the Accuracy and Efficiency of Legal Document Tagging with Large Language Models and Instruction Prompts
par: Johnson, Emily, et autres
Publié: (2025)

Scaling Beyond Masked Diffusion Language Models
par: Sahoo, Subham Sekhar, et autres
Publié: (2026)

Relationship Detection on Tabular Data Using Statistical Analysis and Large Language Models
par: Koletsis, Panagiotis, et autres
Publié: (2025)

Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation
par: Sánchez-Cartagena, Víctor M., et autres
Publié: (2024)

Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis
par: Boughorbel, Sabri, et autres
Publié: (2024)

Vision-Language Models Align with Human Neural Representations in Concept Processing
par: Bavaresco, Anna, et autres
Publié: (2024)

Scaling Parameter-Constrained Language Models with Quality Data
par: Chang, Ernie, et autres
Publié: (2024)

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency
par: Aguda, Toyin, et autres
Publié: (2024)

Linguistic Entity Masking to Improve Cross-Lingual Representation of Multilingual Language Models for Low-Resource Languages
par: Fernando, Aloka, et autres
Publié: (2025)

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
par: Lemercier, Jean-Marie, et autres
Publié: (2026)

Investigating Low-Rank Training in Transformer Language Models: Efficiency and Scaling Analysis
par: Wei, Xiuying, et autres
Publié: (2024)

How Tokenization Limits Phonological Knowledge Representation in Language Models and How to Improve Them
par: Liao, Disen, et autres
Publié: (2026)

Analysis and Visualization of Linguistic Structures in Large Language Models: Neural Representations of Verb-Particle Constructions in BERT
par: Kissane, Hassane, et autres
Publié: (2024)

Speech Representation Learning Revisited: The Necessity of Separate Learnable Parameters and Robust Data Augmentation
par: Yadav, Hemant, et autres
Publié: (2024)

On Linear Representations and Pretraining Data Frequency in Language Models
par: Merullo, Jack, et autres
Publié: (2025)

Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
par: Cao, Jinghan, et autres
Publié: (2026)

Learning to Reduce: Optimal Representations of Structured Data in Prompting Large Language Models
par: Lee, Younghun, et autres
Publié: (2024)

Structured Code Representations Enable Data-Efficient Adaptation of Code Language Models
par: Agarwal, Mayank, et autres
Publié: (2024)

Improving Sample Efficiency of Reinforcement Learning with Background Knowledge from Large Language Models
par: Zhang, Fuxiang, et autres
Publié: (2024)

Improving Training Efficiency and Reducing Maintenance Costs via Language Specific Model Merging
par: Dmonte, Alphaeus, et autres
Publié: (2026)

Improving Data and Reward Design for Scientific Reasoning in Large Language Models
par: Chen, Zijie, et autres
Publié: (2026)

Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models
par: Yousefi, Safoora, et autres
Publié: (2023)