Image de couverture de livre

Linguistic Interpretability of Transformer-based Language Models: a systematic review

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	López-Otal, Miguel, Gracia, Jorge, Bernad, Jordi, Bobed, Carlos, Pitarch-Ballesteros, Lucía, Anglés-Herrero, Emma
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language I.2.7
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?
par: Collado-Montañez, Jaime, et autres
Publié: (2025)

A systematic review of relation extraction task since the emergence of Transformers
par: Celian, Ringwald, et autres
Publié: (2025)

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
par: Rai, Daking, et autres
Publié: (2024)

CRISP: Persistent Concept Unlearning via Sparse Autoencoders
par: Ashuach, Tomer, et autres
Publié: (2025)

PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin
par: Bothwell, Stephen, et autres
Publié: (2024)

Predictive Simultaneous Interpretation: Harnessing Large Language Models for Democratizing Real-Time Multilingual Communication
par: Iida, Kurando, et autres
Publié: (2024)

LegalGuardian: A Privacy-Preserving Framework for Secure Integration of Large Language Models in Legal Practice
par: Demir, M. Mikail, et autres
Publié: (2025)

Merge-Bench: Resolve Merge Conflicts with Large Language Models
par: Schesch, Benedikt, et autres
Publié: (2026)

Automated Bug Triaging using Instruction-Tuned Large Language Models
par: Kiashemshaki, Kiana, et autres
Publié: (2025)

Integrating Emotional and Linguistic Models for Ethical Compliance in Large Language Models
par: Chang, Edward Y.
Publié: (2024)

Linguistically-Informed Multilingual Instruction Tuning: Is There an Optimal Set of Languages to Tune?
par: Soykan, Gürkan, et autres
Publié: (2024)

Combining Denoising Autoencoders with Contrastive Learning to fine-tune Transformer Models
par: Lopez-Avila, Alejo, et autres
Publié: (2024)

Contrasting Linguistic Patterns in Human and LLM-Generated News Text
par: Muñoz-Ortiz, Alberto, et autres
Publié: (2023)

Prototype Transformer: Towards Language Model Architectures Interpretable by Design
par: Yordanov, Yordan, et autres
Publié: (2026)

Comparing Complex Concepts with Transformers: Matching Patent Claims Against Natural Language Text
par: Blume, Matthias, et autres
Publié: (2024)

MCP: A Control-Theoretic Orchestration Framework for Synergistic Efficiency and Interpretability in Multimodal Large Language Models
par: Zhang, Luyan
Publié: (2025)

Lisbon Computational Linguists at SemEval-2024 Task 2: Using A Mistral 7B Model and Data Augmentation
par: Guimarães, Artur, et autres
Publié: (2024)

RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs
par: Saji, Alan, et autres
Publié: (2025)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
par: Peters, Sydney, et autres
Publié: (2025)

How Human-Like Are Large Language Models? A Register-Aware Linguistic Evaluation Framework
par: Nieth, Björn, et autres
Publié: (2026)

Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformers
par: Riemenschneider, Frederick, et autres
Publié: (2024)

Data-driven Circuit Discovery for Interpretability of Language Models
par: Rai, Daking, et autres
Publié: (2026)

Have Multimodal Large Language Models (MLLMs) Really Learned to Tell the Time on Analog Clocks?
par: Fu, Tairan, et autres
Publié: (2025)

PeLLE: Encoder-based language models for Brazilian Portuguese based on open data
par: de Mello, Guilherme Lamartine, et autres
Publié: (2024)

Fine-tuning of Large Language Models for Constituency Parsing Using a Sequence to Sequence Approach
par: Delgado, Francisco Jose Cortes, et autres
Publié: (2025)

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models
par: Moghadasi, Mahdi Naser, et autres
Publié: (2026)

SAGE: Hierarchical LLM-Based Literary Evaluation through Ontology-Grounded Interpretive Dimensions
par: Wang, Tianyu, et autres
Publié: (2026)

The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders
par: Sauter, Adrian, et autres
Publié: (2025)

Explainable AI for Smart Greenhouse Control: Interpretability of Temporal Fusion Transformer in the Internet of Robotic Things
par: Bashir, Muhammad Jawad, et autres
Publié: (2025)

Boosting Accuracy and Interpretability in Multilingual Hate Speech Detection Through Layer Freezing and Explainable AI
par: Bilehsavar, Meysam Shirdel, et autres
Publié: (2026)

On Initializing Transformers with Pre-trained Embeddings
par: Kim, Ha Young, et autres
Publié: (2024)

Pareto-Optimized Open-Source LLMs for Healthcare via Context Retrieval
par: Bayarri-Planas, Jordi, et autres
Publié: (2024)

Automated CAD Modeling Sequence Generation from Text Descriptions via Transformer-Based Large Language Models
par: Liao, Jianxing, et autres
Publié: (2025)

Software Implementation of Digital Filtering via Tustin's Bilinear Transform
par: Herron, Connor W.
Publié: (2024)

Toward Architecture-Aware Evaluation Metrics for LLM Agents
par: Souza, Débora, et autres
Publié: (2026)

SeLeRoSa: Sentence-Level Romanian Satire Detection Dataset
par: Smădu, Răzvan-Alexandru, et autres
Publié: (2025)

Steer-MoE: Efficient Audio-Language Alignment with a Mixture-of-Experts Steering Module
par: Feng, Ruitao, et autres
Publié: (2025)

A Stochastic Analysis of the Linguistic Provenance of English Place Names
par: Dalvean, Michael
Publié: (2023)

Large Language Model (LLM) Bias Index -- LLMBI
par: Oketunji, Abiodun Finbarrs, et autres
Publié: (2023)

Engineering A Large Language Model From Scratch
par: Oketunji, Abiodun Finbarrs
Publié: (2024)