Copertina

Linguistic Interpretability of Transformer-based Language Models: a systematic review

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	López-Otal, Miguel, Gracia, Jorge, Bernad, Jordi, Bobed, Carlos, Pitarch-Ballesteros, Lucía, Anglés-Herrero, Emma
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language I.2.7
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?
di: Collado-Montañez, Jaime, et al.
Pubblicazione: (2025)

A systematic review of relation extraction task since the emergence of Transformers
di: Celian, Ringwald, et al.
Pubblicazione: (2025)

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
di: Rai, Daking, et al.
Pubblicazione: (2024)

CRISP: Persistent Concept Unlearning via Sparse Autoencoders
di: Ashuach, Tomer, et al.
Pubblicazione: (2025)

PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin
di: Bothwell, Stephen, et al.
Pubblicazione: (2024)

Predictive Simultaneous Interpretation: Harnessing Large Language Models for Democratizing Real-Time Multilingual Communication
di: Iida, Kurando, et al.
Pubblicazione: (2024)

LegalGuardian: A Privacy-Preserving Framework for Secure Integration of Large Language Models in Legal Practice
di: Demir, M. Mikail, et al.
Pubblicazione: (2025)

Merge-Bench: Resolve Merge Conflicts with Large Language Models
di: Schesch, Benedikt, et al.
Pubblicazione: (2026)

Automated Bug Triaging using Instruction-Tuned Large Language Models
di: Kiashemshaki, Kiana, et al.
Pubblicazione: (2025)

Integrating Emotional and Linguistic Models for Ethical Compliance in Large Language Models
di: Chang, Edward Y.
Pubblicazione: (2024)

Linguistically-Informed Multilingual Instruction Tuning: Is There an Optimal Set of Languages to Tune?
di: Soykan, Gürkan, et al.
Pubblicazione: (2024)

Combining Denoising Autoencoders with Contrastive Learning to fine-tune Transformer Models
di: Lopez-Avila, Alejo, et al.
Pubblicazione: (2024)

Contrasting Linguistic Patterns in Human and LLM-Generated News Text
di: Muñoz-Ortiz, Alberto, et al.
Pubblicazione: (2023)

Prototype Transformer: Towards Language Model Architectures Interpretable by Design
di: Yordanov, Yordan, et al.
Pubblicazione: (2026)

Comparing Complex Concepts with Transformers: Matching Patent Claims Against Natural Language Text
di: Blume, Matthias, et al.
Pubblicazione: (2024)

MCP: A Control-Theoretic Orchestration Framework for Synergistic Efficiency and Interpretability in Multimodal Large Language Models
di: Zhang, Luyan
Pubblicazione: (2025)

Lisbon Computational Linguists at SemEval-2024 Task 2: Using A Mistral 7B Model and Data Augmentation
di: Guimarães, Artur, et al.
Pubblicazione: (2024)

RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs
di: Saji, Alan, et al.
Pubblicazione: (2025)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
di: Peters, Sydney, et al.
Pubblicazione: (2025)

How Human-Like Are Large Language Models? A Register-Aware Linguistic Evaluation Framework
di: Nieth, Björn, et al.
Pubblicazione: (2026)

Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformers
di: Riemenschneider, Frederick, et al.
Pubblicazione: (2024)

Data-driven Circuit Discovery for Interpretability of Language Models
di: Rai, Daking, et al.
Pubblicazione: (2026)

Have Multimodal Large Language Models (MLLMs) Really Learned to Tell the Time on Analog Clocks?
di: Fu, Tairan, et al.
Pubblicazione: (2025)

PeLLE: Encoder-based language models for Brazilian Portuguese based on open data
di: de Mello, Guilherme Lamartine, et al.
Pubblicazione: (2024)

Fine-tuning of Large Language Models for Constituency Parsing Using a Sequence to Sequence Approach
di: Delgado, Francisco Jose Cortes, et al.
Pubblicazione: (2025)

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models
di: Moghadasi, Mahdi Naser, et al.
Pubblicazione: (2026)

SAGE: Hierarchical LLM-Based Literary Evaluation through Ontology-Grounded Interpretive Dimensions
di: Wang, Tianyu, et al.
Pubblicazione: (2026)

The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders
di: Sauter, Adrian, et al.
Pubblicazione: (2025)

Explainable AI for Smart Greenhouse Control: Interpretability of Temporal Fusion Transformer in the Internet of Robotic Things
di: Bashir, Muhammad Jawad, et al.
Pubblicazione: (2025)

Boosting Accuracy and Interpretability in Multilingual Hate Speech Detection Through Layer Freezing and Explainable AI
di: Bilehsavar, Meysam Shirdel, et al.
Pubblicazione: (2026)

On Initializing Transformers with Pre-trained Embeddings
di: Kim, Ha Young, et al.
Pubblicazione: (2024)

Pareto-Optimized Open-Source LLMs for Healthcare via Context Retrieval
di: Bayarri-Planas, Jordi, et al.
Pubblicazione: (2024)

Automated CAD Modeling Sequence Generation from Text Descriptions via Transformer-Based Large Language Models
di: Liao, Jianxing, et al.
Pubblicazione: (2025)

Software Implementation of Digital Filtering via Tustin's Bilinear Transform
di: Herron, Connor W.
Pubblicazione: (2024)

Toward Architecture-Aware Evaluation Metrics for LLM Agents
di: Souza, Débora, et al.
Pubblicazione: (2026)

SeLeRoSa: Sentence-Level Romanian Satire Detection Dataset
di: Smădu, Răzvan-Alexandru, et al.
Pubblicazione: (2025)

Steer-MoE: Efficient Audio-Language Alignment with a Mixture-of-Experts Steering Module
di: Feng, Ruitao, et al.
Pubblicazione: (2025)

A Stochastic Analysis of the Linguistic Provenance of English Place Names
di: Dalvean, Michael
Pubblicazione: (2023)

Large Language Model (LLM) Bias Index -- LLMBI
di: Oketunji, Abiodun Finbarrs, et al.
Pubblicazione: (2023)

Engineering A Large Language Model From Scratch
di: Oketunji, Abiodun Finbarrs
Pubblicazione: (2024)