Imagen de Portada

DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Langedijk, Anna, Mohebbi, Hosein, Sarti, Gabriele, Zuidema, Willem, Jumelet, Jaap
Formato:	Preprint
Publicado:	2023
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Propositional Logic for Probing Generalization in Neural Networks
por: Langedijk, Anna, et al.
Publicado: (2025)

Do Language Models Exhibit Human-like Structural Priming Effects?
por: Jumelet, Jaap, et al.
Publicado: (2024)

Black Big Boxes: Tracing Adjective Order Preferences in Large Language Models
por: Jumelet, Jaap, et al.
Publicado: (2024)

In-Context Learning in Speech Language Models: Analyzing the Role of Acoustic Features, Linguistic Structure, and Induction Heads
por: Pouw, Charlotte, et al.
Publicado: (2026)

Finding Structure in Language Models
por: Jumelet, Jaap
Publicado: (2024)

Disentangling Textual and Acoustic Features of Neural Speech Representations
por: Mohebbi, Hosein, et al.
Publicado: (2024)

Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures
por: Manna, Chiara, et al.
Publicado: (2026)

Bridging Logic and Learning: Decoding Temporal Logic Embeddings via Transformers
por: Candussio, Sara, et al.
Publicado: (2025)

Efficient Encoder-Decoder Transformer Decoding for Decomposable Tasks
por: Lu, Bo-Ru, et al.
Publicado: (2024)

Tracking the emergence of linguistic structure in self-supervised models learning from speech
por: Kloots, Marianne de Heer, et al.
Publicado: (2026)

Encoder-Decoder or Decoder-Only? Revisiting Encoder-Decoder Large Language Model
por: Zhang, Biao, et al.
Publicado: (2025)

What do self-supervised speech models know about Dutch? Analyzing advantages of language-specific pre-training
por: Kloots, Marianne de Heer, et al.
Publicado: (2025)

Interpretability of Language Models via Task Spaces
por: Weber, Lucas, et al.
Publicado: (2024)

Assessing the Impact of Typological Features on Multilingual Machine Translation in the Age of Large Language Models
por: Hirak, Vitalii, et al.
Publicado: (2026)

The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders
por: Sauter, Adrian, et al.
Publicado: (2025)

Fretting-Transformer: Encoder-Decoder Model for MIDI to Tablature Transcription
por: Hamberger, Anna, et al.
Publicado: (2025)

Findings of the BlackboxNLP 2025 Shared Task: Localizing Circuits and Causal Variables in Language Models
por: Arad, Dana, et al.
Publicado: (2025)

How Language Models Prioritize Contextual Grammatical Cues?
por: Amirzadeh, Hamidreza, et al.
Publicado: (2024)

Decoders Laugh as Loud as Encoders
por: Borodach, Eli, et al.
Publicado: (2025)

Is Child-Directed Language Optimized for Word Learning? A Computational Study of Verb Meaning Acquisition
por: Padovani, Francesca, et al.
Publicado: (2026)

Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Models
por: Padovani, Francesca, et al.
Publicado: (2025)

TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs
por: Başar, Ezgi, et al.
Publicado: (2025)

MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
por: Jumelet, Jaap, et al.
Publicado: (2025)

Transformer See, Transformer Do: Copying as an Intermediate Step in Learning Analogical Reasoning
por: Hellwig, Philipp, et al.
Publicado: (2026)

A Linguistically Motivated Analysis of Intonational Phrasing in Text-to-Speech Systems: Revealing Gaps in Syntactic Sensitivity
por: Pouw, Charlotte, et al.
Publicado: (2025)

Small Encoders Can Rival Large Decoders in Detecting Groundedness
por: Abbes, Istabrak, et al.
Publicado: (2025)

Please Make it Sound like Human: Encoder-Decoder vs. Decoder-Only Transformers for AI-to-Human Text Style Transfer
por: Paneru, Utsav
Publicado: (2026)

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization
por: Nair, Sindhu, et al.
Publicado: (2024)

Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement
por: Sarti, Gabriele, et al.
Publicado: (2025)

Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models
por: Yousefi, Safoora, et al.
Publicado: (2023)

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder
por: M., Abhinav P., et al.
Publicado: (2024)

Rethinking the adaptive relationship between Encoder Layers and Decoder Layers
por: Song, Yubo
Publicado: (2024)

Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks
por: Nielsen, Dan Saattrup, et al.
Publicado: (2024)

Exploiting Pre-trained Encoder-Decoder Transformers for Sequence-to-Sequence Constituent Parsing
por: Fernández-González, Daniel, et al.
Publicado: (2026)

Romanized to Native Malayalam Script Transliteration Using an Encoder-Decoder Framework
por: Baiju, Bajiyo, et al.
Publicado: (2024)

Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It)
por: Miaschi, Alessio, et al.
Publicado: (2024)

IT5: Text-to-text Pretraining for Italian Language Understanding and Generation
por: Sarti, Gabriele, et al.
Publicado: (2022)

Training and Inference Efficiency of Encoder-Decoder Speech Models
por: Żelasko, Piotr, et al.
Publicado: (2025)

Vocabulary shapes cross-lingual variation of word-order learnability in language models
por: Martins, Jonas Mayer, et al.
Publicado: (2026)

Causal Reasoning Favors Encoders: On The Limits of Decoder-Only Models
por: Roy, Amartya, et al.
Publicado: (2025)