Cover Image

Understanding Transformer Encoder-Decoder Representations through Bernoulli Dropout

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Chen, Xuanzhou
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Variational Encoder-Decoders for Learning Latent Representations of Physical Systems
by: Venkatasubramanian, Subashree, et al.
Published: (2024)

Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures
by: Silva, Jorge F., et al.
Published: (2024)

Enhancing Transformer Training Efficiency with Dynamic Dropout
by: Yan, Hanrui, et al.
Published: (2024)

Understanding the Natural Language of DNA using Encoder-Decoder Foundation Models with Byte-level Precision
by: Malusare, Aditya, et al.
Published: (2023)

TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation
by: Uludoğan, Gökçe, et al.
Published: (2024)

Plan, Verify and Fill: A Structured Parallel Decoding Approach for Diffusion Language Models
by: Li, Miao, et al.
Published: (2026)

Enhancing Vision-Language Model Reliability with Uncertainty-Guided Dropout Decoding
by: Fang, Yixiong, et al.
Published: (2024)

Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders
by: Kumar, Amandeep, et al.
Published: (2026)

TEE4EHR: Transformer Event Encoder for Better Representation Learning in Electronic Health Records
by: Karami, Hojjat, et al.
Published: (2024)

Representation Learning of Daily Movement Data Using Text Encoders
by: Capstick, Alexander, et al.
Published: (2024)

FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups
by: Nanfack, Geraldin, et al.
Published: (2025)

Short-term Inland Vessel Trajectory Prediction with Encoder-Decoder Models
by: Donandt, Kathrin, et al.
Published: (2024)

Geometry-Preserving Encoder/Decoder in Latent Generative Models
by: Lee, Wonjun, et al.
Published: (2025)

Dropout Robustness and Cognitive Profiling of Transformer Models via Stochastic Inference
by: Caiado, Antônio Junior Alves, et al.
Published: (2026)

AFN: Adaptive Fusion Normalization via an Encoder-Decoder Framework
by: Zhou, Zikai, et al.
Published: (2023)

Understanding Matching Mechanisms in Cross-Encoders
by: Vast, Mathias, et al.
Published: (2025)

KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning
by: Yu, Fangchen, et al.
Published: (2024)

Diffusion Bridge AutoEncoders for Unsupervised Representation Learning
by: Kim, Yeongmin, et al.
Published: (2024)

Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks
by: Nielsen, Dan Saattrup, et al.
Published: (2024)

Enhancing Authorship Attribution through Embedding Fusion: A Novel Approach with Masked and Encoder-Decoder Language Models
by: Kaushik, Arjun Ramesh, et al.
Published: (2024)

Encoder-Decoder Diffusion Language Models for Efficient Training and Inference
by: Arriola, Marianne, et al.
Published: (2025)

Causal Reasoning Favors Encoders: On The Limits of Decoder-Only Models
by: Roy, Amartya, et al.
Published: (2025)

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder
by: M., Abhinav P., et al.
Published: (2024)

Efficient Sparse Training with Structured Dropout
by: Lo, Andy
Published: (2024)

Continuum Dropout for Neural Differential Equations
by: Lee, Jonghun, et al.
Published: (2025)

Predicting and Explaining Hearing Aid Usage Using Encoder-Decoder with Attention Mechanism and SHAP
by: Su, Qiqi, et al.
Published: (2024)

Explicit Dropout: Deterministic Regularization for Transformer Architectures
by: Agrawal, Vidhi, et al.
Published: (2026)

Rethinking Encoder-Decoder Flow Through Shared Structures
by: Laboyrie, Frederik, et al.
Published: (2025)

RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
by: Huang, Jie, et al.
Published: (2023)

Adapting Decoder-Based Language Models for Diverse Encoder Downstream Tasks
by: Suganthan, Paul, et al.
Published: (2025)

TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series Forecasting
by: Lee, Jaebin, et al.
Published: (2025)

DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders
by: Hou, Sizai, et al.
Published: (2024)

Encoder Decoder Generative Adversarial Network Model for Stock Market Prediction
by: Yadav, Bahadur, et al.
Published: (2025)

Switch-Hurdle: A MoE Encoder with AR Hurdle Decoder for Intermittent Demand Forecasting
by: Muşat, Fabian, et al.
Published: (2026)

Micro-Macro Spatial-Temporal Graph-based Encoder-Decoder for Map-Constrained Trajectory Recovery
by: Wei, Tonglong, et al.
Published: (2024)

Unreliable Uncertainty Estimates with Monte Carlo Dropout
by: Djupskås, Aslak, et al.
Published: (2025)

Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation
by: Hsu, Hsiang, et al.
Published: (2024)

HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representations
by: Carrasco, Martin, et al.
Published: (2025)

SIEDD: Shared-Implicit Encoder with Discrete Decoders
by: Rangarajan, Vikram, et al.
Published: (2025)

Dropout Drops Double Descent
by: Yang, Tian-Le, et al.
Published: (2023)