Cover Image

Architecture Determines Observability of Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Carmichael, Thomas
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformer-Based Reinforcement Learning for Autonomous Orbital Collision Avoidance in Partially Observable Environments
by: Georges, Thomas, et al.
Published: (2026)

Toto: Time Series Optimized Transformer for Observability
by: Cohen, Ben, et al.
Published: (2024)

On Limitations of the Transformer Architecture
by: Peng, Binghui, et al.
Published: (2024)

Causal Imitation Learning under Expert-Observable and Expert-Unobservable Confounding
by: Shao, Daqian, et al.
Published: (2025)

Finding Clustering Algorithms in the Transformer Architecture
by: Clarkson, Kenneth L., et al.
Published: (2025)

OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularization
by: Kan, Kelvin, et al.
Published: (2025)

Interpretable-by-Design Transformers via Architectural Stream Independence
by: Kerce, Clayton, et al.
Published: (2026)

A Survey of Graph Transformers: Architectures, Theories and Applications
by: Yuan, Chaohao, et al.
Published: (2025)

This Probably Looks Exactly Like That: An Invertible Prototypical Network
by: Carmichael, Zachariah, et al.
Published: (2024)

Zero-Shot Reinforcement Learning Under Partial Observability
by: Jeen, Scott, et al.
Published: (2025)

Multi-View Causal Representation Learning with Partial Observability
by: Yao, Dingling, et al.
Published: (2023)

On Exact Bit-level Reversible Transformers Without Changing Architectures
by: Zhang, Guoqiang, et al.
Published: (2024)

Generative Modeling of Networked Time-Series via Transformer Architectures
by: Elnady, Yusuf
Published: (2025)

Decision Transformer as a Foundation Model for Partially Observable Continuous Control
by: Zhang, Xiangyuan, et al.
Published: (2024)

LLMs for Text-Based Exploration and Navigation Under Partial Observability
by: Sandfuchs, Stephan, et al.
Published: (2026)

Enhancing GNNs with Architecture-Agnostic Graph Transformations: A Systematic Analysis
by: Li, Zhifei, et al.
Published: (2024)

TART: Token-based Architecture Transformer for Neural Network Performance Prediction
by: He, Yannis Y.
Published: (2025)

Triple Attention Transformer Architecture for Time-Dependent Concrete Creep Prediction
by: Dokduea, Warayut, et al.
Published: (2025)

This Time is Different: An Observability Perspective on Time Series Foundation Models
by: Cohen, Ben, et al.
Published: (2025)

A Sparsity Principle for Partially Observable Causal Representation Learning
by: Xu, Danru, et al.
Published: (2024)

An Empirical Study on the Power of Future Prediction in Partially Observable Environments
by: Kwon, Jeongyeol, et al.
Published: (2024)

Temporal Knowledge-Graph Memory in a Partially Observable Environment
by: Kim, Taewoon, et al.
Published: (2024)

Provable Representation with Efficient Planning for Partial Observable Reinforcement Learning
by: Zhang, Hongming, et al.
Published: (2023)

ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling
by: Zhang, Yuanyun, et al.
Published: (2025)

Recurrent Deep Reinforcement Learning for Chemotherapy Control under Partial Observability
by: Kiram, Firas Mohamed Elamine, et al.
Published: (2026)

Adversarial Latent-State Training for Robust Policies in Partially Observable Domains
by: Ahuja, Angad Singh
Published: (2026)

Why Linear Recurrent Memory Works in Partially Observable Reinforcement Learning
by: Zhao, Yike, et al.
Published: (2026)

Online Feedback Efficient Active Target Discovery in Partially Observable Environments
by: Sarkar, Anindya, et al.
Published: (2025)

Mitigating Partial Observability in Sequential Decision Processes via the Lambda Discrepancy
by: Allen, Cameron, et al.
Published: (2024)

Partially Observable Gaussian Process Network and Doubly Stochastic Variational Inference
by: Kiroriwal, Saksham, et al.
Published: (2025)

Learning Generalized Policies for Fully Observable Non-Deterministic Planning Domains
by: Hofmann, Till, et al.
Published: (2024)

Guided Policy Optimization under Partial Observability
by: Li, Yueheng, et al.
Published: (2025)

Resource-Efficient Transformer Architecture: Optimizing Memory and Execution Time for Real-Time Applications
by: V, Krisvarish, et al.
Published: (2024)

Ontology-Enhanced Decision-Making for Autonomous Agents in Dynamic and Partially Observable Environments
by: Ghanadbashi, Saeedeh, et al.
Published: (2024)

Benchmarking Partial Observability in Reinforcement Learning with a Suite of Memory-Improvable Domains
by: Tao, Ruo Yu, et al.
Published: (2025)

Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability
by: Pritz, Paul J., et al.
Published: (2025)

Near-Optimal Partially Observable Reinforcement Learning with Partial Online State Information
by: Shi, Ming, et al.
Published: (2023)

On the Role of Information Structure in Reinforcement Learning for Partially-Observable Sequential Teams and Games
by: Altabaa, Awni, et al.
Published: (2024)

A Convolution and Attention Based Encoder for Reinforcement Learning under Partial Observability
by: Wang, Wuhao, et al.
Published: (2025)

The Initialization Determines Whether In-Context Learning Is Gradient Descent
by: Xie, Shifeng, et al.
Published: (2025)