Image de couverture de livre

On Limitation of Transformer for Learning HMMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Hu, Jiachen, Liu, Qinghua, Jin, Chi
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Most Likely Sequence Generation for $n$-Grams, Transformers, HMMs, and Markov Chains, by Using Rollout Algorithms
par: Li, Yuchao, et autres
Publié: (2024)

Fraud Detection Through Large-Scale Graph Clustering with Heterogeneous Link Transformation
par: Liu, Chi
Publié: (2025)

Multimodal Negative Learning
par: Gong, Baoquan, et autres
Publié: (2025)

On Limitations of the Transformer Architecture
par: Peng, Binghui, et autres
Publié: (2024)

In-Context Learning for Non-Stationary MIMO Equalization
par: Jiang, Jiachen, et autres
Publié: (2025)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
par: Zhu, Yuxuan, et autres
Publié: (2024)

Selective Learning: Towards Robust Calibration with Dynamic Regularization
par: Han, Zongbo, et autres
Publié: (2024)

Beyond Frequency: The Role of Redundancy in Large Language Model Memorization
par: Zhang, Jie, et autres
Publié: (2025)

Fundamental Limits of Prompt Tuning Transformers: Universality, Capacity and Efficiency
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)

Sci-Reasoning: A Dataset Decoding AI Innovation Patterns
par: Liu, Jiachen, et autres
Publié: (2026)

Imagination-Limited Q-Learning for Offline Reinforcement Learning
par: Liu, Wenhui, et autres
Publié: (2025)

Limits of Transformer Language Models on Learning to Compose Algorithms
par: Thomm, Jonathan, et autres
Publié: (2024)

Dual-perspective Cross Contrastive Learning in Graph Transformers
par: Yao, Zelin, et autres
Publié: (2024)

Ratio law: mathematical descriptions for a universal relationship between AI performance and input samples
par: Kang, Boming, et autres
Publié: (2024)

Graph Q-Learning for Combinatorial Optimization
par: Dax, Victoria M., et autres
Publié: (2024)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)

Agentic Transformers Provably Learn to Search via Reinforcement Learning
par: Yang, Tong, et autres
Publié: (2026)

The Belief State Transformer
par: Hu, Edward S., et autres
Publié: (2024)

On The Statistical Limits of Self-Improving Agents
par: Wang, Charles L., et autres
Publié: (2025)

Every Node is Different: Dynamically Fusing Self-Supervised Tasks for Attributed Graph Clustering
par: Zhu, Pengfei, et autres
Publié: (2024)

Beyond Prior Limits: Addressing Distribution Misalignment in Particle Filtering
par: Shi, Yiwei, et autres
Publié: (2025)

Provably Efficient Exploration in Quantum Reinforcement Learning with Logarithmic Worst-Case Regret
par: Zhong, Han, et autres
Publié: (2023)

Machine Unlearning in Low-Dimensional Feature Subspace
par: Fang, Kun, et autres
Publié: (2026)

CLDG: Contrastive Learning on Dynamic Graphs
par: Xu, Yiming, et autres
Publié: (2024)

In-Context Algorithm Emulation in Fixed-Weight Transformers
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2025)

On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)

Generalization Limits of Reinforcement Learning Alignment
par: Shida, Haruhi, et autres
Publié: (2026)

SEBA: Sample-Efficient Black-Box Attacks on Visual Reinforcement Learning
par: Huang, Tairan, et autres
Publié: (2025)

In-Context Decision Transformer: Reinforcement Learning via Hierarchical Chain-of-Thought
par: Huang, Sili, et autres
Publié: (2024)

InjectTST: A Transformer Method of Injecting Global Information into Independent Channels for Long Time Series Forecasting
par: Chi, Ce, et autres
Publié: (2024)

Rethinking Transformers in Solving POMDPs
par: Lu, Chenhao, et autres
Publié: (2024)

DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolution
par: Jiang, Jiachen, et autres
Publié: (2026)

Transformers as Multi-task Learners: Decoupling Features in Hidden Markov Models
par: Hao, Yifan, et autres
Publié: (2025)

ElastiFormer: Learned Redundancy Reduction in Transformer via Self-Distillation
par: Liu, Junzhang, et autres
Publié: (2024)

Transformer Approximations from ReLUs
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2026)

Adaptive Graph Learning with Transformer for Multi-Reservoir Inflow Prediction
par: Hu, Pengfei, et autres
Publié: (2025)

On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recovery
par: Liu, Renpu, et autres
Publié: (2024)

Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy
par: Guan, Yunchuan, et autres
Publié: (2025)

Transformers Provably Learn Chain-of-Thought Reasoning with Length Generalization
par: Huang, Yu, et autres
Publié: (2025)

Renaissance of RNNs in Streaming Clinical Time Series: Compact Recurrence Remains Competitive with Transformers
par: Tong, Ran, et autres
Publié: (2025)