Cover Image

Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Zuyuan, Tang, Sizhe, Lan, Tian
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Metric-Gradient Projection for Stable Multi-Agent Policy Learning
by: Zhang, Zuyuan, et al.
Published: (2026)

Operator-Guided Invariance Learning for Continuous Reinforcement Learning
by: Zhang, Zuyuan, et al.
Published: (2026)

Matrix-Space Reinforcement Learning for Reusing Local Transition Geometry
by: Zhang, Zuyuan, et al.
Published: (2026)

Geometry of Drifting MDPs with Path-Integral Stability Certificates
by: Zhang, Zuyuan, et al.
Published: (2026)

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees
by: Zhang, Zuyuan, et al.
Published: (2025)

Reason in Chains, Learn in Trees: Self-Rectification and Grafting for Multi-turn Agent Policy Optimization
by: Li, Yu, et al.
Published: (2026)

Manifold-Constrained Energy-Based Transition Models for Offline Reinforcement Learning
by: Fang, Zeyu, et al.
Published: (2026)

NonZero: Interaction-Guided Exploration for Multi-Agent Monte Carlo Tree Search
by: Tang, Sizhe, et al.
Published: (2026)

Interactive Critique-Revision Training for Reliable Structured LLM Generation
by: Yu, Fei Xu, et al.
Published: (2026)

Almost Sure Convergence of Differential Temporal Difference Learning for Average Reward Markov Decision Processes
by: Blaser, Ethan, et al.
Published: (2026)

Structuring Value Representations via Geometric Coherence in Markov Decision Processes
by: Zhang, Zuyuan, et al.
Published: (2026)

Cooperative Backdoor Attack in Decentralized Reinforcement Learning with Theoretical Guarantee
by: Gao, Mengtong, et al.
Published: (2024)

Discerning Temporal Difference Learning
by: Ma, Jianfei
Published: (2023)

Backstepping Temporal Difference Learning
by: Lim, Han-Dong, et al.
Published: (2023)

Gradient Iterated Temporal-Difference Learning
by: Vincent, Théo, et al.
Published: (2026)

Temporal-Difference Variational Continual Learning
by: Melo, Luckeciano C., et al.
Published: (2024)

Lipschitz Lifelong Monte Carlo Tree Search for Mastering Non-Stationary Tasks
by: Zhang, Zuyuan, et al.
Published: (2025)

Almost Sure Convergence of Linear Temporal Difference Learning with Arbitrary Features
by: Wang, Jiuqi, et al.
Published: (2024)

Demystifying the Recency Heuristic in Temporal-Difference Learning
by: Daley, Brett, et al.
Published: (2024)

ITPP: Learning Disentangled Event Dynamics in Marked Temporal Point Processes
by: Zhou, Wang-Tao, et al.
Published: (2025)

Finite Sample Analysis of Linear Temporal Difference Learning with Arbitrary Features
by: Xie, Zixuan, et al.
Published: (2025)

Learning Spatio-Temporal Dynamics for Trajectory Recovery via Time-Aware Transformer
by: Sun, Tian, et al.
Published: (2025)

Is Temporal Difference Learning the Gold Standard for Stitching in RL?
by: Bortkiewicz, Michał, et al.
Published: (2025)

A Variance Minimization Approach to Temporal-Difference Learning
by: Chen, Xingguo, et al.
Published: (2024)

Temporal Difference Flows
by: Farebrother, Jesse, et al.
Published: (2025)

Deep Generative Models for Offline Policy Learning: Tutorial, Survey, and Perspectives on Future Directions
by: Chen, Jiayu, et al.
Published: (2024)

An MRP Formulation for Supervised Learning: Generalized Temporal Difference Learning Models
by: Pan, Yangchen, et al.
Published: (2024)

Markov Decision Processes under External Temporal Processes
by: Ayyagari, Ranga Shaarad, et al.
Published: (2023)

Deep Reinforcement Learning and The Tale of Two Temporal Difference Errors
by: Rojas, Juan Sebastian, et al.
Published: (2026)

Finite-Time Analysis of Temporal Difference Learning with Experience Replay
by: Lim, Han-Dong, et al.
Published: (2023)

Learning Robust Spectral Dynamics for Temporal Domain Generalization
by: Yu, En, et al.
Published: (2025)

Second-Order Convergence in Private Stochastic Non-Convex Optimization
by: Tao, Youming, et al.
Published: (2025)

Learning Multi-graph Structure for Temporal Knowledge Graph Reasoning
by: Zhang, Jinchuan, et al.
Published: (2023)

An Analysis of Action-Value Temporal-Difference Methods That Learn State Values
by: Daley, Brett, et al.
Published: (2025)

Improving Day-Ahead Grid Carbon Intensity Forecasting by Joint Modeling of Local-Temporal and Cross-Variable Dependencies Across Different Frequencies
by: Zhang, Bowen, et al.
Published: (2026)

Bootstrapped Model Predictive Control
by: Wang, Yuhang, et al.
Published: (2025)

Beyond Static Uncertainty: Modeling Temporal Uncertainty Dynamics for Probabilistic Time Series Forecasting
by: Wang, Yijun, et al.
Published: (2026)

ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning
by: Sun, Zhishen, et al.
Published: (2026)

Temporalizing Confidence: Evaluation of Chain-of-Thought Reasoning with Signal Temporal Logic
by: Mao, Zhenjiang, et al.
Published: (2025)

Beyond Attention: Learning Spatio-Temporal Dynamics with Emergent Interpretable Topologies
by: Alisetti, Sai Vamsi, et al.
Published: (2025)