Cover Image

Parameter-Free Federated TD Learning with Markov Noise in Heterogeneous Environments

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Naskar, Ankur, Thoppe, Gugan, Negi, Utsav, Gupta, Vijay
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Parameter-free Optimal Rates for Nonlinear Semi-Norm Contractions with Applications to $Q$-Learning
by: Naskar, Ankur, et al.
Published: (2025)

Reinforcement Learning for Exponential Utility: Algorithms and Convergence in Discounted MDPs
by: Thoppe, Gugan, et al.
Published: (2026)

Risk Estimation in a Markov Cost Process: Lower and Upper Bounds
by: Thoppe, Gugan, et al.
Published: (2023)

Does DQN Learn?
by: Gopalan, Aditya, et al.
Published: (2022)

Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries
by: Ganesh, Swetha, et al.
Published: (2024)

Reinforcement Learning with Quasi-Hyperbolic Discounting
by: Eshwar, S. R., et al.
Published: (2024)

What Can Be Recovered Under Sparse Adversarial Corruption? Assumption-Free Theory for Linear Measurements
by: Halder, Vishal, et al.
Published: (2025)

Reliable Policy Iteration: Performance Robustness Across Architecture and Environment Perturbations
by: Eshwar, S. R., et al.
Published: (2025)

Policy Gradient with Tree Expansion
by: Dalal, Gal, et al.
Published: (2023)

Federated Stochastic Approximation under Markov Noise and Heterogeneity: Applications in Reinforcement Learning
by: Khodadadian, Sajad, et al.
Published: (2022)

Adversary-Robust Learning from Fully Asynchronous Directional Derivative Estimates
by: Paul, Anik Kumar, et al.
Published: (2026)

Tight Convergence Rates for Online Distributed Linear Estimation with Adversarial Measurements
by: Roy, Nibedita, et al.
Published: (2026)

SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning
by: Mangold, Paul, et al.
Published: (2024)

Federated Reinforcement Learning in Heterogeneous Environments
by: Hwang, Ukjo, et al.
Published: (2025)

Monotone and Conservative Policy Iteration Beyond the Tabular Case
by: Eshwar, S. R., et al.
Published: (2025)

Hierarchical Knowledge Structuring for Effective Federated Learning in Heterogeneous Environments
by: Tam, Wai Fong, et al.
Published: (2025)

FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning
by: Ji, Xinyuan, et al.
Published: (2024)

Convergence of off-policy TD(0) with linear function approximation for reversible Markov chains
by: Overmars, Maik, et al.
Published: (2025)

Noise Resilient Over-The-Air Federated Learning In Heterogeneous Wireless Networks
by: Shaban, Zubair, et al.
Published: (2025)

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning
by: Srikant, R.
Published: (2024)

The Shadow knows: Empirical Distributions of Minimum Spanning Acycles and Persistence Diagrams of Random Complexes
by: Fraiman, Nicolas, et al.
Published: (2020)

Heterogeneity-Aware Client Selection Methodology For Efficient Federated Learning
by: Balivada, Nihal, et al.
Published: (2026)

Client Selection for Federated Policy Optimization with Environment Heterogeneity
by: Xie, Zhijie, et al.
Published: (2023)

Hybrid DQN-TD3 Reinforcement Learning for Autonomous Navigation in Dynamic Environments
by: He, Xiaoyi, et al.
Published: (2025)

Model-Free Learning for the Linear Quadratic Regulator over Rate-Limited Channels
by: Ye, Lintao, et al.
Published: (2024)

Multi-State TD Target for Model-Free Reinforcement Learning
by: Wang, Wuhao, et al.
Published: (2024)

One-Shot Averaging for Distributed TD($λ$) Under Markov Sampling
by: Tian, Haoxing, et al.
Published: (2024)

FlexFed: Mitigating Catastrophic Forgetting in Heterogeneous Federated Learning in Pervasive Computing Environments
by: Alosaime, Sara, et al.
Published: (2025)

subMFL: Compatiple subModel Generation for Federated Learning in Device Heterogenous Environment
by: Oz, Zeyneddin, et al.
Published: (2024)

On the Impact of Data Heterogeneity in Federated Learning Environments with Application to Healthcare Networks
by: Milasheuski, Usevalad, et al.
Published: (2024)

Personalized Observation Normalization for Federated Reinforcement Learning in Simulation Environments with Heterogeneity
by: Pang, Yiran, et al.
Published: (2026)

Causal Multi-Task Demand Learning
by: Gupta, Varun, et al.
Published: (2026)

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity
by: Wang, Yuan, et al.
Published: (2024)

Overpredictive Signal Analytics in Federated Learning: Algorithms and Analysis
by: Anavangot, Vijay
Published: (2024)

PEAR: Primitive Enabled Adaptive Relabeling for Boosting Hierarchical Reinforcement Learning
by: Singh, Utsav, et al.
Published: (2023)

Noise-Aware Algorithm for Heterogeneous Differentially Private Federated Learning
by: Malekmohammadi, Saber, et al.
Published: (2024)

CRISP: Curriculum Inducing Primitive Informed Subgoal Prediction for Hierarchical Reinforcement Learning
by: Singh, Utsav, et al.
Published: (2023)

Apodotiko: Enabling Efficient Serverless Federated Learning in Heterogeneous Environments
by: Chadha, Mohak, et al.
Published: (2024)

On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
by: Wang, Leo Muxing, et al.
Published: (2024)

Sporadic Federated Learning Approach in Quantum Environment to Tackle Quantum Noise
by: Rahman, Ratun, et al.
Published: (2025)