Cover Image

Actor-Critic for Continuous Action Chunks: A Reinforcement Learning Framework for Long-Horizon Robotic Manipulation with Sparse Reward

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Jiarui, Zhu, Bin, Chen, Jingjing, Jiang, Yu-Gang
Format:	Preprint
Published:	2025
Subjects:	Robotics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Non-Markovian Long-Horizon Robot Manipulation via Keyframe Chaining
by: Chen, Yipeng, et al.
Published: (2026)

Mixture of Horizons in Action Chunking
by: Jing, Dong, et al.
Published: (2025)

Learning Native Continuation for Action Chunking Flow Policies
by: Liu, Yufeng, et al.
Published: (2026)

Reinforcement Learning with Action Chunking
by: Li, Qiyang, et al.
Published: (2025)

Chameleon: Episodic Memory for Long-Horizon Robotic Manipulation
by: Guo, Xinying, et al.
Published: (2026)

ARM: Advantage Reward Modeling for Long-Horizon Manipulation
by: Mao, Yiming, et al.
Published: (2026)

RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation
by: Zhou, Shijie, et al.
Published: (2026)

Implicit Action Chunking for Smooth Continuous Control
by: Liang, Bosun, et al.
Published: (2026)

RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks
by: Li, Ruiying, et al.
Published: (2026)

RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking
by: Sun, Zhenguo, et al.
Published: (2025)

A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation
by: Zhu, Xiang, et al.
Published: (2022)

Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers
by: Motoda, Tomohiro, et al.
Published: (2025)

SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulation
by: Chen, Qianzhong, et al.
Published: (2025)

HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulation
by: Zhou, Wenxuan, et al.
Published: (2023)

ManeuverNet: A Soft Actor-Critic Framework for Precise Maneuvering of Double-Ackermann-Steering Robots with Optimized Reward Functions
by: Deflesselle, Kohio, et al.
Published: (2026)

Pretrained Bayesian Non-parametric Knowledge Prior in Robotic Long-Horizon Reinforcement Learning
by: Meng, Yuan, et al.
Published: (2025)

Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation
by: Liu, Jinkun, et al.
Published: (2026)

Toward Accurate Long-Horizon Robotic Manipulation: Language-to-Action with Foundation Models via Scene Graphs
by: Dinesh, Sushil Samuel, et al.
Published: (2025)

Learning Long-Horizon Robot Manipulation Skills via Privileged Action
by: Mao, Xiaofeng, et al.
Published: (2025)

Beyond Policy Optimization: A Data Curation Flywheel for Sparse-Reward Long-Horizon Planning
by: Wang, Yutong, et al.
Published: (2025)

Kaiwu: A Multimodal Manipulation Dataset and Framework for Robot Learning and Human-Robot Interaction
by: Jiang, Shuo, et al.
Published: (2025)

Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
by: Fan, Yiguo, et al.
Published: (2025)

A Safety Modulator Actor-Critic Method in Model-Free Safe Reinforcement Learning and Application in UAV Hovering
by: Qi, Qihan, et al.
Published: (2024)

LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
by: Wang, Xiaofan, et al.
Published: (2025)

Constraints as Rewards: Reinforcement Learning for Robots without Reward Functions
by: Ishihara, Yu, et al.
Published: (2025)

Keyframe-Guided Structured Rewards for Reinforcement Learning in Long-Horizon Laboratory Robotics
by: Qiu, Yibo, et al.
Published: (2026)

A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning
by: Zhai, Shaopeng, et al.
Published: (2025)

VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks
by: Zhang, Shiduo, et al.
Published: (2024)

MOSAIC: A Skill-Centric Algorithmic Framework for Long-Horizon Manipulation Planning
by: Mishani, Itamar, et al.
Published: (2025)

Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulation
by: Feng, Yunhai, et al.
Published: (2025)

Offline Actor-Critic Reinforcement Learning Scales to Large Models
by: Springenberg, Jost Tobias, et al.
Published: (2024)

Reward Training Wheels: Adaptive Auxiliary Rewards for Robotics Reinforcement Learning
by: Wang, Linji, et al.
Published: (2025)

Towards Safe Maneuvering of Double-Ackermann-Steering Robots with a Soft Actor-Critic Framework
by: Deflesselle, Kohio, et al.
Published: (2025)

MRHER: Model-based Relay Hindsight Experience Replay for Sequential Object Manipulation Tasks with Sparse Rewards
by: Huang, Yuming, et al.
Published: (2023)

Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation
by: Li, Yihang, et al.
Published: (2025)

Hybrid Framework for Robotic Manipulation: Integrating Reinforcement Learning and Large Language Models
by: Saad, Md, et al.
Published: (2026)

Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulation
by: Tan, Huajie, et al.
Published: (2026)

SPIRE: Synergistic Planning, Imitation, and Reinforcement Learning for Long-Horizon Manipulation
by: Zhou, Zihan, et al.
Published: (2024)

CTSAC: Curriculum-Based Transformer Soft Actor-Critic for Goal-Oriented Robot Exploration
by: Yang, Chunyu, et al.
Published: (2025)

Trace-Focused Diffusion Policy for Multi-Modal Action Disambiguation in Long-Horizon Robotic Manipulation
by: Hu, Yuxuan, et al.
Published: (2026)