Residual RL--MPC for Robust Microrobotic Cell Pushing Under Time-Varying Flow

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Yanda, Das, Sambeeta
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910042615185408
author Yang, Yanda
Das, Sambeeta
author_facet Yang, Yanda
Das, Sambeeta
contents Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a waypoint-sampled reference curve under time-varying Poiseuille flow. We propose a hybrid controller that augments a nominal MPC with a learned residual policy trained by SAC. The policy outputs a bounded 2D velocity correction that is contact-gated, so residual actions are applied only during robot--cell contact, preserving reliable approach behavior and stabilizing learning. All methods share the same actuation interface and speed envelope for fair comparisons. Experiments show improved robustness and tracking accuracy over pure MPC and PID under nonstationary flow, with generalization from a clover training curve to unseen circle and square trajectories. A residual-bound sweep identifies an intermediate correction limit as the best trade-off, which we use in all benchmarks.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05448
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Residual RL--MPC for Robust Microrobotic Cell Pushing Under Time-Varying Flow
Yang, Yanda
Das, Sambeeta
Robotics
Artificial Intelligence
Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a waypoint-sampled reference curve under time-varying Poiseuille flow. We propose a hybrid controller that augments a nominal MPC with a learned residual policy trained by SAC. The policy outputs a bounded 2D velocity correction that is contact-gated, so residual actions are applied only during robot--cell contact, preserving reliable approach behavior and stabilizing learning. All methods share the same actuation interface and speed envelope for fair comparisons. Experiments show improved robustness and tracking accuracy over pure MPC and PID under nonstationary flow, with generalization from a clover training curve to unseen circle and square trajectories. A residual-bound sweep identifies an intermediate correction limit as the best trade-off, which we use in all benchmarks.
title Residual RL--MPC for Robust Microrobotic Cell Pushing Under Time-Varying Flow
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2603.05448