Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Yingke, Li, Hao, Zhu, Yifeng, Yu, Hong-Xing, Goldberg, Ken, Fei-Fei, Li, Wu, Jiajun, Li, Yunzhu, Zhang, Ruohan
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2603.29315
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914433800863744
author Wang, Yingke
Li, Hao
Zhu, Yifeng
Yu, Hong-Xing
Goldberg, Ken
Fei-Fei, Li
Wu, Jiajun
Li, Yunzhu
Zhang, Ruohan
author_facet Wang, Yingke
Li, Hao
Zhu, Yifeng
Yu, Hong-Xing
Goldberg, Ken
Fei-Fei, Li
Wu, Jiajun
Li, Yunzhu
Zhang, Ruohan
contents Robotic reproduction of oil paintings using soft brushes and pigments requires force-sensitive control of deformable tools, prediction of brushstroke effects, and multi-step stroke planning, often without human step-by-step demonstrations or faithful simulators. Given only a sequence of target oil painting images, can a robot infer and execute the stroke trajectories, forces, and colors needed to reproduce it? We present IMPASTO, a robotic oil-painting system that integrates learned pixel dynamics models with model-based planning. The dynamics models predict canvas updates from image observations and parameterized stroke actions; a receding-horizon model predictive control optimizer then plans trajectories and forces, while a force-sensitive controller executes strokes on a 7-DoF robot arm. IMPASTO integrates low-level force control, learned dynamics models, and high-level closed-loop planning, learns solely from robot self-play, and approximates human artists' single-stroke datasets and multi-stroke artworks, outperforming baselines in reproduction accuracy. Project website: https://impasto-robopainting.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2603_29315
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle IMPASTO: Integrating Model-Based Planning with Learned Dynamics Models for Robotic Oil Painting Reproduction
Wang, Yingke
Li, Hao
Zhu, Yifeng
Yu, Hong-Xing
Goldberg, Ken
Fei-Fei, Li
Wu, Jiajun
Li, Yunzhu
Zhang, Ruohan
Robotics
Artificial Intelligence
Robotic reproduction of oil paintings using soft brushes and pigments requires force-sensitive control of deformable tools, prediction of brushstroke effects, and multi-step stroke planning, often without human step-by-step demonstrations or faithful simulators. Given only a sequence of target oil painting images, can a robot infer and execute the stroke trajectories, forces, and colors needed to reproduce it? We present IMPASTO, a robotic oil-painting system that integrates learned pixel dynamics models with model-based planning. The dynamics models predict canvas updates from image observations and parameterized stroke actions; a receding-horizon model predictive control optimizer then plans trajectories and forces, while a force-sensitive controller executes strokes on a 7-DoF robot arm. IMPASTO integrates low-level force control, learned dynamics models, and high-level closed-loop planning, learns solely from robot self-play, and approximates human artists' single-stroke datasets and multi-stroke artworks, outperforming baselines in reproduction accuracy. Project website: https://impasto-robopainting.github.io/
title IMPASTO: Integrating Model-Based Planning with Learned Dynamics Models for Robotic Oil Painting Reproduction
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2603.29315