CulinaryCut-VLAP: A Vision-Language-Action-Physics Framework for Food Cutting via a Force-Aware Material Point Method

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Koh, Hyunseo, Song, Chang-Yong, Choi, Youngjae, Viveiros, Misa, Hyde, David, Kim, Heewon
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908756956151808
author Koh, Hyunseo
Song, Chang-Yong
Choi, Youngjae
Viveiros, Misa
Hyde, David
Kim, Heewon
author_facet Koh, Hyunseo
Song, Chang-Yong
Choi, Youngjae
Viveiros, Misa
Hyde, David
Kim, Heewon
contents Food cutting is a highly practical yet underexplored application at the intersection of vision and robotic manipulation. The task remains challenging because interactions between the knife and deformable materials are highly nonlinear and often entail large deformations, frequent contact, and topological change, which in turn hinder stable and safe large-scale data collection. To address these challenges, we propose a unified framework that couples a vision-language-action (VLA) dataset with a physically realistic cutting simulator built on the material point method (MPM). Our simulator adopts MLS-MPM as its computational core, reducing numerical dissipation and energy drift while preserving rotational and shear responses even under topology-changing cuts. During cutting, forces and stress distributions are estimated from impulse exchanges between particles and the grid, enabling stable tracking of transient contact forces and energy transfer. We also provide a benchmark dataset that integrates diverse cutting trajectories, multi-view visual observations, and fine-grained language instructions, together with force--torque and tool--pose labels to provide physically consistent training signals. These components realize a learning--evaluation loop that respects the core physics of cutting and establishes a safe, reproducible, and scalable foundation for advancing VLA models in deformable object manipulation.
format Preprint
id arxiv_https___arxiv_org_abs_2601_06451
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CulinaryCut-VLAP: A Vision-Language-Action-Physics Framework for Food Cutting via a Force-Aware Material Point Method
Koh, Hyunseo
Song, Chang-Yong
Choi, Youngjae
Viveiros, Misa
Hyde, David
Kim, Heewon
Robotics
Computer Vision and Pattern Recognition
68T40, 68T45
I.2.9; I.2.6; I.2.10; I.6.8
Food cutting is a highly practical yet underexplored application at the intersection of vision and robotic manipulation. The task remains challenging because interactions between the knife and deformable materials are highly nonlinear and often entail large deformations, frequent contact, and topological change, which in turn hinder stable and safe large-scale data collection. To address these challenges, we propose a unified framework that couples a vision-language-action (VLA) dataset with a physically realistic cutting simulator built on the material point method (MPM). Our simulator adopts MLS-MPM as its computational core, reducing numerical dissipation and energy drift while preserving rotational and shear responses even under topology-changing cuts. During cutting, forces and stress distributions are estimated from impulse exchanges between particles and the grid, enabling stable tracking of transient contact forces and energy transfer. We also provide a benchmark dataset that integrates diverse cutting trajectories, multi-view visual observations, and fine-grained language instructions, together with force--torque and tool--pose labels to provide physically consistent training signals. These components realize a learning--evaluation loop that respects the core physics of cutting and establishes a safe, reproducible, and scalable foundation for advancing VLA models in deformable object manipulation.
title CulinaryCut-VLAP: A Vision-Language-Action-Physics Framework for Food Cutting via a Force-Aware Material Point Method
topic Robotics
Computer Vision and Pattern Recognition
68T40, 68T45
I.2.9; I.2.6; I.2.10; I.6.8
url https://arxiv.org/abs/2601.06451