Transformer Driven Visual Servoing for Fabric Texture Matching Using Dual-Arm Manipulator
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918263982653440 |
|---|---|
| author | Tokuda, Fuyuki Seino, Akira Kobayashi, Akinari Tang, Kai Kosuge, Kazuhiro |
| author_facet | Tokuda, Fuyuki Seino, Akira Kobayashi, Akinari Tang, Kai Kosuge, Kazuhiro |
| contents | In this paper, we propose a method to align and place a fabric piece on top of another using a dual-arm manipulator and a grayscale camera, so that their surface textures are accurately matched. We propose a novel control scheme that combines Transformer-driven visual servoing with dualarm impedance control. This approach enables the system to simultaneously control the pose of the fabric piece and place it onto the underlying one while applying tension to keep the fabric piece flat. Our transformer-based network incorporates pretrained backbones and a newly introduced Difference Extraction Attention Module (DEAM), which significantly enhances pose difference prediction accuracy. Trained entirely on synthetic images generated using rendering software, the network enables zero-shot deployment in real-world scenarios without requiring prior training on specific fabric textures. Real-world experiments demonstrate that the proposed system accurately aligns fabric pieces with different textures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_21203 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Transformer Driven Visual Servoing for Fabric Texture Matching Using Dual-Arm Manipulator Tokuda, Fuyuki Seino, Akira Kobayashi, Akinari Tang, Kai Kosuge, Kazuhiro Robotics In this paper, we propose a method to align and place a fabric piece on top of another using a dual-arm manipulator and a grayscale camera, so that their surface textures are accurately matched. We propose a novel control scheme that combines Transformer-driven visual servoing with dualarm impedance control. This approach enables the system to simultaneously control the pose of the fabric piece and place it onto the underlying one while applying tension to keep the fabric piece flat. Our transformer-based network incorporates pretrained backbones and a newly introduced Difference Extraction Attention Module (DEAM), which significantly enhances pose difference prediction accuracy. Trained entirely on synthetic images generated using rendering software, the network enables zero-shot deployment in real-world scenarios without requiring prior training on specific fabric textures. Real-world experiments demonstrate that the proposed system accurately aligns fabric pieces with different textures. |
| title | Transformer Driven Visual Servoing for Fabric Texture Matching Using Dual-Arm Manipulator |
| topic | Robotics |
| url | https://arxiv.org/abs/2511.21203 |