TactStyle: Generating Tactile Textures with Generative AI for Digital Fabrication

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Faruqi, Faraz, Perroni-Scharf, Maxine, Walia, Jaskaran Singh, Zhu, Yunyi, Feng, Shuyue, Degraen, Donald, Mueller, Stefanie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929740336594944
author Faruqi, Faraz
Perroni-Scharf, Maxine
Walia, Jaskaran Singh
Zhu, Yunyi
Feng, Shuyue
Degraen, Donald
Mueller, Stefanie
author_facet Faruqi, Faraz
Perroni-Scharf, Maxine
Walia, Jaskaran Singh
Zhu, Yunyi
Feng, Shuyue
Degraen, Donald
Mueller, Stefanie
contents Recent work in Generative AI enables the stylization of 3D models based on image prompts. However, these methods do not incorporate tactile information, leading to designs that lack the expected tactile properties. We present TactStyle, a system that allows creators to stylize 3D models with images while incorporating the expected tactile properties. TactStyle accomplishes this using a modified image-generation model fine-tuned to generate heightfields for given surface textures. By optimizing 3D model surfaces to embody a generated texture, TactStyle creates models that match the desired style and replicate the tactile experience. We utilize a large-scale dataset of textures to train our texture generation model. In a psychophysical experiment, we evaluate the tactile qualities of a set of 3D-printed original textures and TactStyle's generated textures. Our results show that TactStyle successfully generates a wide range of tactile features from a single image input, enabling a novel approach to haptic design.
format Preprint
id arxiv_https___arxiv_org_abs_2503_02007
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TactStyle: Generating Tactile Textures with Generative AI for Digital Fabrication
Faruqi, Faraz
Perroni-Scharf, Maxine
Walia, Jaskaran Singh
Zhu, Yunyi
Feng, Shuyue
Degraen, Donald
Mueller, Stefanie
Human-Computer Interaction
Artificial Intelligence
Recent work in Generative AI enables the stylization of 3D models based on image prompts. However, these methods do not incorporate tactile information, leading to designs that lack the expected tactile properties. We present TactStyle, a system that allows creators to stylize 3D models with images while incorporating the expected tactile properties. TactStyle accomplishes this using a modified image-generation model fine-tuned to generate heightfields for given surface textures. By optimizing 3D model surfaces to embody a generated texture, TactStyle creates models that match the desired style and replicate the tactile experience. We utilize a large-scale dataset of textures to train our texture generation model. In a psychophysical experiment, we evaluate the tactile qualities of a set of 3D-printed original textures and TactStyle's generated textures. Our results show that TactStyle successfully generates a wide range of tactile features from a single image input, enabling a novel approach to haptic design.
title TactStyle: Generating Tactile Textures with Generative AI for Digital Fabrication
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2503.02007