Transformer in Touch: A Survey

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gao, Jing, Cheng, Ning, Fang, Bin, Han, Wenjuan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914803982794752
author Gao, Jing
Cheng, Ning
Fang, Bin
Han, Wenjuan
author_facet Gao, Jing
Cheng, Ning
Fang, Bin
Han, Wenjuan
contents The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the application and development of Transformers in tactile technology. We first introduce the two fundamental concepts behind the success of the Transformer: the self-attention mechanism and large-scale pre-training. Then, we delve into the application of Transformers in various tactile tasks, including but not limited to object recognition, cross-modal generation, and object manipulation, offering a concise summary of the core methodologies, performance benchmarks, and design highlights. Finally, we suggest potential areas for further research and future work, aiming to generate more interest within the community, tackle existing challenges, and encourage the use of Transformer models in the tactile field.
format Preprint
id arxiv_https___arxiv_org_abs_2405_12779
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transformer in Touch: A Survey
Gao, Jing
Cheng, Ning
Fang, Bin
Han, Wenjuan
Machine Learning
Artificial Intelligence
The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the application and development of Transformers in tactile technology. We first introduce the two fundamental concepts behind the success of the Transformer: the self-attention mechanism and large-scale pre-training. Then, we delve into the application of Transformers in various tactile tasks, including but not limited to object recognition, cross-modal generation, and object manipulation, offering a concise summary of the core methodologies, performance benchmarks, and design highlights. Finally, we suggest potential areas for further research and future work, aiming to generate more interest within the community, tackle existing challenges, and encourage the use of Transformer models in the tactile field.
title Transformer in Touch: A Survey
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2405.12779