Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Kaiwei, Zhu, Dandan, Min, Xiongkuo, Zhai, Guangtao
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910739739967488
author Zhang, Kaiwei
Zhu, Dandan
Min, Xiongkuo
Zhai, Guangtao
author_facet Zhang, Kaiwei
Zhu, Dandan
Min, Xiongkuo
Zhai, Guangtao
contents Textured meshes significantly enhance the realism and detail of objects by mapping intricate texture details onto the geometric structure of 3D models. This advancement is valuable across various applications, including entertainment, education, and industry. While traditional mesh saliency studies focus on non-textured meshes, our work explores the complexities introduced by detailed texture patterns. We present a new dataset for textured mesh saliency, created through an innovative eye-tracking experiment in a six degrees of freedom (6-DOF) VR environment. This dataset addresses the limitations of previous studies by providing comprehensive eye-tracking data from multiple viewpoints, thereby advancing our understanding of human visual behavior and supporting more accurate and effective 3D content creation. Our proposed model predicts saliency maps for textured mesh surfaces by treating each triangular face as an individual unit and assigning a saliency density value to reflect the importance of each local surface region. The model incorporates a texture alignment module and a geometric extraction module, combined with an aggregation module to integrate texture and geometry for precise saliency prediction. We believe this approach will enhance the visual fidelity of geometric processing algorithms while ensuring efficient use of computational resources, which is crucial for real-time rendering and high-detail applications such as VR and gaming.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08188
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics
Zhang, Kaiwei
Zhu, Dandan
Min, Xiongkuo
Zhai, Guangtao
Graphics
Computer Vision and Pattern Recognition
Textured meshes significantly enhance the realism and detail of objects by mapping intricate texture details onto the geometric structure of 3D models. This advancement is valuable across various applications, including entertainment, education, and industry. While traditional mesh saliency studies focus on non-textured meshes, our work explores the complexities introduced by detailed texture patterns. We present a new dataset for textured mesh saliency, created through an innovative eye-tracking experiment in a six degrees of freedom (6-DOF) VR environment. This dataset addresses the limitations of previous studies by providing comprehensive eye-tracking data from multiple viewpoints, thereby advancing our understanding of human visual behavior and supporting more accurate and effective 3D content creation. Our proposed model predicts saliency maps for textured mesh surfaces by treating each triangular face as an individual unit and assigning a saliency density value to reflect the importance of each local surface region. The model incorporates a texture alignment module and a geometric extraction module, combined with an aggregation module to integrate texture and geometry for precise saliency prediction. We believe this approach will enhance the visual fidelity of geometric processing algorithms while ensuring efficient use of computational resources, which is crucial for real-time rendering and high-detail applications such as VR and gaming.
title Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics
topic Graphics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.08188