Cover Image

SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Vasco, Chen, Brian, Gonzalez, Eric J., Colaço, Andrea, Hoffmann, Henry, Gonzalez-Franco, Mar, Ahuja, Karan
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Human-Computer Interaction Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices
by: Xu, Vasco, et al.
Published: (2025)

EmBARDiment: an Embodied AI Agent for Productivity in XR
by: Bovo, Riccardo, et al.
Published: (2024)

Augmented Object Intelligence with XR-Objects
by: Dogan, Mustafa Doga, et al.
Published: (2024)

Text Entry for XR Trove (TEXT): Collecting and Analyzing Techniques for Text Input in XR
by: Bhatia, Arpit, et al.
Published: (2025)

Hovering Over the Key to Text Input in XR
by: Gonzalez-Franco, Mar, et al.
Published: (2024)

MotionTrace: IMU-based Field of View Prediction for Smartphone AR Interactions
by: Islam, Rahul, et al.
Published: (2024)

PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videos
by: Abreu, Steven, et al.
Published: (2024)

ForcePinch: Force-Responsive Spatial Interaction for Tracking Speed Control in XR
by: Zhang, Chenyang, et al.
Published: (2025)

WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches
by: Kim, Jiwan, et al.
Published: (2026)

HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand Tracking
by: Tütüncü, Esen K., et al.
Published: (2025)

WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches
by: Yeon, Taeyoung, et al.
Published: (2025)

Break the Window: Exploring Spatial Decomposition of Webpages in XR
by: Zhang, Chenyang, et al.
Published: (2026)

Symbiotic AI: Augmenting Human Cognition from PCs to Cars
by: Bovo, Riccardo, et al.
Published: (2025)

DeltaDorsal: Enhancing Hand Pose Estimation with Dorsal Features in Egocentric Views
by: Huang, William, et al.
Published: (2026)

Practical and Rich User Digitization
by: Ahuja, Karan
Published: (2024)

OpenWatch: A Multimodal Benchmark for Hand Gesture Recognition on Smartwatches
by: Bonazzi, Pietro, et al.
Published: (2026)

Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography
by: Hadidi, Nima, et al.
Published: (2026)

World Mouse: Exploring Interactions with a Cross-Reality Cursor
by: Tütüncü, Esen K., et al.
Published: (2026)

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing
by: Mahmud, Saif, et al.
Published: (2024)

EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision
by: Zhao, Yiming, et al.
Published: (2024)

Challenging Disability and Interaction Norms in XR: Cooling Down the Empathy Machine in Waiting for Hands
by: Duarte, Yesica, et al.
Published: (2025)

Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
by: Lystbæk, Mathias N., et al.
Published: (2026)

Person Identification from Egocentric Human-Object Interactions using 3D Hand Pose
by: Hamza, Muhammad, et al.
Published: (2025)

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs
by: Bao, Yiming, et al.
Published: (2024)

ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Images
by: Ding, Fangqiang, et al.
Published: (2024)

Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
by: Liu, Xiaoan, et al.
Published: (2026)

SocialPulse: An On-Smartwatch System for Detecting Real-World Social Interactions
by: Ahmed, Md Sabbir, et al.
Published: (2025)

emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation
by: Salter, Sasha, et al.
Published: (2024)

GraV: Grasp Volume Data for the Design of One-Handed XR Interfaces
by: Aponte, Alejandro, et al.
Published: (2024)

Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR
by: David, Kristian Paolo, et al.
Published: (2026)

Investigating Seamless Transitions Between Immersive Computational Notebooks and Embodied Data Interactions
by: In, Sungwon, et al.
Published: (2025)

Revisiting put-that-there, context aware window interactions via LLMs
by: Bovo, Riccardo, et al.
Published: (2025)

HpEIS: Learning Hand Pose Embeddings for Multimedia Interactive Systems
by: Xu, Songpei, et al.
Published: (2024)

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
by: Yu, Tianhong Catherine, et al.
Published: (2024)

SocialPulse: On-Device Detection of Social Interactions in Naturalistic Settings Using Smartwatch Multimodal Sensing
by: Ahmed, Md Sabbir, et al.
Published: (2026)

Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
by: Du, Ruofei, et al.
Published: (2026)

EmoWear: Exploring Emotional Teasers for Voice Message Interaction on Smartwatches
by: An, Pengcheng, et al.
Published: (2024)

EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
by: Lee, Chi-Jung, et al.
Published: (2024)

SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data
by: DeVrio, Nathan, et al.
Published: (2025)

TAPOR: 3D Hand Pose Reconstruction with Fully Passive Thermal Sensing for Around-Device Interactions
by: Zhang, Xie, et al.
Published: (2025)