Cover Image

KeySense: LLM-Powered Hands-Down, Ten-Finger Typing on Commodity Touchscreens

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Tony, Ma, Yan, Li, Zhuojun, Yu, Chun, Ramakrishnan, IV, Bi, Xiaojun
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Simulating Errors in Touchscreen Typing
by: Shi, Danqing, et al.
Published: (2025)

Electro-Mechanical Contact Interactions Between Human Finger and Touchscreen Under Electroadhesion
by: AliAbbasi, Easa
Published: (2024)

Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models
by: Kodandaram, Satwik Ram, et al.
Published: (2024)

Exploring Keyboard Positioning and Ten-Finger Typing in Mixed Reality
by: Schmitz, Cecilia, et al.
Published: (2024)

TouchWalker: Real-Time Avatar Locomotion from Touchscreen Finger Walking
by: Park, Geuntae, et al.
Published: (2025)

Sliding Speed Influences Electrovibration-Induced Finger Friction Dynamics on Touchscreens
by: Balasubramanian, Jagan K, et al.
Published: (2025)

GazeSwipe: Enhancing Mobile Touchscreen Reachability through Seamless Gaze and Finger-Swipe Integration
by: Cai, Zhuojiang, et al.
Published: (2025)

Finding the Signal in the Noise: An Exploratory Study on Assessing the Effectiveness of AI and Accessibility Forums for Blind Users' Support Needs
by: Kodandaram, Satwik Ram, et al.
Published: (2026)

Magical Touch: Transforming Raw Capacitive Streams into Expressive Hand-Touchscreen Interaction
by: Guo, Yuanlei, et al.
Published: (2026)

Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible Products
by: Reddy, Monalika Padma, et al.
Published: (2026)

V-Hands: Touchscreen-based Hand Tracking for Remote Whiteboard Interaction
by: Liu, Xinshuang, et al.
Published: (2024)

Wrist2Finger: Sensing Fingertip Force for Force-Aware Hand Interaction with a Ring-Watch Wearable
by: Xiao, Yingjing, et al.
Published: (2025)

EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
by: Lee, Chi-Jung, et al.
Published: (2024)

Designing Touchscreen Menu Interfaces for In-Vehicle Infotainment Systems: the Effect of Depth and Breadth Trade-off and Task Types on Visual-Manual Distraction
by: Nicolas, Louveton, et al.
Published: (2024)

PoseAugment: Generative Human Pose Data Augmentation with Physical Plausibility for IMU-based Motion Capture
by: Li, Zhuojun, et al.
Published: (2024)

FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM Agents
by: Yang, Qinglong, et al.
Published: (2025)

FITS: Ensuring Safe and Effective Touchscreen Use in Moving Vehicles
by: Pool, Daan M., et al.
Published: (2024)

Evaluating Perceptual Deviations in Video See-Through Head-Mounted Displays while Utilizing Physical Touchscreens
by: de Lange, Rudy De-Xin, et al.
Published: (2024)

Functional Near-Infrared Spectroscopy (fNIRS) Analysis of Interaction Techniques in Touchscreen-Based Educational Gaming
by: Sharmin, Shayla, et al.
Published: (2024)

Finger Tendon Vibration: Finger Movement Illusions for Immersive Virtual Object Interaction
by: Song, Kun-Woo, et al.
Published: (2026)

Understanding Down Syndrome Stereotypes in LLM-Based Personas
by: Wu, Chantelle, et al.
Published: (2025)

TAPOR: 3D Hand Pose Reconstruction with Fully Passive Thermal Sensing for Around-Device Interactions
by: Zhang, Xie, et al.
Published: (2025)

Challenging Disability and Interaction Norms in XR: Cooling Down the Empathy Machine in Waiting for Hands
by: Duarte, Yesica, et al.
Published: (2025)

Enter: Graduated Realism: A Pedagogical Framework for AI-Powered Avatars in Virtual Reality Teacher Training
by: Haynes IV, Judson Leroy Dean
Published: (2025)

Fabric Sensing of Intrinsic Hand Muscle Activity
by: Lee, Katelyn, et al.
Published: (2024)

TA-GNN: Physics Inspired Time-Agnostic Graph Neural Network for Finger Motion Prediction
by: Li, Tinghui, et al.
Published: (2025)

Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing
by: Sang, Yu, et al.
Published: (2017)

iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance Sensing
by: Liu, Mengxi, et al.
Published: (2024)

BIT: Battery-free, IC-less and Wireless Smart Textile Interface and Sensing System
by: Xu, Weiye, et al.
Published: (2025)

Exploring LLM-generated Culture-specific Affective Human-Robot Tactile Interaction
by: Ren, Qiaoqiao, et al.
Published: (2025)

SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring
by: Lim, Hyunchul, et al.
Published: (2025)

Hand by Hand: LLM Driving EMS Assistant for Operational Skill Learning
by: Xiang, Wei, et al.
Published: (2025)

Effects of Virtual Hand Representation on the Typing Performance, Upper Extremity Angle, and Neck Muscle Activity during Virtual Reality Typing
by: Zaman, Mobasshira, et al.
Published: (2024)

WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches
by: Kim, Jiwan, et al.
Published: (2026)

What to Make Sense of in the Era of LLM? A Perspective from the Structure and Efforts in Sensemaking
by: Li, Tianyi, et al.
Published: (2026)

Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand
by: Lee, Chi-Jung, et al.
Published: (2025)

Earinter: A Closed-Loop System for Eating Pace Regulation with Just-in-Time Intervention Using Commodity Earbuds
by: Fang, Jun, et al.
Published: (2026)

WhatIf: Interactive Exploration of LLM-Powered Social Simulations for Policy Reasoning
by: Li, Yuxuan, et al.
Published: (2026)

"Power of Words": Stealthy and Adaptive Private Information Elicitation via LLM Communication Strategies
by: Zhang, Shuning, et al.
Published: (2025)

Steering LLM Summarization with Visual Workspaces for Sensemaking
by: Tang, Xuxin, et al.
Published: (2024)