Cover Image

ScreenTK: Seamless Detection of Time-Killing Moments Using Continuous Mobile Screen Text and On-Device LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fang, Le, Zhang, Shiquan, Jia, Hong, Goncalves, Jorge, Kostakos, Vassilis
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enabling On-Device LLMs Personalization with Smartphone Sensing
by: Zhang, Shiquan, et al.
Published: (2024)

AutoJournaling: A Context-Aware Journaling System Leveraging MLLMs on Smartphone Screenshots
by: Zhang, Tianyi, et al.
Published: (2024)

Predicting Affective States from Screen Text Sentiment
by: Teng, Songyan, et al.
Published: (2024)

Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots
by: Zhang, Shiquan, et al.
Published: (2026)

Situationally-Induced Impairments and Disabilities Research
by: Sarsenbayeva, Zhanna, et al.
Published: (2019)

Real-Time Detection of Robot Failures Using Gaze Dynamics in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

Crepe: A Mobile Screen Data Collector Using Graph Query
by: Lu, Yuwen, et al.
Published: (2024)

HealthSLM-Bench: Benchmarking Small Language Models for Mobile and Wearable Healthcare Monitoring
by: Wang, Xin, et al.
Published: (2025)

ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models
by: Zhong, Mingyuan, et al.
Published: (2025)

InfoPrint: Embedding Information into 3D Printed Objects
by: Jiang, Weiwei, et al.
Published: (2021)

Raising Awareness of Location Information Vulnerabilities in Social Media Photos using LLMs
by: Ma, Ying, et al.
Published: (2025)

GazeSwipe: Enhancing Mobile Touchscreen Reachability through Seamless Gaze and Finger-Swipe Integration
by: Cai, Zhuojiang, et al.
Published: (2025)

LLMartini: Seamless and Interactive Leveraging of Multiple LLMs through Comparison and Composition
by: Shi, Yingtian, et al.
Published: (2025)

Design of Seamless Multi-modal Interaction Framework for Intelligent Virtual Agents in Wearable Mixed Reality Environment
by: Ali, Ghazanfar, et al.
Published: (2025)

Caption: Generating Informative Content Labels for Image Buttons Using Next-Screen Context
by: Zhong, Mingyuan, et al.
Published: (2025)

Early Autism Spectrum Disorder Detection Using SMOTE‐Enhanced 1D‐CNN and Behavioral Screening Data
by: Ahlam Alghamdi, et al.
Published: (2025)

From Play to Detection: Mini-SPACE as a Serious Game for Unsupervised Cognitive Impairment Screening
by: Tian, Nana, et al.
Published: (2025)

Optimizing Gesture Recognition for Seamless UI Interaction Using Convolutional Neural Networks
by: Sun, Qi, et al.
Published: (2024)

Flowy: Supporting UX Design Decisions Through AI-Driven Pattern Annotation in Multi-Screen User Flows
by: Lu, Yuwen, et al.
Published: (2024)

An Analysis of Physiological and Psychological Responses in Virtual Reality and Flat Screen Gaming
by: Vatsal, Ritik, et al.
Published: (2023)

Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation
by: Wang, Zhecheng, et al.
Published: (2025)

LLM-Driven Optimization of HTML Structure to Support Screen Reader Navigation
by: Yu, Yaman, et al.
Published: (2025)

VTutor for High-Impact Tutoring at Scale: Managing Engagement and Real-Time Multi-Screen Monitoring with P2P Connections
by: Chen, Eason, et al.
Published: (2025)

Interaction Techniques for Exploratory Data Visualization on Mobile Devices
by: Snyder, Luke S., et al.
Published: (2024)

Daily Affect Fluctuations in Phone Screen Content Predict Anxiety and Depressive Symptoms
by: Kelly, Christopher A., et al.
Published: (2026)

Design and Evaluation of a Culturally Adapted Multimodal Virtual Agent for PTSD Screening
by: Ozel, Cengiz, et al.
Published: (2026)

Leveraging Head Movement for Navigating Off-Screen Content on Large Curved Displays
by: Ullah, A K M Amanat, et al.
Published: (2026)

Visual Embedding of Screen Sequences for User-Flow Search in Example-driven Communication
by: Jeong, Daeheon, et al.
Published: (2025)

From Struggle to Success: Context-Aware Guidance for Screen Reader Users in Computer Use
by: Chen, Nan, et al.
Published: (2026)

Screen Reader Programmers in the Vibe Coding Era: Adaptation, Empowerment, and New Accessibility Landscape
by: Chen, Nan, et al.
Published: (2025)

The Speculative Future of Conversational AI for Neurocognitive Disorder Screening: a Multi-Stakeholder Perspective
by: Hu, Jiaxiong, et al.
Published: (2026)

Take the Power Back: Screen-Based Personal Moderation Against Hate Speech on Instagram
by: Luther, Anna Ricarda, et al.
Published: (2026)

Improving Data Quality via Pre-Task Participant Screening in Crowdsourced GUI Experiments
by: Miyama, Takaya, et al.
Published: (2026)

Seamless Integration: The Evolution, Design, and Future Impact of Wearable Technology
by: Pearl, David, et al.
Published: (2025)

Email as the Interface to Generative AI Models: Seamless Administrative Automation
by: Navarro, Andres, et al.
Published: (2025)

User Satisfaction -- UX Design Strategies for Seamless Virtual Experience
by: Vijayakumar, Harish
Published: (2025)

AiRWeb: Using AR to Extend Web Browsing Beyond Handheld Screens
by: Gao, Mengfei, et al.
Published: (2026)

AlloyLens: A Visual Analytics Tool for High-throughput Alloy Screening and Inverse Design
by: Li, Suyang, et al.
Published: (2025)

Continuous Scatterplot and Image Moments for Time-Varying Bivariate Field Analysis of Electronic Structure Evolution
by: Sharma, Mohit, et al.
Published: (2025)