Cover Image

Towards Enhanced Context Awareness with Vision-based Multimodal Interfaces

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Yongquan, Hu, Wen, Quigley, Aaron
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Models for Multimodal Surface Sensing
by: Hu, Yongquan, et al.
Published: (2024)

MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing
by: Hu, Yongquan, et al.
Published: (2024)

Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
by: Hu, Yongquan 'Owen', et al.
Published: (2025)

Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing
by: Hu, Yongquan, et al.
Published: (2024)

Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health
by: Hu, Yongquan, et al.
Published: (2024)

Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs
by: Yuan, Mingyue, et al.
Published: (2024)

MAxPrototyper: A Multi-Agent Generation System for Interactive User Interface Prototyping
by: Yuan, Mingyue, et al.
Published: (2024)

Investigating the Design Considerations for Integrating Text-to-Image Generative AI within Augmented Reality Environments
by: Hu, Yongquan, et al.
Published: (2023)

Towards Context-Aware Modeling of Situation Awareness in Conditionally Automated Driving
by: Avetisyan, Lilit, et al.
Published: (2024)

A Case Study of Scalable Content Annotation Using Multi-LLM Consensus and Human Review
by: Yuan, Mingyue, et al.
Published: (2025)

Toward an Actionable Socioeconomic-Aware HCI
by: Burnett, Margaret, et al.
Published: (2021)

Adanonymizer: Interactively Navigating and Balancing the Duality of Privacy and Output Performance in Human-LLM Interaction
by: Zhang, Shuning, et al.
Published: (2024)

Actual Achieved Gain and Optimal Perceived Gain: Modeling Human Take-over Decisions Towards Automated Vehicles' Suggestions
by: Zhang, Shuning, et al.
Published: (2025)

From Awareness to Intent: Mitigating Silent Driving System Failures through Prospective Situation Awareness Enhancing Interfaces
by: Wang, Jiyao, et al.
Published: (2026)

Vocabuild: An Accessible Augmented Tangible Interface for Gamified Vocabulary Learning of Constructing Meaning
by: Hu, Siying, et al.
Published: (2025)

DySRec: Dynamic Context-Aware Psychometric Scale Recommendation via Multi-Agent Collaboration
by: Li, Yanzeng, et al.
Published: (2026)

Context-Aware Workflow Decomposition for Automated Mobile UI Annotation Using Multimodal Large Language Models
by: Parvez, Athar, et al.
Published: (2026)

Machine Learning-based Context-Aware EMAs: An Offline Feasibility Study
by: King, Zachary D, et al.
Published: (2025)

Developing an AI-Based Psychometric System for Assessing Learning Difficulties and Adaptive System to Overcome: A Qualitative and Conceptual Framework
by: Hu, Aaron
Published: (2024)

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
by: Lee, Jaewook, et al.
Published: (2024)

From Patient Burdens to User Agency: Designing for Real-Time Protection Support in Online Health Consultations
by: Zhang, Shuning, et al.
Published: (2025)

Position: Human-Robot Interaction in Embodied Intelligence Demands a Shift From Static Privacy Controls to Dynamic Learning
by: Zhang, Shuning, et al.
Published: (2025)

ImmuniFraug: A Metacognitive Intervention Anti-Fraud Approach to Enhance Undergraduate Students' Cyber Fraud Awareness
by: Yuan, Xiangzhe, et al.
Published: (2026)

SwarmChat: An LLM-Based, Context-Aware Multimodal Interaction System for Robotic Swarms
by: Eumi, Ettilla Mohiuddin, et al.
Published: (2025)

AwareLLM: A Proactive Multimodal Ecosystem for Personalized Human-AI Collaboration to Enhance Productivity
by: Rao, Amog, et al.
Published: (2026)

Beyond Functionality: Co-Designing Voice User Interfaces for Older Adults' Well-being
by: Hu, Xinhui, et al.
Published: (2024)

Context-AI Tunes: Context-Aware AI-Generated Music for Stress Reduction
by: Wei, Xiaoyan, et al.
Published: (2025)

A Deep Learning Approach to Interface Color Quality Assessment in HCI
by: Wang, Shixiao, et al.
Published: (2025)

Context-Aware Image Descriptions for Web Accessibility
by: Mohanbabu, Ananya Gubbi, et al.
Published: (2024)

Face2Feel: Emotion-Aware Adaptive User Interface
by: Hadimlioglu, Ismail Alihan, et al.
Published: (2025)

Generative AI as a Tool for Enhancing Reflective Learning in Students
by: Yuan, Bo, et al.
Published: (2024)

DesignMinds: Enhancing Video-Based Design Ideation with Vision-Language Model and Context-Injected Large Language Model
by: He, Tianhao, et al.
Published: (2024)

Context-KG: Context-Aware Knowledge Graph Visualization with User Preferences and Ontological Guidance
by: Perera, Rumali, et al.
Published: (2026)

UbiTouch: Towards a Universal Touch Interface
by: Shah, Dev
Published: (2024)

Petting Pen for Stress Awareness and Management in Children
by: Li, Jing, et al.
Published: (2025)

Context-Based Interface Prototyping: Understanding the Effect of Prototype Representation on User Feedback
by: Hoggenmueller, Marius, et al.
Published: (2024)

Improving mmWave based Hand Hygiene Monitoring through Beam Steering and Combining Techniques
by: Nirmal, Isura, et al.
Published: (2025)

OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2024)

Towards Intent-based User Interfaces: Charting the Design Space of Intent-AI Interactions Across Task Types
by: Ding, Zijian
Published: (2024)

Intelligent Interaction Strategies for Context-Aware Cognitive Augmentation
by: Xiangrong, et al.
Published: (2025)