Copertina

AutoJournaling: A Context-Aware Journaling System Leveraging MLLMs on Smartphone Screenshots

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Tianyi, Zhang, Shiquan, Fang, Le, Jia, Hong, Kostakos, Vassilis, D'Alfonso, Simon
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots
di: Zhang, Shiquan, et al.
Pubblicazione: (2026)

Enabling On-Device LLMs Personalization with Smartphone Sensing
di: Zhang, Shiquan, et al.
Pubblicazione: (2024)

Leveraging LLMs to Predict Affective States via Smartphone Sensor Features
di: Zhang, Tianyi, et al.
Pubblicazione: (2024)

Predicting Affective States from Screen Text Sentiment
di: Teng, Songyan, et al.
Pubblicazione: (2024)

Behavioral Indicators of Loneliness: Predicting University Students' Loneliness Scores from Smartphone Sensing Data
di: Wu, Qianjie, et al.
Pubblicazione: (2025)

ScreenTK: Seamless Detection of Time-Killing Moments Using Continuous Mobile Screen Text and On-Device LLMs
di: Fang, Le, et al.
Pubblicazione: (2024)

AWARE Narrator and the Utilization of Large Language Models to Extract Behavioral Insights from Smartphone Sensing Data
di: Zhang, Tianyi, et al.
Pubblicazione: (2024)

Situationally-Induced Impairments and Disabilities Research
di: Sarsenbayeva, Zhanna, et al.
Pubblicazione: (2019)

AutoLife: Automatic Life Journaling with Smartphones and LLMs
di: Xu, Huatao, et al.
Pubblicazione: (2024)

Real-Time Detection of Robot Failures Using Gaze Dynamics in Collaborative Tasks
di: Tabatabaei, Ramtin, et al.
Pubblicazione: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
di: Tabatabaei, Ramtin, et al.
Pubblicazione: (2025)

MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing
di: Hu, Yongquan, et al.
Pubblicazione: (2024)

What Social Media Use Do People Regret? An Analysis of 34K Smartphone Screenshots with Multimodal LLM
di: Guo, Longjie, et al.
Pubblicazione: (2024)

HealthSLM-Bench: Benchmarking Small Language Models for Mobile and Wearable Healthcare Monitoring
di: Wang, Xin, et al.
Pubblicazione: (2025)

Feminist Interaction Techniques: Deterring Non-Consensual Screenshots with Interaction Techniques
di: Qiwei, Li, et al.
Pubblicazione: (2024)

Raising Awareness of Location Information Vulnerabilities in Social Media Photos using LLMs
di: Ma, Ying, et al.
Pubblicazione: (2025)

Crafting a Personal Journaling Practice: Negotiating Ecosystems of Materials, Personal Context, and Community in Analog Journaling
di: Lin, Katherine, et al.
Pubblicazione: (2025)

InfoPrint: Embedding Information into 3D Printed Objects
di: Jiang, Weiwei, et al.
Pubblicazione: (2021)

Beyond Screenshots: Evaluating VLMs' Understanding of UI Animations
di: Liang, Chen, et al.
Pubblicazione: (2026)

Putting Language into Context Using Smartphone-Based Keyboard Logging
di: Bemmann, Florian, et al.
Pubblicazione: (2024)

Informative Keyboard and its Application to Raise Awareness of Smartphone Use
di: Domaszewicz, Jaroslaw, et al.
Pubblicazione: (2025)

InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone Overuse
di: Lu, Tao, et al.
Pubblicazione: (2024)

Persode: Personalized Visual Journaling with Episodic Memory-Aware AI Agent
di: Jin, Seokho, et al.
Pubblicazione: (2025)

Leveraging Artificial Intelligence to Promote Awareness in Augmented Reality Systems
di: Li, Wangfan, et al.
Pubblicazione: (2024)

PersonaMail: Learning and Adapting Personal Communication Preferences for Context-Aware Email Writing
di: Yao, Rui, et al.
Pubblicazione: (2026)

Context-AI Tunes: Context-Aware AI-Generated Music for Stress Reduction
di: Wei, Xiaoyan, et al.
Pubblicazione: (2025)

Context-Aware Intelligent Chatbot Framework Leveraging Mobile Sensing
di: Zhang, Ziyan, et al.
Pubblicazione: (2025)

Intelligent Interaction Strategies for Context-Aware Cognitive Augmentation
di: Xiangrong, et al.
Pubblicazione: (2025)

Relative Attention-based One-Class Adversarial Autoencoder for Continuous Authentication of Smartphone Users
di: Hu, Mingming, et al.
Pubblicazione: (2022)

Environmental (in)considerations in the Design of Smartphone Settings
di: Thibault, Thomas, et al.
Pubblicazione: (2025)

MoodPupilar: Predicting Mood Through Smartphone Detected Pupillary Responses in Naturalistic Settings
di: Islam, Rahul, et al.
Pubblicazione: (2024)

IDEIA: A Generative AI-Based System for Real-Time Editorial Ideation in Digital Journalism
di: Santos, Victor B., et al.
Pubblicazione: (2025)

Deconstructing Implicit Beliefs in Visual Data Journalism: Unstable Meanings Behind Data as Truth & Design for Insight
di: Zhang, Ke Er Amy, et al.
Pubblicazione: (2025)

MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings
di: Islam, Rahul, et al.
Pubblicazione: (2024)

Reflections on Teaching Data Storytelling at the Journalism School
di: Lan, Xingyu
Pubblicazione: (2024)

Phoenix: A Novel Context-Aware Voice-Powered Math Equation Workspace and Editor
di: Ge, Kenneth, et al.
Pubblicazione: (2025)

Dango: A Mixed-Initiative Data Wrangling System using Large Language Model
di: Chen, Wei-Hao, et al.
Pubblicazione: (2025)

Exploring MLLMs Perception of Network Visualization Principles
di: Miller, Jacob, et al.
Pubblicazione: (2025)

AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant
di: Jing, Xiaoqing, et al.
Pubblicazione: (2024)

AutoTour: Automatic Photo Tour Guide with Smartphones and LLMs
di: Xu, Huatao, et al.
Pubblicazione: (2026)