SmartHome-Bench: A Comprehensive Benchmark for Video Anomaly Detection in Smart Homes Using Multi-Modal Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | Zhao, Xinyi, Zhang, Congjing, Guo, Pei, Li, Wei, Chen, Lin, Zhao, Chaoyue, Huang, Shuai |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification
by: Zhang, Congjing, et al.
Published: (2025)
by: Zhang, Congjing, et al.
Published: (2025)
Detecting Abnormal Health Conditions in Smart Home Using a Drone
by: Barman, Pronob Kumar
Published: (2023)
by: Barman, Pronob Kumar
Published: (2023)
HomeSafeBench: A Benchmark for Embodied Vision-Language Models in Free-Exploration Home Safety Inspection
by: Gao, Siyuan, et al.
Published: (2025)
by: Gao, Siyuan, et al.
Published: (2025)
PersonalHomeBench: Evaluating Agents in Personalized Smart Homes
by: Bharadwaj, Manasa, et al.
Published: (2026)
by: Bharadwaj, Manasa, et al.
Published: (2026)
MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals
by: Yu, Lei, et al.
Published: (2024)
by: Yu, Lei, et al.
Published: (2024)
HomeBench: Evaluating LLMs in Smart Homes with Valid and Invalid Instructions Across Single and Multiple Devices
by: Li, Silin, et al.
Published: (2025)
by: Li, Silin, et al.
Published: (2025)
SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes
by: Li, Kuan, et al.
Published: (2026)
by: Li, Kuan, et al.
Published: (2026)
LongInsightBench: A Comprehensive Benchmark for Evaluating Omni-Modal Models on Human-Centric Long-Video Understanding
by: Han, ZhaoYang, et al.
Published: (2025)
by: Han, ZhaoYang, et al.
Published: (2025)
IllusionBench+: A Large-scale and Comprehensive Benchmark for Visual Illusion Understanding in Vision-Language Models
by: Zhang, Yiming, et al.
Published: (2025)
by: Zhang, Yiming, et al.
Published: (2025)
SmartBench: Evaluating LLMs in Smart Homes with Anomalous Device States and Behavioral Contexts
by: Zou, Qingsong, et al.
Published: (2026)
by: Zou, Qingsong, et al.
Published: (2026)
TOC-Bench: A Temporal Object Consistency Benchmark for Video Large Language Models
by: Chen, Junzhe, et al.
Published: (2026)
by: Chen, Junzhe, et al.
Published: (2026)
Smart Homes of the Future
by: Absalom E. Ezugwu, et al.
Published: (2025)
by: Absalom E. Ezugwu, et al.
Published: (2025)
Synthetic User Behavior Sequence Generation with Large Language Models for Smart Homes
by: Xu, Zhiyao, et al.
Published: (2025)
by: Xu, Zhiyao, et al.
Published: (2025)
Self-adaptive Traffic Anomaly Detection System for IoT Smart Home Environments
by: Watanabe, Naoto, et al.
Published: (2024)
by: Watanabe, Naoto, et al.
Published: (2024)
Make Your Home Safe: Time-aware Unsupervised User Behavior Anomaly Detection in Smart Homes via Loss-guided Mask
by: Xiao, Jingyu, et al.
Published: (2024)
by: Xiao, Jingyu, et al.
Published: (2024)
SmartBuild : Smart Home Construction Platform
by: Akshara A P, et al.
Published: (2026)
by: Akshara A P, et al.
Published: (2026)
DeePLT: Personalized Lighting Facilitates by Trajectory Prediction of Recognized Residents in the Smart Home
by: Safaei, Danial, et al.
Published: (2023)
by: Safaei, Danial, et al.
Published: (2023)
SimuHome: A Temporal- and Environment-Aware Benchmark for Smart Home LLM Agents
by: Seo, Gyuhyeon, et al.
Published: (2025)
by: Seo, Gyuhyeon, et al.
Published: (2025)
Matter: IoT Interoperability for Smart Homes
by: Madadi-Barough, Saeid, et al.
Published: (2024)
by: Madadi-Barough, Saeid, et al.
Published: (2024)
AVFakeBench: A Comprehensive Audio-Video Forgery Detection Benchmark for AV-LMMs
by: Xia, Shuhan, et al.
Published: (2025)
by: Xia, Shuhan, et al.
Published: (2025)
EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis
by: Liu, Shengyuan, et al.
Published: (2025)
by: Liu, Shengyuan, et al.
Published: (2025)
Intelligent Living: A Comprehensive Survey on Smart Home Technologies
by: Orfanides, Sotiris
Published: (2025)
by: Orfanides, Sotiris
Published: (2025)
VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Models
by: Xu, Mingjie, et al.
Published: (2025)
by: Xu, Mingjie, et al.
Published: (2025)
PM4Bench: Benchmarking Large Vision-Language Models with Parallel Multilingual Multi-Modal Multi-task Corpus
by: Gao, Junyuan, et al.
Published: (2025)
by: Gao, Junyuan, et al.
Published: (2025)
Impact Conflict Detection of IoT Services in Multi-resident Smart Homes
by: Chaki, Dipankar, et al.
Published: (2024)
by: Chaki, Dipankar, et al.
Published: (2024)
Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference
by: Zhao, Han, et al.
Published: (2024)
by: Zhao, Han, et al.
Published: (2024)
Framework for an Intelligent Affect Aware Smart Home Environment for Elderly People
by: Thakur, Nirmalya, et al.
Published: (2021)
by: Thakur, Nirmalya, et al.
Published: (2021)
Semantic-aware Graph-guided Behavior Sequences Generation with Large Language Models for Smart Homes
by: Xu, Zhiyao, et al.
Published: (2025)
by: Xu, Zhiyao, et al.
Published: (2025)
"What If Smart Homes Could See Our Homes?": Exploring DIY Smart Home Building Experiences with VLM-Based Camera Sensors
by: Yun, Sojeong, et al.
Published: (2025)
by: Yun, Sojeong, et al.
Published: (2025)
SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation
by: Wu, Aodi, et al.
Published: (2026)
by: Wu, Aodi, et al.
Published: (2026)
Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models
by: Wang, Jin, et al.
Published: (2025)
by: Wang, Jin, et al.
Published: (2025)
LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition
by: Liu, Zishuai, et al.
Published: (2026)
by: Liu, Zishuai, et al.
Published: (2026)
EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents
by: Yang, Rui, et al.
Published: (2025)
by: Yang, Rui, et al.
Published: (2025)
ProactiveVideoQA: A Comprehensive Benchmark Evaluating Proactive Interactions in Video Large Language Models
by: Wang, Yueqian, et al.
Published: (2025)
by: Wang, Yueqian, et al.
Published: (2025)
Accessible, At-Home Detection of Parkinson's Disease via Multi-task Video Analysis
by: Islam, Md Saiful, et al.
Published: (2024)
by: Islam, Md Saiful, et al.
Published: (2024)
InstructionBench: An Instructional Video Understanding Benchmark
by: Wei, Haiwan, et al.
Published: (2025)
by: Wei, Haiwan, et al.
Published: (2025)
MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
by: Jiang, Xi, et al.
Published: (2024)
by: Jiang, Xi, et al.
Published: (2024)
Using Large Language Models to Compare Explainable Models for Smart Home Human Activity Recognition
by: Fiori, Michele, et al.
Published: (2024)
by: Fiori, Michele, et al.
Published: (2024)
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs
by: Bharadwaj, Rohit, et al.
Published: (2024)
by: Bharadwaj, Rohit, et al.
Published: (2024)
VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
by: Qi, Yukun, et al.
Published: (2025)
by: Qi, Yukun, et al.
Published: (2025)
Similar Items
-
ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification
by: Zhang, Congjing, et al.
Published: (2025) -
Detecting Abnormal Health Conditions in Smart Home Using a Drone
by: Barman, Pronob Kumar
Published: (2023) -
HomeSafeBench: A Benchmark for Embodied Vision-Language Models in Free-Exploration Home Safety Inspection
by: Gao, Siyuan, et al.
Published: (2025) -
PersonalHomeBench: Evaluating Agents in Personalized Smart Homes
by: Bharadwaj, Manasa, et al.
Published: (2026) -
MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals
by: Yu, Lei, et al.
Published: (2024)