AI-Driven Relocation Tracking in Dynamic Kitchen Environments

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Esfahani, Arash Nasr, Hosseini, Hamed, Masouleh, Mehdi Tale, Kalhor, Ahmad, Sajedi, Hedieh
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909522459623424
author Esfahani, Arash Nasr
Hosseini, Hamed
Masouleh, Mehdi Tale
Kalhor, Ahmad
Sajedi, Hedieh
author_facet Esfahani, Arash Nasr
Hosseini, Hamed
Masouleh, Mehdi Tale
Kalhor, Ahmad
Sajedi, Hedieh
contents As smart homes become more prevalent in daily life, the ability to understand dynamic environments is essential which is increasingly dependent on AI systems. This study focuses on developing an intelligent algorithm which can navigate a robot through a kitchen, recognizing objects, and tracking their relocation. The kitchen was chosen as the testing ground due to its dynamic nature as objects are frequently moved, rearranged and replaced. Various techniques, such as SLAM feature-based tracking and deep learning-based object detection (e.g., Faster R-CNN), are commonly used for object tracking. Additionally, methods such as optical flow analysis and 3D reconstruction have also been used to track the relocation of objects. These approaches often face challenges when it comes to problems such as lighting variations and partial occlusions, where parts of the object are hidden in some frames but visible in others. The proposed method in this study leverages the YOLOv5 architecture, initialized with pre-trained weights and subsequently fine-tuned on a custom dataset. A novel method was developed, introducing a frame-scoring algorithm which calculates a score for each object based on its location and features within all frames. This scoring approach helps to identify changes by determining the best-associated frame for each object and comparing the results in each scene, overcoming limitations seen in other methods while maintaining simplicity in design. The experimental results demonstrate an accuracy of 97.72%, a precision of 95.83% and a recall of 96.84% for this algorithm, which highlights the efficacy of the model in detecting spatial changes.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01547
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AI-Driven Relocation Tracking in Dynamic Kitchen Environments
Esfahani, Arash Nasr
Hosseini, Hamed
Masouleh, Mehdi Tale
Kalhor, Ahmad
Sajedi, Hedieh
Computer Vision and Pattern Recognition
As smart homes become more prevalent in daily life, the ability to understand dynamic environments is essential which is increasingly dependent on AI systems. This study focuses on developing an intelligent algorithm which can navigate a robot through a kitchen, recognizing objects, and tracking their relocation. The kitchen was chosen as the testing ground due to its dynamic nature as objects are frequently moved, rearranged and replaced. Various techniques, such as SLAM feature-based tracking and deep learning-based object detection (e.g., Faster R-CNN), are commonly used for object tracking. Additionally, methods such as optical flow analysis and 3D reconstruction have also been used to track the relocation of objects. These approaches often face challenges when it comes to problems such as lighting variations and partial occlusions, where parts of the object are hidden in some frames but visible in others. The proposed method in this study leverages the YOLOv5 architecture, initialized with pre-trained weights and subsequently fine-tuned on a custom dataset. A novel method was developed, introducing a frame-scoring algorithm which calculates a score for each object based on its location and features within all frames. This scoring approach helps to identify changes by determining the best-associated frame for each object and comparing the results in each scene, overcoming limitations seen in other methods while maintaining simplicity in design. The experimental results demonstrate an accuracy of 97.72%, a precision of 95.83% and a recall of 96.84% for this algorithm, which highlights the efficacy of the model in detecting spatial changes.
title AI-Driven Relocation Tracking in Dynamic Kitchen Environments
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.01547