Deep Learning-Driven Multimodal Detection and Movement Analysis of Objects in Culinary
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912591229485056 |
|---|---|
| author | Ishat, Tahoshin Alam Qayum, Mohammad Abdul |
| author_facet | Ishat, Tahoshin Alam Qayum, Mohammad Abdul |
| contents | This is a research exploring existing models and fine tuning them to combine a YOLOv8 segmentation model, a LSTM model trained on hand point motion sequence and a ASR (whisper-base) to extract enough data for a LLM (TinyLLaMa) to predict the recipe and generate text creating a step by step guide for the cooking procedure. All the data were gathered by the author for a robust task specific system to perform best in complex and challenging environments proving the extension and endless application of computer vision in daily activities such as kitchen work. This work extends the field for many more crucial task of our day to day life. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_00033 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Deep Learning-Driven Multimodal Detection and Movement Analysis of Objects in Culinary Ishat, Tahoshin Alam Qayum, Mohammad Abdul Computer Vision and Pattern Recognition Artificial Intelligence This is a research exploring existing models and fine tuning them to combine a YOLOv8 segmentation model, a LSTM model trained on hand point motion sequence and a ASR (whisper-base) to extract enough data for a LLM (TinyLLaMa) to predict the recipe and generate text creating a step by step guide for the cooking procedure. All the data were gathered by the author for a robust task specific system to perform best in complex and challenging environments proving the extension and endless application of computer vision in daily activities such as kitchen work. This work extends the field for many more crucial task of our day to day life. |
| title | Deep Learning-Driven Multimodal Detection and Movement Analysis of Objects in Culinary |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2509.00033 |