Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.09711 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929386530275328 |
|---|---|
| author | Qazi, Ahmed Razzaq, Taha Iqbal, Asim |
| author_facet | Qazi, Ahmed Razzaq, Taha Iqbal, Asim |
| contents | We introduce a multimodal vision framework for precision livestock farming, harnessing the power of GroundingDINO, HQSAM, and ViTPose models. This integrated suite enables comprehensive behavioral analytics from video data without invasive animal tagging. GroundingDINO generates accurate bounding boxes around livestock, while HQSAM segments individual animals within these boxes. ViTPose estimates key body points, facilitating posture and movement analysis. Demonstrated on a sheep dataset with grazing, running, sitting, standing, and walking activities, our framework extracts invaluable insights: activity and grazing patterns, interaction dynamics, and detailed postural evaluations. Applicable across species and video resolutions, this framework revolutionizes non-invasive livestock monitoring for activity detection, counting, health assessments, and posture analyses. It empowers data-driven farm management, optimizing animal welfare and productivity through AI-powered behavioral understanding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_09711 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming Qazi, Ahmed Razzaq, Taha Iqbal, Asim Computer Vision and Pattern Recognition We introduce a multimodal vision framework for precision livestock farming, harnessing the power of GroundingDINO, HQSAM, and ViTPose models. This integrated suite enables comprehensive behavioral analytics from video data without invasive animal tagging. GroundingDINO generates accurate bounding boxes around livestock, while HQSAM segments individual animals within these boxes. ViTPose estimates key body points, facilitating posture and movement analysis. Demonstrated on a sheep dataset with grazing, running, sitting, standing, and walking activities, our framework extracts invaluable insights: activity and grazing patterns, interaction dynamics, and detailed postural evaluations. Applicable across species and video resolutions, this framework revolutionizes non-invasive livestock monitoring for activity detection, counting, health assessments, and posture analyses. It empowers data-driven farm management, optimizing animal welfare and productivity through AI-powered behavioral understanding. |
| title | AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.09711 |