CattleFace-RGBT: RGB-T Cattle Facial Landmark Benchmark

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Coffman, Ethan, Clark, Reagan, Bui, Nhat-Tan, Pham, Trong Thang, Kegley, Beth, Powell, Jeremy G., Zhao, Jiangchao, Le, Ngan
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910473263251456
author Coffman, Ethan
Clark, Reagan
Bui, Nhat-Tan
Pham, Trong Thang
Kegley, Beth
Powell, Jeremy G.
Zhao, Jiangchao
Le, Ngan
author_facet Coffman, Ethan
Clark, Reagan
Bui, Nhat-Tan
Pham, Trong Thang
Kegley, Beth
Powell, Jeremy G.
Zhao, Jiangchao
Le, Ngan
contents To address this challenge, we introduce CattleFace-RGBT, a RGB-T Cattle Facial Landmark dataset consisting of 2,300 RGB-T image pairs, a total of 4,600 images. Creating a landmark dataset is time-consuming, but AI-assisted annotation can help. However, applying AI to thermal images is challenging due to suboptimal results from direct thermal training and infeasible RGB-thermal alignment due to different camera views. Therefore, we opt to transfer models trained on RGB to thermal images and refine them using our AI-assisted annotation tool following a semi-automatic annotation approach. Accurately localizing facial key points on both RGB and thermal images enables us to not only discern the cattle's respiratory signs but also measure temperatures to assess the animal's thermal state. To the best of our knowledge, this is the first dataset for the cattle facial landmark on RGB-T images. We conduct benchmarking of the CattleFace-RGBT dataset across various backbone architectures, with the objective of establishing baselines for future research, analysis, and comparison. The dataset and models are at https://github.com/UARK-AICV/CattleFace-RGBT-benchmark
format Preprint
id arxiv_https___arxiv_org_abs_2406_03431
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CattleFace-RGBT: RGB-T Cattle Facial Landmark Benchmark
Coffman, Ethan
Clark, Reagan
Bui, Nhat-Tan
Pham, Trong Thang
Kegley, Beth
Powell, Jeremy G.
Zhao, Jiangchao
Le, Ngan
Computer Vision and Pattern Recognition
To address this challenge, we introduce CattleFace-RGBT, a RGB-T Cattle Facial Landmark dataset consisting of 2,300 RGB-T image pairs, a total of 4,600 images. Creating a landmark dataset is time-consuming, but AI-assisted annotation can help. However, applying AI to thermal images is challenging due to suboptimal results from direct thermal training and infeasible RGB-thermal alignment due to different camera views. Therefore, we opt to transfer models trained on RGB to thermal images and refine them using our AI-assisted annotation tool following a semi-automatic annotation approach. Accurately localizing facial key points on both RGB and thermal images enables us to not only discern the cattle's respiratory signs but also measure temperatures to assess the animal's thermal state. To the best of our knowledge, this is the first dataset for the cattle facial landmark on RGB-T images. We conduct benchmarking of the CattleFace-RGBT dataset across various backbone architectures, with the objective of establishing baselines for future research, analysis, and comparison. The dataset and models are at https://github.com/UARK-AICV/CattleFace-RGBT-benchmark
title CattleFace-RGBT: RGB-T Cattle Facial Landmark Benchmark
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.03431