BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Fangxun, Rayeed, S M, Stevens, Samuel, East, Alyson, Chiang, Cheng Hsuan, Lee, Colin, Yi, Daniel, Yang, Junke, Naik, Tejas, Wang, Ziyi, Kilrain, Connor, Buckwalter, Elijah H, Hou, Jiacheng, Bueno, Saul Ibaven, Wang, Shuheng, Ma, Xinyue, Liu, Yifan, Tao, Zhiyuan, Zhang, Ziheng, Sokol, Eric, Belitz, Michael, Record, Sydne, Stewart, Charles V., Chao, Wei-Lun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910077330391040
author Liu, Fangxun
Rayeed, S M
Stevens, Samuel
East, Alyson
Chiang, Cheng Hsuan
Lee, Colin
Yi, Daniel
Yang, Junke
Naik, Tejas
Wang, Ziyi
Kilrain, Connor
Buckwalter, Elijah H
Hou, Jiacheng
Bueno, Saul Ibaven
Wang, Shuheng
Ma, Xinyue
Liu, Yifan
Tao, Zhiyuan
Zhang, Ziheng
Sokol, Eric
Belitz, Michael
Record, Sydne
Stewart, Charles V.
Chao, Wei-Lun
author_facet Liu, Fangxun
Rayeed, S M
Stevens, Samuel
East, Alyson
Chiang, Cheng Hsuan
Lee, Colin
Yi, Daniel
Yang, Junke
Naik, Tejas
Wang, Ziyi
Kilrain, Connor
Buckwalter, Elijah H
Hou, Jiacheng
Bueno, Saul Ibaven
Wang, Shuheng
Ma, Xinyue
Liu, Yifan
Tao, Zhiyuan
Zhang, Ziheng
Sokol, Eric
Belitz, Michael
Record, Sydne
Stewart, Charles V.
Chao, Wei-Lun
contents In entomology and ecology research, biologists often need to collect a large number of insects, among which beetles are the most common species. A common practice for biologists to organize beetles is to place them on trays and take a picture of each tray. Given the images of thousands of such trays, it is important to have an automated pipeline to process the large-scale data for further research. Therefore, we develop a 3-stage pipeline to detect all the beetles on each tray, sort and crop the image of each beetle, and do morphological segmentation on the cropped beetles. For detection, we design an iterative process utilizing a transformer-based open-vocabulary object detector and a vision-language model. For segmentation, we manually labeled 670 beetle images and fine-tuned two variants of a transformer-based segmentation model to achieve fine-grained segmentation of beetles with relatively high accuracy. The pipeline integrates multiple deep learning methods and is specialized for beetle image processing, which can greatly improve the efficiency to process large-scale beetle data and accelerate biological research.
format Preprint
id arxiv_https___arxiv_org_abs_2511_00255
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing
Liu, Fangxun
Rayeed, S M
Stevens, Samuel
East, Alyson
Chiang, Cheng Hsuan
Lee, Colin
Yi, Daniel
Yang, Junke
Naik, Tejas
Wang, Ziyi
Kilrain, Connor
Buckwalter, Elijah H
Hou, Jiacheng
Bueno, Saul Ibaven
Wang, Shuheng
Ma, Xinyue
Liu, Yifan
Tao, Zhiyuan
Zhang, Ziheng
Sokol, Eric
Belitz, Michael
Record, Sydne
Stewart, Charles V.
Chao, Wei-Lun
Computer Vision and Pattern Recognition
In entomology and ecology research, biologists often need to collect a large number of insects, among which beetles are the most common species. A common practice for biologists to organize beetles is to place them on trays and take a picture of each tray. Given the images of thousands of such trays, it is important to have an automated pipeline to process the large-scale data for further research. Therefore, we develop a 3-stage pipeline to detect all the beetles on each tray, sort and crop the image of each beetle, and do morphological segmentation on the cropped beetles. For detection, we design an iterative process utilizing a transformer-based open-vocabulary object detector and a vision-language model. For segmentation, we manually labeled 670 beetle images and fine-tuned two variants of a transformer-based segmentation model to achieve fine-grained segmentation of beetles with relatively high accuracy. The pipeline integrates multiple deep learning methods and is specialized for beetle image processing, which can greatly improve the efficiency to process large-scale beetle data and accelerate biological research.
title BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.00255