CrowdFormer: Weakly-supervised Crowd counting with Improved Generalizability

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Savner, Siddharth Singh, Kanhangad, Vivek
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916069115953152
author Savner, Siddharth Singh
Kanhangad, Vivek
author_facet Savner, Siddharth Singh
Kanhangad, Vivek
contents Convolutional neural networks (CNNs) have dominated the field of computer vision for nearly a decade due to their strong ability to learn local features. However, due to their limited receptive field, CNNs fail to model the global context. On the other hand, transformer, an attention-based architecture can model the global context easily. Despite this, there are limited studies that investigate the effectiveness of transformers in crowd counting. In addition, the majority of the existing crowd counting methods are based on the regression of density maps which requires point-level annotation of each person present in the scene. This annotation task is laborious and also error-prone. This has led to increased focus on weakly-supervised crowd counting methods which require only the count-level annotations. In this paper, we propose a weakly-supervised method for crowd counting using a pyramid vision transformer. We have conducted extensive evaluations to validate the effectiveness of the proposed method. Our method is comparable to the state-of-the-art on the benchmark crowd datasets. More importantly, it shows remarkable generalizability.
format Preprint
id arxiv_https___arxiv_org_abs_2203_03768
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle CrowdFormer: Weakly-supervised Crowd counting with Improved Generalizability
Savner, Siddharth Singh
Kanhangad, Vivek
Computer Vision and Pattern Recognition
Convolutional neural networks (CNNs) have dominated the field of computer vision for nearly a decade due to their strong ability to learn local features. However, due to their limited receptive field, CNNs fail to model the global context. On the other hand, transformer, an attention-based architecture can model the global context easily. Despite this, there are limited studies that investigate the effectiveness of transformers in crowd counting. In addition, the majority of the existing crowd counting methods are based on the regression of density maps which requires point-level annotation of each person present in the scene. This annotation task is laborious and also error-prone. This has led to increased focus on weakly-supervised crowd counting methods which require only the count-level annotations. In this paper, we propose a weakly-supervised method for crowd counting using a pyramid vision transformer. We have conducted extensive evaluations to validate the effectiveness of the proposed method. Our method is comparable to the state-of-the-art on the benchmark crowd datasets. More importantly, it shows remarkable generalizability.
title CrowdFormer: Weakly-supervised Crowd counting with Improved Generalizability
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2203.03768