Saved in:
Bibliographic Details
Main Authors: Tran, Minh, De Luis, Adrian, Liao, Haitao, Huang, Ying, McCann, Roy, Mantooth, Alan, Cothren, Jack, Le, Ngan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.04489
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913813255684096
author Tran, Minh
De Luis, Adrian
Liao, Haitao
Huang, Ying
McCann, Roy
Mantooth, Alan
Cothren, Jack
Le, Ngan
author_facet Tran, Minh
De Luis, Adrian
Liao, Haitao
Huang, Ying
McCann, Roy
Mantooth, Alan
Cothren, Jack
Le, Ngan
contents As the impact of climate change escalates, the global necessity to transition to sustainable energy sources becomes increasingly evident. Renewable energies have emerged as a viable solution for users, with Photovoltaic energy being a favored choice for small installations due to its reliability and efficiency. Accurate mapping of PV installations is crucial for understanding the extension of its adoption and informing energy policy. To meet this need, we introduce S3Former, designed to segment solar panels from aerial imagery and provide size and location information critical for analyzing the impact of such installations on the grid. Solar panel identification is challenging due to factors such as varying weather conditions, roof characteristics, Ground Sampling Distance variations and lack of appropriate initialization weights for optimized training. To tackle these complexities, S3Former features a Masked Attention Mask Transformer incorporating a self-supervised learning pretrained backbone. Specifically, our model leverages low-level and high-level features extracted from the backbone and incorporates an instance query mechanism incorporated on the Transformer architecture to enhance the localization of solar PV installations. We introduce a self-supervised learning phase (pretext task) to improve the initialization weights on the backbone of S3Former. We evaluated S3Former using diverse datasets, demonstrate improvement state-of-the-art models.
format Preprint
id arxiv_https___arxiv_org_abs_2405_04489
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle S3Former: Self-supervised High-resolution Transformer for Solar PV Profiling
Tran, Minh
De Luis, Adrian
Liao, Haitao
Huang, Ying
McCann, Roy
Mantooth, Alan
Cothren, Jack
Le, Ngan
Computer Vision and Pattern Recognition
As the impact of climate change escalates, the global necessity to transition to sustainable energy sources becomes increasingly evident. Renewable energies have emerged as a viable solution for users, with Photovoltaic energy being a favored choice for small installations due to its reliability and efficiency. Accurate mapping of PV installations is crucial for understanding the extension of its adoption and informing energy policy. To meet this need, we introduce S3Former, designed to segment solar panels from aerial imagery and provide size and location information critical for analyzing the impact of such installations on the grid. Solar panel identification is challenging due to factors such as varying weather conditions, roof characteristics, Ground Sampling Distance variations and lack of appropriate initialization weights for optimized training. To tackle these complexities, S3Former features a Masked Attention Mask Transformer incorporating a self-supervised learning pretrained backbone. Specifically, our model leverages low-level and high-level features extracted from the backbone and incorporates an instance query mechanism incorporated on the Transformer architecture to enhance the localization of solar PV installations. We introduce a self-supervised learning phase (pretext task) to improve the initialization weights on the backbone of S3Former. We evaluated S3Former using diverse datasets, demonstrate improvement state-of-the-art models.
title S3Former: Self-supervised High-resolution Transformer for Solar PV Profiling
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.04489