Self-supervised learning unveils change in urban housing from street-level images

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Stalder, Steven, Volpi, Michele, Büttner, Nicolas, Law, Stephen, Harttgen, Kenneth, Suel, Esra
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910547374505984
author Stalder, Steven
Volpi, Michele
Büttner, Nicolas
Law, Stephen
Harttgen, Kenneth
Suel, Esra
author_facet Stalder, Steven
Volpi, Michele
Büttner, Nicolas
Law, Stephen
Harttgen, Kenneth
Suel, Esra
contents Cities around the world face a critical shortage of affordable and decent housing. Despite its critical importance for policy, our ability to effectively monitor and track progress in urban housing is limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions toward more liveable, equitable, and sustainable cities.
format Preprint
id arxiv_https___arxiv_org_abs_2309_11354
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Self-supervised learning unveils change in urban housing from street-level images
Stalder, Steven
Volpi, Michele
Büttner, Nicolas
Law, Stephen
Harttgen, Kenneth
Suel, Esra
Computer Vision and Pattern Recognition
Machine Learning
Cities around the world face a critical shortage of affordable and decent housing. Despite its critical importance for policy, our ability to effectively monitor and track progress in urban housing is limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions toward more liveable, equitable, and sustainable cities.
title Self-supervised learning unveils change in urban housing from street-level images
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2309.11354