LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chippa, Meenakshi Subhash, Chhipa, Prakash Chandra, De, Kanjar, Liwicki, Marcus, Saini, Rajkumar
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917797295030272
author Chippa, Meenakshi Subhash
Chhipa, Prakash Chandra
De, Kanjar
Liwicki, Marcus
Saini, Rajkumar
author_facet Chippa, Meenakshi Subhash
Chhipa, Prakash Chandra
De, Kanjar
Liwicki, Marcus
Saini, Rajkumar
contents Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic parameters is challenging, making it hard to synthesize perspective distortion effectively. The current distortion correction methods involve removing distortion and learning vision tasks, thus making it a multi-step process, often compromising performance. Recent work leverages the Möbius transform for mitigating perspective distortions (MPD) to synthesize perspective distortions without estimating camera parameters. Möbius transform requires tuning multiple interdependent and interrelated parameters and involving complex arithmetic operations, leading to substantial computational complexity. To address these challenges, we propose Log Conformal Maps (LCM), a method leveraging the logarithmic function to approximate perspective distortions with fewer parameters and reduced computational complexity. We provide a detailed foundation complemented with experiments to demonstrate that LCM with fewer parameters approximates the MPD. We show that LCM integrates well with supervised and self-supervised representation learning, outperform standard models, and matches the state-of-the-art performance in mitigating perspective distortion over multiple benchmarks, namely Imagenet-PD, Imagenet-E, and Imagenet-X. Further LCM demonstrate seamless integration with person re-identification and improved the performance. Source code is made publicly available at https://github.com/meenakshi23/Log-Conformal-Maps.
format Preprint
id arxiv_https___arxiv_org_abs_2410_03686
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion
Chippa, Meenakshi Subhash
Chhipa, Prakash Chandra
De, Kanjar
Liwicki, Marcus
Saini, Rajkumar
Computer Vision and Pattern Recognition
Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic parameters is challenging, making it hard to synthesize perspective distortion effectively. The current distortion correction methods involve removing distortion and learning vision tasks, thus making it a multi-step process, often compromising performance. Recent work leverages the Möbius transform for mitigating perspective distortions (MPD) to synthesize perspective distortions without estimating camera parameters. Möbius transform requires tuning multiple interdependent and interrelated parameters and involving complex arithmetic operations, leading to substantial computational complexity. To address these challenges, we propose Log Conformal Maps (LCM), a method leveraging the logarithmic function to approximate perspective distortions with fewer parameters and reduced computational complexity. We provide a detailed foundation complemented with experiments to demonstrate that LCM with fewer parameters approximates the MPD. We show that LCM integrates well with supervised and self-supervised representation learning, outperform standard models, and matches the state-of-the-art performance in mitigating perspective distortion over multiple benchmarks, namely Imagenet-PD, Imagenet-E, and Imagenet-X. Further LCM demonstrate seamless integration with person re-identification and improved the performance. Source code is made publicly available at https://github.com/meenakshi23/Log-Conformal-Maps.
title LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.03686