Saved in:
Bibliographic Details
Main Authors: Jain, Divij, Kher, Saatvik, Liang, Lena, Wu, Yufeng, Zheng, Ashley, Cai, Xizhen, Plantinga, Anna, Upton, Elizabeth
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.14878
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911885590265856
author Jain, Divij
Kher, Saatvik
Liang, Lena
Wu, Yufeng
Zheng, Ashley
Cai, Xizhen
Plantinga, Anna
Upton, Elizabeth
author_facet Jain, Divij
Kher, Saatvik
Liang, Lena
Wu, Yufeng
Zheng, Ashley
Cai, Xizhen
Plantinga, Anna
Upton, Elizabeth
contents We propose a machine learning pipeline for forensic shoeprint pattern matching that improves on the accuracy and generalisability of existing methods. We extract 2D coordinates from shoeprint scans using edge detection and align the two shoeprints with iterative closest point (ICP). We then extract similarity metrics to quantify how well the two prints match and use these metrics to train a random forest that generates a probabilistic measurement of how likely two prints are to have originated from the same outsole. We assess the generalisability of machine learning methods trained on lab shoeprint scans to more realistic crime scene shoeprint data by evaluating the accuracy of our methods on several shoeprint scenarios: partial prints, prints with varying levels of blurriness, prints with different amounts of wear, and prints from different shoe models. We find that models trained on one type of shoeprint yield extremely high levels of accuracy when tested on shoeprint pairs of the same scenario but fail to generalise to other scenarios. We also discover that models trained on a variety of scenarios predict almost as accurately as models trained on specific scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14878
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving and Evaluating Machine Learning Methods for Forensic Shoeprint Matching
Jain, Divij
Kher, Saatvik
Liang, Lena
Wu, Yufeng
Zheng, Ashley
Cai, Xizhen
Plantinga, Anna
Upton, Elizabeth
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Applications
We propose a machine learning pipeline for forensic shoeprint pattern matching that improves on the accuracy and generalisability of existing methods. We extract 2D coordinates from shoeprint scans using edge detection and align the two shoeprints with iterative closest point (ICP). We then extract similarity metrics to quantify how well the two prints match and use these metrics to train a random forest that generates a probabilistic measurement of how likely two prints are to have originated from the same outsole. We assess the generalisability of machine learning methods trained on lab shoeprint scans to more realistic crime scene shoeprint data by evaluating the accuracy of our methods on several shoeprint scenarios: partial prints, prints with varying levels of blurriness, prints with different amounts of wear, and prints from different shoe models. We find that models trained on one type of shoeprint yield extremely high levels of accuracy when tested on shoeprint pairs of the same scenario but fail to generalise to other scenarios. We also discover that models trained on a variety of scenarios predict almost as accurately as models trained on specific scenarios.
title Improving and Evaluating Machine Learning Methods for Forensic Shoeprint Matching
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Applications
url https://arxiv.org/abs/2405.14878