Saved in:
Bibliographic Details
Main Authors: Vonderhaar, Lynn, Elvira, Timothy, Procko, Tyler, Ochoa, Omar
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.15268
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913400017125376
author Vonderhaar, Lynn
Elvira, Timothy
Procko, Tyler
Ochoa, Omar
author_facet Vonderhaar, Lynn
Elvira, Timothy
Procko, Tyler
Ochoa, Omar
contents Countless domains rely on Machine Learning (ML) models, including safety-critical domains, such as autonomous driving, which this paper focuses on. While the black box nature of ML is simply a nuisance in some domains, in safety-critical domains, this makes ML models difficult to trust. To fully utilize ML models in safety-critical domains, it would be beneficial to have a method to improve trust in model robustness and accuracy without human experts checking each decision. This research proposes a method to increase trust in ML models used in safety-critical domains by ensuring the robustness and completeness of the model's training dataset. Because ML models embody what they are trained with, ensuring the completeness of training datasets can help to increase the trust in the training of ML models. To this end, this paper proposes the use of a domain ontology and an image quality characteristic ontology to validate the domain completeness and image quality robustness of a training dataset. This research also presents an experiment as a proof of concept for this method, where ontologies are built for the emergency road vehicle domain.
format Preprint
id arxiv_https___arxiv_org_abs_2406_15268
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Robust Training Datasets for Machine Learning with Ontologies: A Case Study for Emergency Road Vehicle Detection
Vonderhaar, Lynn
Elvira, Timothy
Procko, Tyler
Ochoa, Omar
Artificial Intelligence
Countless domains rely on Machine Learning (ML) models, including safety-critical domains, such as autonomous driving, which this paper focuses on. While the black box nature of ML is simply a nuisance in some domains, in safety-critical domains, this makes ML models difficult to trust. To fully utilize ML models in safety-critical domains, it would be beneficial to have a method to improve trust in model robustness and accuracy without human experts checking each decision. This research proposes a method to increase trust in ML models used in safety-critical domains by ensuring the robustness and completeness of the model's training dataset. Because ML models embody what they are trained with, ensuring the completeness of training datasets can help to increase the trust in the training of ML models. To this end, this paper proposes the use of a domain ontology and an image quality characteristic ontology to validate the domain completeness and image quality robustness of a training dataset. This research also presents an experiment as a proof of concept for this method, where ontologies are built for the emergency road vehicle domain.
title Towards Robust Training Datasets for Machine Learning with Ontologies: A Case Study for Emergency Road Vehicle Detection
topic Artificial Intelligence
url https://arxiv.org/abs/2406.15268