How to design a dataset compliant with an ML-based system ODD?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914842321879040 |
|---|---|
| author | Cappi, Cyril Cohen, Noémie Ducoffe, Mélanie Gabreau, Christophe Gardes, Laurent Gauffriau, Adrien Ginestet, Jean-Brice Mamalet, Franck Mussot, Vincent Pagetti, Claire Vigouroux, David |
| author_facet | Cappi, Cyril Cohen, Noémie Ducoffe, Mélanie Gabreau, Christophe Gardes, Laurent Gauffriau, Adrien Ginestet, Jean-Brice Mamalet, Franck Mussot, Vincent Pagetti, Claire Vigouroux, David |
| contents | This paper focuses on a Vision-based Landing task and presents the design and the validation of a dataset that would comply with the Operational Design Domain (ODD) of a Machine-Learning (ML) system. Relying on emerging certification standards, we describe the process for establishing ODDs at both the system and image levels. In the process, we present the translation of high-level system constraints into actionable image-level properties, allowing for the definition of verifiable Data Quality Requirements (DQRs). To illustrate this approach, we use the Landing Approach Runway Detection (LARD) dataset which combines synthetic imagery and real footage, and we focus on the steps required to verify the DQRs. The replicable framework presented in this paper addresses the challenges of designing a dataset compliant with the stringent needs of ML-based systems certification in safety-critical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_14027 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | How to design a dataset compliant with an ML-based system ODD? Cappi, Cyril Cohen, Noémie Ducoffe, Mélanie Gabreau, Christophe Gardes, Laurent Gauffriau, Adrien Ginestet, Jean-Brice Mamalet, Franck Mussot, Vincent Pagetti, Claire Vigouroux, David Artificial Intelligence This paper focuses on a Vision-based Landing task and presents the design and the validation of a dataset that would comply with the Operational Design Domain (ODD) of a Machine-Learning (ML) system. Relying on emerging certification standards, we describe the process for establishing ODDs at both the system and image levels. In the process, we present the translation of high-level system constraints into actionable image-level properties, allowing for the definition of verifiable Data Quality Requirements (DQRs). To illustrate this approach, we use the Landing Approach Runway Detection (LARD) dataset which combines synthetic imagery and real footage, and we focus on the steps required to verify the DQRs. The replicable framework presented in this paper addresses the challenges of designing a dataset compliant with the stringent needs of ML-based systems certification in safety-critical applications. |
| title | How to design a dataset compliant with an ML-based system ODD? |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2406.14027 |