Comparative Model Fidelity Evaluation to Support Design Decisions for Complex, Novel Systems of Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Louis, Edward, Mocko, Gregory, Taylor, Evan
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915425682456576
author Louis, Edward
Mocko, Gregory
Taylor, Evan
author_facet Louis, Edward
Mocko, Gregory
Taylor, Evan
contents Systems design processes are increasingly reliant on simulation models to inform design decisions. A pervasive issue within the systems engineering community is trusting in the models used to make decisions about complex systems. This work presents a method of evaluating the trustworthiness of a model to provide utility to a designer making a decision within a design process. Trusting the results of a model is especially important in design processes where the system is complex, novel, or displays emergent phenomena. Additionally, systems that are in the pre-prototype stages of development often do not have sources of ground truth for validating the models. Developing methods of model validation and trust that do not require real-world data is a key challenge facing systems engineers. Model fidelity in this work refers to the adherence of a model to real-world physics and is closely tied to model trust and model validity. Trust and validity directly support a designer's ability to make decisions using physics-based models. The physics that are captured in a model and the complexity of the mathematical representation of the physics contribute to a model's fidelity, and this work leverages the included physical phenomena to develop a means of selecting the most appropriate for a given design decision.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02456
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Comparative Model Fidelity Evaluation to Support Design Decisions for Complex, Novel Systems of Systems
Louis, Edward
Mocko, Gregory
Taylor, Evan
Computational Engineering, Finance, and Science
Systems design processes are increasingly reliant on simulation models to inform design decisions. A pervasive issue within the systems engineering community is trusting in the models used to make decisions about complex systems. This work presents a method of evaluating the trustworthiness of a model to provide utility to a designer making a decision within a design process. Trusting the results of a model is especially important in design processes where the system is complex, novel, or displays emergent phenomena. Additionally, systems that are in the pre-prototype stages of development often do not have sources of ground truth for validating the models. Developing methods of model validation and trust that do not require real-world data is a key challenge facing systems engineers. Model fidelity in this work refers to the adherence of a model to real-world physics and is closely tied to model trust and model validity. Trust and validity directly support a designer's ability to make decisions using physics-based models. The physics that are captured in a model and the complexity of the mathematical representation of the physics contribute to a model's fidelity, and this work leverages the included physical phenomena to develop a means of selecting the most appropriate for a given design decision.
title Comparative Model Fidelity Evaluation to Support Design Decisions for Complex, Novel Systems of Systems
topic Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2508.02456