Practical Causal Evaluation Metrics for Biological Networks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sato, Noriaki, Scutari, Marco, Kawano, Shuichi, Yamaguchi, Rui, Imoto, Seiya
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911268878680064
author Sato, Noriaki
Scutari, Marco
Kawano, Shuichi
Yamaguchi, Rui
Imoto, Seiya
author_facet Sato, Noriaki
Scutari, Marco
Kawano, Shuichi
Yamaguchi, Rui
Imoto, Seiya
contents Estimating causal networks from biological data is a critical step in systems biology. When evaluating the inferred network, assessing the networks based on their intervention effects is particularly important for downstream probabilistic reasoning and the identification of potential drug targets. In the context of gene regulatory network inference, biological databases are often used as reference sources. These databases typically describe relationships in a qualitative rather than quantitative manner. However, few evaluation metrics have been developed that take this qualitative nature into account. To address this, we developed a metric, the sign-augmented Structural Intervention Distance (sSID), and a weighted sSID that incorporates the net effects of the intervention. Through simulations and analyses of real transcriptomic datasets, we found that our proposed metrics could identify a different algorithm as optimal compared to conventional metrics, and the network selected by sSID had a superior performance in the classification task of clinical covariates using transcriptomic data. This suggests that sSID can distinguish networks that are structurally correct but functionally incorrect, highlighting its potential as a more biologically meaningful and practical evaluation metric.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12805
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Practical Causal Evaluation Metrics for Biological Networks
Sato, Noriaki
Scutari, Marco
Kawano, Shuichi
Yamaguchi, Rui
Imoto, Seiya
Molecular Networks
Machine Learning
Estimating causal networks from biological data is a critical step in systems biology. When evaluating the inferred network, assessing the networks based on their intervention effects is particularly important for downstream probabilistic reasoning and the identification of potential drug targets. In the context of gene regulatory network inference, biological databases are often used as reference sources. These databases typically describe relationships in a qualitative rather than quantitative manner. However, few evaluation metrics have been developed that take this qualitative nature into account. To address this, we developed a metric, the sign-augmented Structural Intervention Distance (sSID), and a weighted sSID that incorporates the net effects of the intervention. Through simulations and analyses of real transcriptomic datasets, we found that our proposed metrics could identify a different algorithm as optimal compared to conventional metrics, and the network selected by sSID had a superior performance in the classification task of clinical covariates using transcriptomic data. This suggests that sSID can distinguish networks that are structurally correct but functionally incorrect, highlighting its potential as a more biologically meaningful and practical evaluation metric.
title Practical Causal Evaluation Metrics for Biological Networks
topic Molecular Networks
Machine Learning
url https://arxiv.org/abs/2511.12805