Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.16954 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917096573632512 |
|---|---|
| author | Liu, Qiyuan Zhang, Qirui Du, Jinhong Zhao, Siming Wang, Jingshu |
| author_facet | Liu, Qiyuan Zhang, Qirui Du, Jinhong Zhao, Siming Wang, Jingshu |
| contents | The Perturbation Discrimination Score (PDS) is increasingly used to evaluate whether predicted perturbation effects remain distinguishable, including in Systema and the Virtual Cell Challenge. However, its behavior in high-dimensional gene-expression settings has not been examined in detail. We show that PDS is highly sensitive to the choice of similarity or distance measure and to the scale of predicted effects. Analysis of observed perturbation responses reveals that $\ell_1$ and $\ell_2$-based PDS behave very differently from cosine-based measures, even after norm matching. We provide geometric insight and discuss implications for future discrimination-based evaluation metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_16954 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Effects of Distance Metrics and Scaling on the Perturbation Discrimination Score Liu, Qiyuan Zhang, Qirui Du, Jinhong Zhao, Siming Wang, Jingshu Applications Computation The Perturbation Discrimination Score (PDS) is increasingly used to evaluate whether predicted perturbation effects remain distinguishable, including in Systema and the Virtual Cell Challenge. However, its behavior in high-dimensional gene-expression settings has not been examined in detail. We show that PDS is highly sensitive to the choice of similarity or distance measure and to the scale of predicted effects. Analysis of observed perturbation responses reveals that $\ell_1$ and $\ell_2$-based PDS behave very differently from cosine-based measures, even after norm matching. We provide geometric insight and discuss implications for future discrimination-based evaluation metrics. |
| title | Effects of Distance Metrics and Scaling on the Perturbation Discrimination Score |
| topic | Applications Computation |
| url | https://arxiv.org/abs/2511.16954 |