Concorde: Fast and Accurate CPU Performance Modeling with Compositional Analytical-ML Fusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nasr-Esfahany, Arash, Alizadeh, Mohammad, Lee, Victor, Alam, Hanna, Coon, Brett W., Culler, David, Dadu, Vidushi, Dixon, Martin, Levy, Henry M., Pandey, Santosh, Ranganathan, Parthasarathy, Yazdanbakhsh, Amir
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917971811631104
author Nasr-Esfahany, Arash
Alizadeh, Mohammad
Lee, Victor
Alam, Hanna
Coon, Brett W.
Culler, David
Dadu, Vidushi
Dixon, Martin
Levy, Henry M.
Pandey, Santosh
Ranganathan, Parthasarathy
Yazdanbakhsh, Amir
author_facet Nasr-Esfahany, Arash
Alizadeh, Mohammad
Lee, Victor
Alam, Hanna
Coon, Brett W.
Culler, David
Dadu, Vidushi
Dixon, Martin
Levy, Henry M.
Pandey, Santosh
Ranganathan, Parthasarathy
Yazdanbakhsh, Amir
contents Cycle-level simulators such as gem5 are widely used in microarchitecture design, but they are prohibitively slow for large-scale design space explorations. We present Concorde, a new methodology for learning fast and accurate performance models of microarchitectures. Unlike existing simulators and learning approaches that emulate each instruction, Concorde predicts the behavior of a program based on compact performance distributions that capture the impact of different microarchitectural components. It derives these performance distributions using simple analytical models that estimate bounds on performance induced by each microarchitectural component, providing a simple yet rich representation of a program's performance characteristics across a large space of microarchitectural parameters. Experiments show that Concorde is more than five orders of magnitude faster than a reference cycle-level simulator, with about 2% average Cycles-Per-Instruction (CPI) prediction error across a range of SPEC, open-source, and proprietary benchmarks. This enables rapid design-space exploration and performance sensitivity analyses that are currently infeasible, e.g., in about an hour, we conducted a first-of-its-kind fine-grained performance attribution to different microarchitectural components across a diverse set of programs, requiring nearly 150 million CPI evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2503_23076
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Concorde: Fast and Accurate CPU Performance Modeling with Compositional Analytical-ML Fusion
Nasr-Esfahany, Arash
Alizadeh, Mohammad
Lee, Victor
Alam, Hanna
Coon, Brett W.
Culler, David
Dadu, Vidushi
Dixon, Martin
Levy, Henry M.
Pandey, Santosh
Ranganathan, Parthasarathy
Yazdanbakhsh, Amir
Hardware Architecture
Machine Learning
Performance
Cycle-level simulators such as gem5 are widely used in microarchitecture design, but they are prohibitively slow for large-scale design space explorations. We present Concorde, a new methodology for learning fast and accurate performance models of microarchitectures. Unlike existing simulators and learning approaches that emulate each instruction, Concorde predicts the behavior of a program based on compact performance distributions that capture the impact of different microarchitectural components. It derives these performance distributions using simple analytical models that estimate bounds on performance induced by each microarchitectural component, providing a simple yet rich representation of a program's performance characteristics across a large space of microarchitectural parameters. Experiments show that Concorde is more than five orders of magnitude faster than a reference cycle-level simulator, with about 2% average Cycles-Per-Instruction (CPI) prediction error across a range of SPEC, open-source, and proprietary benchmarks. This enables rapid design-space exploration and performance sensitivity analyses that are currently infeasible, e.g., in about an hour, we conducted a first-of-its-kind fine-grained performance attribution to different microarchitectural components across a diverse set of programs, requiring nearly 150 million CPI evaluations.
title Concorde: Fast and Accurate CPU Performance Modeling with Compositional Analytical-ML Fusion
topic Hardware Architecture
Machine Learning
Performance
url https://arxiv.org/abs/2503.23076