An Updated Assessment of Reinforcement Learning for Macro Placement

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cheng, Chung-Kuan, Kahng, Andrew B., Kundu, Sayak, Wang, Yucheng, Wang, Zhiang
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917330428100608
author Cheng, Chung-Kuan
Kahng, Andrew B.
Kundu, Sayak
Wang, Yucheng
Wang, Zhiang
author_facet Cheng, Chung-Kuan
Kahng, Andrew B.
Kundu, Sayak
Wang, Yucheng
Wang, Zhiang
contents We provide an improved assessment of Google Brain's deep reinforcement learning approach to macro placement and its updated Circuit Training (CT) implementation in GitHub. A stronger simulated annealing (SA) baseline leverages the "go-with-the-winners" metaheuristic and a multi-threading implementation. We develop and release new public benchmarks in sub-10nm technology: LEF/DEF for Google's 7nm TSMC Ariane protobuf and scaled variants, as well as testcases implemented in the open-source ASAP7 7nm research enablement. We evaluate from-scratch training and fine-tuning results for the latest "AlphaChip" release of Circuit Training, alongside multiple alternative macro placers. We also study the recently-published pre-training guidance in. A commercial place-and-route tool is used to provide "true reward" post-route power, performance and area metrics. All data, evaluation flows and related scripts are publicly available in the MacroPlacement GitHub repository. Our study affords insights into reproducibility and reporting in the research literature, and points out still-missing confirmations (e.g., of CT's scalability and pre-training methodology) that remain open questions for the research community.
format Preprint
id arxiv_https___arxiv_org_abs_2302_11014
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle An Updated Assessment of Reinforcement Learning for Macro Placement
Cheng, Chung-Kuan
Kahng, Andrew B.
Kundu, Sayak
Wang, Yucheng
Wang, Zhiang
Machine Learning
Artificial Intelligence
B.7.2
We provide an improved assessment of Google Brain's deep reinforcement learning approach to macro placement and its updated Circuit Training (CT) implementation in GitHub. A stronger simulated annealing (SA) baseline leverages the "go-with-the-winners" metaheuristic and a multi-threading implementation. We develop and release new public benchmarks in sub-10nm technology: LEF/DEF for Google's 7nm TSMC Ariane protobuf and scaled variants, as well as testcases implemented in the open-source ASAP7 7nm research enablement. We evaluate from-scratch training and fine-tuning results for the latest "AlphaChip" release of Circuit Training, alongside multiple alternative macro placers. We also study the recently-published pre-training guidance in. A commercial place-and-route tool is used to provide "true reward" post-route power, performance and area metrics. All data, evaluation flows and related scripts are publicly available in the MacroPlacement GitHub repository. Our study affords insights into reproducibility and reporting in the research literature, and points out still-missing confirmations (e.g., of CT's scalability and pre-training methodology) that remain open questions for the research community.
title An Updated Assessment of Reinforcement Learning for Macro Placement
topic Machine Learning
Artificial Intelligence
B.7.2
url https://arxiv.org/abs/2302.11014