Enhancing Reinforcement Learning for the Floorplanning of Analog ICs with Beam Search

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Della Rovere, Sandro Junior, Basso, Davide, Bortolussi, Luca, Videnovic-Misic, Mirjana, Habal, Husni
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910932713603072
author Della Rovere, Sandro Junior
Basso, Davide
Bortolussi, Luca
Videnovic-Misic, Mirjana
Habal, Husni
author_facet Della Rovere, Sandro Junior
Basso, Davide
Bortolussi, Luca
Videnovic-Misic, Mirjana
Habal, Husni
contents The layout of analog ICs requires making complex trade-offs, while addressing device physics and variability of the circuits. This makes full automation with learning-based solutions hard to achieve. However, reinforcement learning (RL) has recently reached significant results, particularly in solving the floorplanning problem. This paper presents a hybrid method that combines RL with a beam (BS) strategy. The BS algorithm enhances the agent's inference process, allowing for the generation of flexible floorplans by accomodating various objective weightings, and addressing congestion without without the need for policy retraining or fine-tuning. Moreover, the RL agent's generalization ability stays intact, along with its efficient handling of circuit features and constraints. Experimental results show approx. 5-85% improvement in area, dead space and half-perimeter wire length compared to a standard RL application, along with higher rewards for the agent. Moreover, performance and efficiency align closely with those of existing state-of-the-art techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05059
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Reinforcement Learning for the Floorplanning of Analog ICs with Beam Search
Della Rovere, Sandro Junior
Basso, Davide
Bortolussi, Luca
Videnovic-Misic, Mirjana
Habal, Husni
Artificial Intelligence
Machine Learning
The layout of analog ICs requires making complex trade-offs, while addressing device physics and variability of the circuits. This makes full automation with learning-based solutions hard to achieve. However, reinforcement learning (RL) has recently reached significant results, particularly in solving the floorplanning problem. This paper presents a hybrid method that combines RL with a beam (BS) strategy. The BS algorithm enhances the agent's inference process, allowing for the generation of flexible floorplans by accomodating various objective weightings, and addressing congestion without without the need for policy retraining or fine-tuning. Moreover, the RL agent's generalization ability stays intact, along with its efficient handling of circuit features and constraints. Experimental results show approx. 5-85% improvement in area, dead space and half-perimeter wire length compared to a standard RL application, along with higher rewards for the agent. Moreover, performance and efficiency align closely with those of existing state-of-the-art techniques.
title Enhancing Reinforcement Learning for the Floorplanning of Analog ICs with Beam Search
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2505.05059