Market-based Architectures in RL and Beyond

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sudhir, Abhimanyu Pallavi, Tran-Thanh, Long
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916646878183424
author Sudhir, Abhimanyu Pallavi
Tran-Thanh, Long
author_facet Sudhir, Abhimanyu Pallavi
Tran-Thanh, Long
contents Market-based agents refer to reinforcement learning agents which determine their actions based on an internal market of sub-agents. We introduce a new type of market-based algorithm where the state itself is factored into several axes called ``goods'', which allows for greater specialization and parallelism than existing market-based RL algorithms. Furthermore, we argue that market-based algorithms have the potential to address many current challenges in AI, such as search, dynamic scaling and complete feedback, and demonstrate that they may be seen to generalize neural networks; finally, we list some novel ways that market algorithms may be applied in conjunction with Large Language Models for immediate practical applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2503_05828
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Market-based Architectures in RL and Beyond
Sudhir, Abhimanyu Pallavi
Tran-Thanh, Long
Artificial Intelligence
Theoretical Economics
Market-based agents refer to reinforcement learning agents which determine their actions based on an internal market of sub-agents. We introduce a new type of market-based algorithm where the state itself is factored into several axes called ``goods'', which allows for greater specialization and parallelism than existing market-based RL algorithms. Furthermore, we argue that market-based algorithms have the potential to address many current challenges in AI, such as search, dynamic scaling and complete feedback, and demonstrate that they may be seen to generalize neural networks; finally, we list some novel ways that market algorithms may be applied in conjunction with Large Language Models for immediate practical applicability.
title Market-based Architectures in RL and Beyond
topic Artificial Intelligence
Theoretical Economics
url https://arxiv.org/abs/2503.05828