Algorithmic Collusion under Observed Demand Shocks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Ye, Zexin
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917129742188544
author Ye, Zexin
author_facet Ye, Zexin
contents This paper examines how the observability of demand shocks influences pricing patterns and market outcomes when firms delegate pricing decisions to Q-learning algorithms. Simulations show that demand observability induces Q-learning agents to adapt prices to demand fluctuations, giving rise to distinctive demand-contingent pricing patterns across the discount factor $δ$, consistent with Rotemberg and Saloner (1986). When $δ$ is high, they learn procyclical pricing, charging higher prices in higher demand states. In contrast, at low $δ$, they lower prices during booms and raise them during downturns, exhibiting countercyclical pricing. Q-learning agents also autonomously sustain supracompetitive profits, indicating that demand observability does not hinder algorithmic collusion. I further explore how the information available to algorithms shapes their learned pricing behavior. Overall, the results suggest that, through pure trial and error, Q-learning algorithms internalize both the stronger deviation incentives during booms and the trade-off between short-term gains and long-term continuation values governed by the discount factor, thereby reproducing the cyclicality of pricing patterns predicted by collusion theory.
format Preprint
id arxiv_https___arxiv_org_abs_2502_15084
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Algorithmic Collusion under Observed Demand Shocks
Ye, Zexin
General Economics
Economics
This paper examines how the observability of demand shocks influences pricing patterns and market outcomes when firms delegate pricing decisions to Q-learning algorithms. Simulations show that demand observability induces Q-learning agents to adapt prices to demand fluctuations, giving rise to distinctive demand-contingent pricing patterns across the discount factor $δ$, consistent with Rotemberg and Saloner (1986). When $δ$ is high, they learn procyclical pricing, charging higher prices in higher demand states. In contrast, at low $δ$, they lower prices during booms and raise them during downturns, exhibiting countercyclical pricing. Q-learning agents also autonomously sustain supracompetitive profits, indicating that demand observability does not hinder algorithmic collusion. I further explore how the information available to algorithms shapes their learned pricing behavior. Overall, the results suggest that, through pure trial and error, Q-learning algorithms internalize both the stronger deviation incentives during booms and the trade-off between short-term gains and long-term continuation values governed by the discount factor, thereby reproducing the cyclicality of pricing patterns predicted by collusion theory.
title Algorithmic Collusion under Observed Demand Shocks
topic General Economics
Economics
url https://arxiv.org/abs/2502.15084