Decoding Consumer Preferences Using Attention-Based Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Foster, Joshua, Odegaard, Fredrik
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912498375983104
author Foster, Joshua
Odegaard, Fredrik
author_facet Foster, Joshua
Odegaard, Fredrik
contents This paper proposes a new demand estimation method using attention-based language models. An encoder-only language model is trained in a two-stage process to analyze the natural language descriptions of used cars from a large US-based online auction marketplace. The approach enables semi-nonparametrically estimation for the demand primitives of a structural model representing the private valuations and market size for each vehicle listing. In the first stage, the language model is fine-tuned to encode the target auction outcomes using the natural language vehicle descriptions. In the second stage, the trained language model's encodings are projected into the parameter space of the structural model. The model's capability to conduct counterfactual analyses within the trained market space is validated using a subsample of withheld auction data, which includes a set of unique "zero shot" instances.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17564
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Decoding Consumer Preferences Using Attention-Based Language Models
Foster, Joshua
Odegaard, Fredrik
Econometrics
This paper proposes a new demand estimation method using attention-based language models. An encoder-only language model is trained in a two-stage process to analyze the natural language descriptions of used cars from a large US-based online auction marketplace. The approach enables semi-nonparametrically estimation for the demand primitives of a structural model representing the private valuations and market size for each vehicle listing. In the first stage, the language model is fine-tuned to encode the target auction outcomes using the natural language vehicle descriptions. In the second stage, the trained language model's encodings are projected into the parameter space of the structural model. The model's capability to conduct counterfactual analyses within the trained market space is validated using a subsample of withheld auction data, which includes a set of unique "zero shot" instances.
title Decoding Consumer Preferences Using Attention-Based Language Models
topic Econometrics
url https://arxiv.org/abs/2507.17564