Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Timoshenko, Artem, Mao, Chengfeng, Hauser, John R.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910113592246272
author Timoshenko, Artem
Mao, Chengfeng
Hauser, John R.
author_facet Timoshenko, Artem
Mao, Chengfeng
Hauser, John R.
contents Identifying customer needs (CNs) is fundamental to product innovation and marketing strategy. Yet for over thirty years, Voice-of-the-Customer (VOC) applications have relied on professional analysts to manually interpret qualitative data and formulate "jobs to be done." This task is cognitively demanding, time-consuming, and difficult to scale. While current practice uses machine learning to screen content, the critical final step of precisely formulating CNs relies on expert human judgment. We conduct a series of studies with market research professionals to evaluate whether Large Language Models (LLMs) can automate CN abstraction. Across various product and service categories, we demonstrate that supervised fine-tuned (SFT) LLMs perform at least as well as professional analysts and substantially better than foundational LLMs. These results generalize to alternative foundational LLMs and require relatively "small" models. The abstracted CNs are well-formulated, sufficiently specific to guide innovation, and grounded in source content without hallucination. Our analysis suggests that SFT training enables LLMs to learn the underlying syntactic and semantic conventions of professional CN formulation rather than relying on memorized CNs. Automation of tedious tasks transforms the VOC approach by enabling the discovery of high-leverage insights at scale and by refocusing analysts on higher-value-added tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01870
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs
Timoshenko, Artem
Mao, Chengfeng
Hauser, John R.
Computation and Language
Artificial Intelligence
Human-Computer Interaction
General Economics
Economics
Identifying customer needs (CNs) is fundamental to product innovation and marketing strategy. Yet for over thirty years, Voice-of-the-Customer (VOC) applications have relied on professional analysts to manually interpret qualitative data and formulate "jobs to be done." This task is cognitively demanding, time-consuming, and difficult to scale. While current practice uses machine learning to screen content, the critical final step of precisely formulating CNs relies on expert human judgment. We conduct a series of studies with market research professionals to evaluate whether Large Language Models (LLMs) can automate CN abstraction. Across various product and service categories, we demonstrate that supervised fine-tuned (SFT) LLMs perform at least as well as professional analysts and substantially better than foundational LLMs. These results generalize to alternative foundational LLMs and require relatively "small" models. The abstracted CNs are well-formulated, sufficiently specific to guide innovation, and grounded in source content without hallucination. Our analysis suggests that SFT training enables LLMs to learn the underlying syntactic and semantic conventions of professional CN formulation rather than relying on memorized CNs. Automation of tedious tasks transforms the VOC approach by enabling the discovery of high-leverage insights at scale and by refocusing analysts on higher-value-added tasks.
title Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs
topic Computation and Language
Artificial Intelligence
Human-Computer Interaction
General Economics
Economics
url https://arxiv.org/abs/2503.01870