Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.16521 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909325279100928 |
|---|---|
| author | Chen, Yan-Ying Hakimi, Shabnam Van, Monica Chen, Francine Hong, Matthew Klenk, Matt Wu, Charlene |
| author_facet | Chen, Yan-Ying Hakimi, Shabnam Van, Monica Chen, Francine Hong, Matthew Klenk, Matt Wu, Charlene |
| contents | Product images (e.g., a phone) can be used to elicit a diverse set of consumer-reported features expressed through language, including surface-level perceptual attributes (e.g., "white") and more complex ones, like perceived utility (e.g., "battery"). The cognitive complexity of elicited language reveals the nature of cognitive processes and the context required to understand them; cognitive complexity also predicts consumers' subsequent choices. This work offers an approach for measuring and validating the cognitive complexity of human language elicited by product images, providing a tool for understanding the cognitive processes of human as well as virtual respondents simulated by Large Language Models (LLMs). We also introduce a large dataset that includes diverse descriptive labels for product images, including human-rated complexity. We demonstrate that human-rated cognitive complexity can be approximated using a set of natural language models that, combined, roughly capture the complexity construct. Moreover, this approach is minimally supervised and scalable, even in use cases with limited human assessment of complexity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_16521 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Understanding the Cognitive Complexity in Language Elicited by Product Images Chen, Yan-Ying Hakimi, Shabnam Van, Monica Chen, Francine Hong, Matthew Klenk, Matt Wu, Charlene Computation and Language Product images (e.g., a phone) can be used to elicit a diverse set of consumer-reported features expressed through language, including surface-level perceptual attributes (e.g., "white") and more complex ones, like perceived utility (e.g., "battery"). The cognitive complexity of elicited language reveals the nature of cognitive processes and the context required to understand them; cognitive complexity also predicts consumers' subsequent choices. This work offers an approach for measuring and validating the cognitive complexity of human language elicited by product images, providing a tool for understanding the cognitive processes of human as well as virtual respondents simulated by Large Language Models (LLMs). We also introduce a large dataset that includes diverse descriptive labels for product images, including human-rated complexity. We demonstrate that human-rated cognitive complexity can be approximated using a set of natural language models that, combined, roughly capture the complexity construct. Moreover, this approach is minimally supervised and scalable, even in use cases with limited human assessment of complexity. |
| title | Understanding the Cognitive Complexity in Language Elicited by Product Images |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2409.16521 |