Objectifying the Subjective: Cognitive Biases in Topic Interpretations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909705192865792 |
|---|---|
| author | Hingmire, Swapnil Li, Ze Shi Shiyu Zeng Awon, Ahmed Musa Guerra, Luiz Franciscatto Ernst, Neil |
| author_facet | Hingmire, Swapnil Li, Ze Shi Shiyu Zeng Awon, Ahmed Musa Guerra, Luiz Franciscatto Ernst, Neil |
| contents | Interpretation of topics is crucial for their downstream applications. State-of-the-art evaluation measures of topic quality such as coherence and word intrusion do not measure how much a topic facilitates the exploration of a corpus. To design evaluation measures grounded on a task, and a population of users, we do user studies to understand how users interpret topics. We propose constructs of topic quality and ask users to assess them in the context of a topic and provide rationale behind evaluations. We use reflexive thematic analysis to identify themes of topic interpretations from rationales. Users interpret topics based on availability and representativeness heuristics rather than probability. We propose a theory of topic interpretation based on the anchoring-and-adjustment heuristic: users anchor on salient words and make semantic adjustments to arrive at an interpretation. Topic interpretation can be viewed as making a judgment under uncertainty by an ecologically rational user, and hence cognitive biases aware user models and evaluation frameworks are needed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_19117 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Objectifying the Subjective: Cognitive Biases in Topic Interpretations Hingmire, Swapnil Li, Ze Shi Shiyu Zeng Awon, Ahmed Musa Guerra, Luiz Franciscatto Ernst, Neil Computation and Language Interpretation of topics is crucial for their downstream applications. State-of-the-art evaluation measures of topic quality such as coherence and word intrusion do not measure how much a topic facilitates the exploration of a corpus. To design evaluation measures grounded on a task, and a population of users, we do user studies to understand how users interpret topics. We propose constructs of topic quality and ask users to assess them in the context of a topic and provide rationale behind evaluations. We use reflexive thematic analysis to identify themes of topic interpretations from rationales. Users interpret topics based on availability and representativeness heuristics rather than probability. We propose a theory of topic interpretation based on the anchoring-and-adjustment heuristic: users anchor on salient words and make semantic adjustments to arrive at an interpretation. Topic interpretation can be viewed as making a judgment under uncertainty by an ecologically rational user, and hence cognitive biases aware user models and evaluation frameworks are needed. |
| title | Objectifying the Subjective: Cognitive Biases in Topic Interpretations |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.19117 |