WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dawkins, Hillary, Nejadgholi, Isar, Lo, Chi-kiu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909382884720640
author Dawkins, Hillary
Nejadgholi, Isar
Lo, Chi-kiu
author_facet Dawkins, Hillary
Nejadgholi, Isar
Lo, Chi-kiu
contents We assess the difficulty of gender resolution in literary-style dialogue settings and the influence of gender stereotypes. Instances of the test suite contain spoken dialogue interleaved with external meta-context about the characters and the manner of speaking. We find that character and manner stereotypes outside of the dialogue significantly impact the gender agreement of referents within the dialogue.
format Preprint
id arxiv_https___arxiv_org_abs_2411_06194
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles
Dawkins, Hillary
Nejadgholi, Isar
Lo, Chi-kiu
Computation and Language
We assess the difficulty of gender resolution in literary-style dialogue settings and the influence of gender stereotypes. Instances of the test suite contain spoken dialogue interleaved with external meta-context about the characters and the manner of speaking. We find that character and manner stereotypes outside of the dialogue significantly impact the gender agreement of referents within the dialogue.
title WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles
topic Computation and Language
url https://arxiv.org/abs/2411.06194