Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.14285 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918061475364864 |
|---|---|
| author | Jang, Seongbo Jeon, Minjin Lee, Jaehoon Lee, Seonghyeon Lee, Dongha Yu, Hwanjo |
| author_facet | Jang, Seongbo Jeon, Minjin Lee, Jaehoon Lee, Seonghyeon Lee, Dongha Yu, Hwanjo |
| contents | While research on dialogue response generation has primarily focused on generating coherent responses conditioning on textual context, the critical question of when to respond grounded on the temporal context remains underexplored. To bridge this gap, we propose a novel task called timely dialogue response generation and introduce the TimelyChat benchmark, which evaluates the capabilities of language models to predict appropriate time intervals and generate time-conditioned responses. Additionally, we construct a large-scale training dataset by leveraging unlabeled event knowledge from a temporal commonsense knowledge graph and employing a large language model (LLM) to synthesize 55K event-driven dialogues. We then train Timer, a dialogue agent designed to proactively predict time intervals and generate timely responses that align with those intervals. Experimental results show that Timer outperforms prompting-based LLMs and other fine-tuned baselines in both turn-level and dialogue-level evaluations. We publicly release our data, model, and code. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_14285 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From What to Respond to When to Respond: Timely Response Generation for Open-domain Dialogue Agents Jang, Seongbo Jeon, Minjin Lee, Jaehoon Lee, Seonghyeon Lee, Dongha Yu, Hwanjo Computation and Language While research on dialogue response generation has primarily focused on generating coherent responses conditioning on textual context, the critical question of when to respond grounded on the temporal context remains underexplored. To bridge this gap, we propose a novel task called timely dialogue response generation and introduce the TimelyChat benchmark, which evaluates the capabilities of language models to predict appropriate time intervals and generate time-conditioned responses. Additionally, we construct a large-scale training dataset by leveraging unlabeled event knowledge from a temporal commonsense knowledge graph and employing a large language model (LLM) to synthesize 55K event-driven dialogues. We then train Timer, a dialogue agent designed to proactively predict time intervals and generate timely responses that align with those intervals. Experimental results show that Timer outperforms prompting-based LLMs and other fine-tuned baselines in both turn-level and dialogue-level evaluations. We publicly release our data, model, and code. |
| title | From What to Respond to When to Respond: Timely Response Generation for Open-domain Dialogue Agents |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.14285 |