Saved in:
Bibliographic Details
Main Authors: Gwak, Daehoon, Park, Junwoo, Park, Minho, Park, Chaehun, Lee, Hyunchan, Choi, Edward, Choo, Jaegul
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.14042
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929599705776128
author Gwak, Daehoon
Park, Junwoo
Park, Minho
Park, Chaehun
Lee, Hyunchan
Choi, Edward
Choo, Jaegul
author_facet Gwak, Daehoon
Park, Junwoo
Park, Minho
Park, Chaehun
Lee, Hyunchan
Choi, Edward
Choo, Jaegul
contents Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics. However, existing datasets available for this task are often limited in quality, hindering the progress of related research. In this paper, we introduce WORLDREP (WORLD Relationship and Event Prediction), a novel dataset designed to address these limitations by leveraging the advanced reasoning capabilities of large-language models (LLMs). Our dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. We showcase the quality and utility of WORLDREP for real-world event prediction tasks, demonstrating its effectiveness through extensive experiments and analysis. Furthermore, we publicly release our dataset along with the full automation source code for data collection, labeling, and benchmarking, aiming to support and advance research in text-based event prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2411_14042
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
Gwak, Daehoon
Park, Junwoo
Park, Minho
Park, Chaehun
Lee, Hyunchan
Choi, Edward
Choo, Jaegul
Computation and Language
Artificial Intelligence
Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics. However, existing datasets available for this task are often limited in quality, hindering the progress of related research. In this paper, we introduce WORLDREP (WORLD Relationship and Event Prediction), a novel dataset designed to address these limitations by leveraging the advanced reasoning capabilities of large-language models (LLMs). Our dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. We showcase the quality and utility of WORLDREP for real-world event prediction tasks, demonstrating its effectiveness through extensive experiments and analysis. Furthermore, we publicly release our dataset along with the full automation source code for data collection, labeling, and benchmarking, aiming to support and advance research in text-based event prediction.
title Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2411.14042