Jetsons at FinNLP 2024: Towards Understanding the ESG Impact of a News Article using Transformer-based Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917626957004800 |
|---|---|
| author | Dakle, Parag Pravin Gon, Alolika Zha, Sihan Wang, Liang Rallabandi, SaiKrishna Raghavan, Preethi |
| author_facet | Dakle, Parag Pravin Gon, Alolika Zha, Sihan Wang, Liang Rallabandi, SaiKrishna Raghavan, Preethi |
| contents | In this paper, we describe the different approaches explored by the Jetsons team for the Multi-Lingual ESG Impact Duration Inference (ML-ESG-3) shared task. The shared task focuses on predicting the duration and type of the ESG impact of a news article. The shared task dataset consists of 2,059 news titles and articles in English, French, Korean, and Japanese languages. For the impact duration classification task, we fine-tuned XLM-RoBERTa with a custom fine-tuning strategy and using self-training and DeBERTa-v3 using only English translations. These models individually ranked first on the leaderboard for Korean and Japanese and in an ensemble for the English language, respectively. For the impact type classification task, our XLM-RoBERTa model fine-tuned using a custom fine-tuning strategy ranked first for the English language. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_00386 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Jetsons at FinNLP 2024: Towards Understanding the ESG Impact of a News Article using Transformer-based Models Dakle, Parag Pravin Gon, Alolika Zha, Sihan Wang, Liang Rallabandi, SaiKrishna Raghavan, Preethi Computation and Language In this paper, we describe the different approaches explored by the Jetsons team for the Multi-Lingual ESG Impact Duration Inference (ML-ESG-3) shared task. The shared task focuses on predicting the duration and type of the ESG impact of a news article. The shared task dataset consists of 2,059 news titles and articles in English, French, Korean, and Japanese languages. For the impact duration classification task, we fine-tuned XLM-RoBERTa with a custom fine-tuning strategy and using self-training and DeBERTa-v3 using only English translations. These models individually ranked first on the leaderboard for Korean and Japanese and in an ensemble for the English language, respectively. For the impact type classification task, our XLM-RoBERTa model fine-tuned using a custom fine-tuning strategy ranked first for the English language. |
| title | Jetsons at FinNLP 2024: Towards Understanding the ESG Impact of a News Article using Transformer-based Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2404.00386 |