Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Veeramani, Hariram, Thapa, Surendrabikram, Naseem, Usman
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913235837386752
author Veeramani, Hariram
Thapa, Surendrabikram
Naseem, Usman
author_facet Veeramani, Hariram
Thapa, Surendrabikram
Naseem, Usman
contents In the evolving landscape of Environmental, Social, and Corporate Governance (ESG) impact assessment, the ML-ESG-2 shared task proposes identifying ESG impact types. To address this challenge, we present a comprehensive system leveraging ensemble learning techniques, capitalizing on early and late fusion approaches. Our approach employs four distinct models: mBERT, FlauBERT-base, ALBERT-base-v2, and a Multi-Layer Perceptron (MLP) incorporating Latent Semantic Analysis (LSA) and Term Frequency-Inverse Document Frequency (TF-IDF) features. Through extensive experimentation, we find that our early fusion ensemble approach, featuring the integration of LSA, TF-IDF, mBERT, FlauBERT-base, and ALBERT-base-v2, delivers the best performance. Our system offers a comprehensive ESG impact type identification solution, contributing to the responsible and sustainable decision-making processes vital in today's financial and corporate governance landscape.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10772
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models
Veeramani, Hariram
Thapa, Surendrabikram
Naseem, Usman
Computation and Language
In the evolving landscape of Environmental, Social, and Corporate Governance (ESG) impact assessment, the ML-ESG-2 shared task proposes identifying ESG impact types. To address this challenge, we present a comprehensive system leveraging ensemble learning techniques, capitalizing on early and late fusion approaches. Our approach employs four distinct models: mBERT, FlauBERT-base, ALBERT-base-v2, and a Multi-Layer Perceptron (MLP) incorporating Latent Semantic Analysis (LSA) and Term Frequency-Inverse Document Frequency (TF-IDF) features. Through extensive experimentation, we find that our early fusion ensemble approach, featuring the integration of LSA, TF-IDF, mBERT, FlauBERT-base, and ALBERT-base-v2, delivers the best performance. Our system offers a comprehensive ESG impact type identification solution, contributing to the responsible and sustainable decision-making processes vital in today's financial and corporate governance landscape.
title Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models
topic Computation and Language
url https://arxiv.org/abs/2402.10772