Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nejadgholi, Isar, Molamohammadi, Maryam, Bakhtawar, Samir
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911686384943104
author Nejadgholi, Isar
Molamohammadi, Maryam
Bakhtawar, Samir
author_facet Nejadgholi, Isar
Molamohammadi, Maryam
Bakhtawar, Samir
contents The non-profit settlement sector in Canada supports newcomers in achieving successful integration. This sector faces increasing operational pressures amidst rising immigration targets, which highlights a need for enhanced efficiency and innovation, potentially through reliable AI solutions. The ad-hoc use of general-purpose generative AI, such as ChatGPT, might become a common practice among newcomers and service providers to address this need. However, these tools are not tailored for the settlement domain and can have detrimental implications for immigrants and refugees. We explore the risks that these tools might pose on newcomers to first, warn against the unguarded use of generative AI, and second, to incentivize further research and development in creating AI literacy programs as well as customized LLMs that are aligned with the preferences of the impacted communities. Crucially, such technologies should be designed to integrate seamlessly into the existing workflow of the settlement sector, ensuring human oversight, trustworthiness, and accountability.
format Preprint
id arxiv_https___arxiv_org_abs_2407_20240
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada
Nejadgholi, Isar
Molamohammadi, Maryam
Bakhtawar, Samir
Computers and Society
Artificial Intelligence
I.2.1, I.2.7
The non-profit settlement sector in Canada supports newcomers in achieving successful integration. This sector faces increasing operational pressures amidst rising immigration targets, which highlights a need for enhanced efficiency and innovation, potentially through reliable AI solutions. The ad-hoc use of general-purpose generative AI, such as ChatGPT, might become a common practice among newcomers and service providers to address this need. However, these tools are not tailored for the settlement domain and can have detrimental implications for immigrants and refugees. We explore the risks that these tools might pose on newcomers to first, warn against the unguarded use of generative AI, and second, to incentivize further research and development in creating AI literacy programs as well as customized LLMs that are aligned with the preferences of the impacted communities. Crucially, such technologies should be designed to integrate seamlessly into the existing workflow of the settlement sector, ensuring human oversight, trustworthiness, and accountability.
title Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada
topic Computers and Society
Artificial Intelligence
I.2.1, I.2.7
url https://arxiv.org/abs/2407.20240