Saved in:
Bibliographic Details
Main Authors: Kaushik, Arjun Ramesh, P, Sunil Rufus R, Ratha, Nalini
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.00411
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909374517084160
author Kaushik, Arjun Ramesh
P, Sunil Rufus R
Ratha, Nalini
author_facet Kaushik, Arjun Ramesh
P, Sunil Rufus R
Ratha, Nalini
contents The increasing prevalence of AI-generated content alongside human-written text underscores the need for reliable discrimination methods. To address this challenge, we propose a novel framework with textual embeddings from Pre-trained Language Models (PLMs) to distinguish AI-generated and human-authored text. Our approach utilizes Embedding Fusion to integrate semantic information from multiple Language Models, harnessing their complementary strengths to enhance performance. Through extensive evaluation across publicly available diverse datasets, our proposed approach demonstrates strong performance, achieving classification accuracy greater than 96% and a Matthews Correlation Coefficient (MCC) greater than 0.93. This evaluation is conducted on a balanced dataset of texts generated from five well-known Large Language Models (LLMs), highlighting the effectiveness and robustness of our novel methodology.
format Preprint
id arxiv_https___arxiv_org_abs_2411_00411
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing Authorship Attribution through Embedding Fusion: A Novel Approach with Masked and Encoder-Decoder Language Models
Kaushik, Arjun Ramesh
P, Sunil Rufus R
Ratha, Nalini
Computation and Language
Machine Learning
The increasing prevalence of AI-generated content alongside human-written text underscores the need for reliable discrimination methods. To address this challenge, we propose a novel framework with textual embeddings from Pre-trained Language Models (PLMs) to distinguish AI-generated and human-authored text. Our approach utilizes Embedding Fusion to integrate semantic information from multiple Language Models, harnessing their complementary strengths to enhance performance. Through extensive evaluation across publicly available diverse datasets, our proposed approach demonstrates strong performance, achieving classification accuracy greater than 96% and a Matthews Correlation Coefficient (MCC) greater than 0.93. This evaluation is conducted on a balanced dataset of texts generated from five well-known Large Language Models (LLMs), highlighting the effectiveness and robustness of our novel methodology.
title Enhancing Authorship Attribution through Embedding Fusion: A Novel Approach with Masked and Encoder-Decoder Language Models
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2411.00411