Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Yuantao, Yang, Zhankui
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2504.04216
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909571199533056
author Zhang, Yuantao
Yang, Zhankui
author_facet Zhang, Yuantao
Yang, Zhankui
contents The rise of Large Language Models (LLMs) has brought about concerns regarding copyright infringement and unethical practices in data and model usage. For instance, slight modifications to existing LLMs may be used to falsely claim the development of new models, leading to issues of model copying and violations of ownership rights. This paper addresses these challenges by introducing a novel metric for quantifying LLM similarity, which leverages perplexity curves and differences in Menger curvature. Comprehensive experiments validate the performance of our methodology, demonstrating its superiority over baseline methods and its ability to generalize across diverse models and domains. Furthermore, we highlight the capability of our approach in detecting model replication through simulations, emphasizing its potential to preserve the originality and integrity of LLMs. Code is available at https://github.com/zyttt-coder/LLM_similarity.
format Preprint
id arxiv_https___arxiv_org_abs_2504_04216
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Perplexity and Menger Curvature-Based Approach for Similarity Evaluation of Large Language Models
Zhang, Yuantao
Yang, Zhankui
Computation and Language
The rise of Large Language Models (LLMs) has brought about concerns regarding copyright infringement and unethical practices in data and model usage. For instance, slight modifications to existing LLMs may be used to falsely claim the development of new models, leading to issues of model copying and violations of ownership rights. This paper addresses these challenges by introducing a novel metric for quantifying LLM similarity, which leverages perplexity curves and differences in Menger curvature. Comprehensive experiments validate the performance of our methodology, demonstrating its superiority over baseline methods and its ability to generalize across diverse models and domains. Furthermore, we highlight the capability of our approach in detecting model replication through simulations, emphasizing its potential to preserve the originality and integrity of LLMs. Code is available at https://github.com/zyttt-coder/LLM_similarity.
title A Perplexity and Menger Curvature-Based Approach for Similarity Evaluation of Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2504.04216