Evolutionary Algorithms Approach For Search Based On Semantic Document Similarity

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Muniyappa, Chandrashekar, Kim, Eujin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916632786370560
author Muniyappa, Chandrashekar
Kim, Eujin
author_facet Muniyappa, Chandrashekar
Kim, Eujin
contents Advancements in cloud computing and distributed computing have fostered research activities in Computer science. As a result, researchers have made significant progress in Neural Networks, Evolutionary Computing Algorithms like Genetic, and Differential evolution algorithms. These algorithms are used to develop clustering, recommendation, and question-and-answering systems using various text representation and similarity measurement techniques. In this research paper, Universal Sentence Encoder (USE) is used to capture the semantic similarity of text; And the transfer learning technique is used to apply Genetic Algorithm (GA) and Differential Evolution (DE) algorithms to search and retrieve relevant top N documents based on user query. The proposed approach is applied to the Stanford Question and Answer (SQuAD) Dataset to identify a user query. Finally, through experiments, we prove that text documents can be efficiently represented as sentence embedding vectors using USE to capture the semantic similarity, and by comparing the results of the Manhattan Distance, GA, and DE algorithms we prove that the evolutionary algorithms are good at finding the top N results than the traditional ranking approach.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19437
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Evolutionary Algorithms Approach For Search Based On Semantic Document Similarity
Muniyappa, Chandrashekar
Kim, Eujin
Neural and Evolutionary Computing
Artificial Intelligence
Machine Learning
68T50
I.2.7; I.2.11
Advancements in cloud computing and distributed computing have fostered research activities in Computer science. As a result, researchers have made significant progress in Neural Networks, Evolutionary Computing Algorithms like Genetic, and Differential evolution algorithms. These algorithms are used to develop clustering, recommendation, and question-and-answering systems using various text representation and similarity measurement techniques. In this research paper, Universal Sentence Encoder (USE) is used to capture the semantic similarity of text; And the transfer learning technique is used to apply Genetic Algorithm (GA) and Differential Evolution (DE) algorithms to search and retrieve relevant top N documents based on user query. The proposed approach is applied to the Stanford Question and Answer (SQuAD) Dataset to identify a user query. Finally, through experiments, we prove that text documents can be efficiently represented as sentence embedding vectors using USE to capture the semantic similarity, and by comparing the results of the Manhattan Distance, GA, and DE algorithms we prove that the evolutionary algorithms are good at finding the top N results than the traditional ranking approach.
title Evolutionary Algorithms Approach For Search Based On Semantic Document Similarity
topic Neural and Evolutionary Computing
Artificial Intelligence
Machine Learning
68T50
I.2.7; I.2.11
url https://arxiv.org/abs/2502.19437