Resilient Pattern Mining

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bian, Pengxin, Charalampopoulos, Panagiotis, Ayad, Lorraine A. K., Mohamed, Manal, Pissis, Solon P., Loukides, Grigorios
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915327998164992
author Bian, Pengxin
Charalampopoulos, Panagiotis
Ayad, Lorraine A. K.
Mohamed, Manal
Pissis, Solon P.
Loukides, Grigorios
author_facet Bian, Pengxin
Charalampopoulos, Panagiotis
Ayad, Lorraine A. K.
Mohamed, Manal
Pissis, Solon P.
Loukides, Grigorios
contents Frequent pattern mining is a flagship problem in data mining. In its most basic form, it asks for the set of substrings of a given string $S$ of length $n$ that occur at least $τ$ times in $S$, for some integer $τ\in[1,n]$. We introduce a resilient version of this classic problem, which we term the $(τ, k)$-Resilient Pattern Mining (RPM) problem. Given a string $S$ of length $n$ and two integers $τ, k\in[1,n]$, RPM asks for the set of substrings of $S$ that occur at least $τ$ times in $S$, even when the letters at any $k$ positions of $S$ are substituted by other letters. Unlike frequent substrings, resilient ones account for the fact that changes to string $S$ are often expensive to handle or are unknown. We propose an exact $\mathcal{O}(n\log n)$-time and $\mathcal{O}(n)$-space algorithm for RPM, which employs advanced data structures and combinatorial insights. We then present experiments on real large-scale datasets from different domains demonstrating that: (I) The notion of resilient substrings is useful in analyzing genomic data and is more powerful than that of frequent substrings, in scenarios where resilience is required, such as in the case of versioned datasets; (II) Our algorithm is several orders of magnitude faster and more space-efficient than a baseline algorithm that is based on dynamic programming; and (III) Clustering based on resilient substrings is effective.
format Preprint
id arxiv_https___arxiv_org_abs_2506_04935
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Resilient Pattern Mining
Bian, Pengxin
Charalampopoulos, Panagiotis
Ayad, Lorraine A. K.
Mohamed, Manal
Pissis, Solon P.
Loukides, Grigorios
Data Structures and Algorithms
Frequent pattern mining is a flagship problem in data mining. In its most basic form, it asks for the set of substrings of a given string $S$ of length $n$ that occur at least $τ$ times in $S$, for some integer $τ\in[1,n]$. We introduce a resilient version of this classic problem, which we term the $(τ, k)$-Resilient Pattern Mining (RPM) problem. Given a string $S$ of length $n$ and two integers $τ, k\in[1,n]$, RPM asks for the set of substrings of $S$ that occur at least $τ$ times in $S$, even when the letters at any $k$ positions of $S$ are substituted by other letters. Unlike frequent substrings, resilient ones account for the fact that changes to string $S$ are often expensive to handle or are unknown. We propose an exact $\mathcal{O}(n\log n)$-time and $\mathcal{O}(n)$-space algorithm for RPM, which employs advanced data structures and combinatorial insights. We then present experiments on real large-scale datasets from different domains demonstrating that: (I) The notion of resilient substrings is useful in analyzing genomic data and is more powerful than that of frequent substrings, in scenarios where resilience is required, such as in the case of versioned datasets; (II) Our algorithm is several orders of magnitude faster and more space-efficient than a baseline algorithm that is based on dynamic programming; and (III) Clustering based on resilient substrings is effective.
title Resilient Pattern Mining
topic Data Structures and Algorithms
url https://arxiv.org/abs/2506.04935