Research on Evaluation Methods for Patent Novelty Search Systems and Empirical Analysis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Shu, Zhang, LiSha, Duan, Kai, Sun, XinKai
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918129984077824
author Zhang, Shu
Zhang, LiSha
Duan, Kai
Sun, XinKai
author_facet Zhang, Shu
Zhang, LiSha
Duan, Kai
Sun, XinKai
contents Patent novelty search systems are critical to IP protection and innovation assessment; their retrieval accuracy directly impacts patent quality. We propose a comprehensive evaluation methodology that builds high-quality, reproducible datasets from examiner citations and X-type citations extracted from technically consistent family patents, and evaluates systems using invention descriptions as inputs. Using Top-k Detection Rate and Recall as core metrics, we further conduct multi-dimensional analyses by language, technical field (IPC), and filing jurisdiction. Experiments show the method effectively exposes performance differences across scenarios and offers actionable evidence for system improvement. The framework is scalable and practical, providing a useful reference for development and optimization of patent novelty search systems
format Preprint
id arxiv_https___arxiv_org_abs_2508_17782
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Research on Evaluation Methods for Patent Novelty Search Systems and Empirical Analysis
Zhang, Shu
Zhang, LiSha
Duan, Kai
Sun, XinKai
Information Retrieval
Patent novelty search systems are critical to IP protection and innovation assessment; their retrieval accuracy directly impacts patent quality. We propose a comprehensive evaluation methodology that builds high-quality, reproducible datasets from examiner citations and X-type citations extracted from technically consistent family patents, and evaluates systems using invention descriptions as inputs. Using Top-k Detection Rate and Recall as core metrics, we further conduct multi-dimensional analyses by language, technical field (IPC), and filing jurisdiction. Experiments show the method effectively exposes performance differences across scenarios and offers actionable evidence for system improvement. The framework is scalable and practical, providing a useful reference for development and optimization of patent novelty search systems
title Research on Evaluation Methods for Patent Novelty Search Systems and Empirical Analysis
topic Information Retrieval
url https://arxiv.org/abs/2508.17782