Buchumschlag

Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Tan, Zhiyin, D'Souza, Jennifer
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Computation and Language Artificial Intelligence Digital Libraries
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models
von: Tan, Zhiyin, et al.
Veröffentlicht: (2025)

LLMs4Synthesis: Leveraging Large Language Models for Scientific Synthesis
von: Giglou, Hamed Babaei, et al.
Veröffentlicht: (2024)

Large Language Models for Scientific Information Extraction: An Empirical Study for Virology
von: Shamsabadi, Mahsa, et al.
Veröffentlicht: (2024)

Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models
von: D'Souza, Jennifer, et al.
Veröffentlicht: (2025)

LLMs4SchemaDiscovery: A Human-in-the-Loop Workflow for Scientific Schema Mining with Large Language Models
von: Sadruddin, Sameer, et al.
Veröffentlicht: (2025)

From Keywords to Structured Summaries: Streamlining Scholarly Information Access
von: Shamsabadi, Mahsa, et al.
Veröffentlicht: (2024)

Fairness Evaluation of Large Language Models in Academic Library Reference Services
von: Wang, Haining, et al.
Veröffentlicht: (2025)

SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog
von: D'Souza, Jennifer, et al.
Veröffentlicht: (2025)

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment
von: Wu, Wenqing, et al.
Veröffentlicht: (2026)

Named Entity Recognition of Historical Texts via Large Language Model
von: Zhang, Shibingfeng, et al.
Veröffentlicht: (2025)

Automated Novelty Evaluation of Academic Paper: A Collaborative Approach Integrating Human and Large Language Model Knowledge
von: Wu, Wenqing, et al.
Veröffentlicht: (2025)

An Extreme Multi-label Text Classification (XMTC) Library Dataset: What if we took "Use of Practical AI in Digital Libraries" seriously?
von: D'Souza, Jennifer, et al.
Veröffentlicht: (2026)

Leveraging Large Language Models for Generating Research Topic Ontologies: A Multi-Disciplinary Study
von: Aggarwal, Tanay, et al.
Veröffentlicht: (2025)

Semantically Orthogonal Framework for Citation Classification: Disentangling Intent and Content
von: Duan, Changxu, et al.
Veröffentlicht: (2026)

Publishing FAIR and Machine-actionable Reviews in Materials Science: The Case for Symbolic Knowledge in Neuro-symbolic Artificial Intelligence
von: D'Souza, Jennifer, et al.
Veröffentlicht: (2026)

A Survey Forest Diagram : Gain a Divergent Insight View on a Specific Research Topic
von: Li, Jinghong, et al.
Veröffentlicht: (2024)

Diagnosing Structural Failures in LLM-Based Evidence Extraction for Meta-Analysis
von: Tan, Zhiyin, et al.
Veröffentlicht: (2026)

Evaluating GPT-3.5's Awareness and Summarization Abilities for European Constitutional Texts with Shared Topics
von: Greco, Candida M., et al.
Veröffentlicht: (2024)

Can Smaller Large Language Models Evaluate Research Quality?
von: Thelwall, Mike
Veröffentlicht: (2025)

Publication Trend Analysis and Synthesis via Large Language Model: A Case Study of Engineering in PNAS
von: Smetana, Mason, et al.
Veröffentlicht: (2025)

Multi-Disciplinary Dataset Discovery from Citation-Verified Literature Contexts
von: Tan, Zhiyin, et al.
Veröffentlicht: (2026)

Large Language Models as Evaluators for Scientific Synthesis
von: Evans, Julia, et al.
Veröffentlicht: (2024)

The Impact of Large Language Models in Academia: from Writing to Speaking
von: Geng, Mingmeng, et al.
Veröffentlicht: (2024)

Using Large Language Models to Enrich the Documentation of Datasets for Machine Learning
von: Giner-Miguelez, Joan, et al.
Veröffentlicht: (2024)

The 17% Gap: Quantifying Epistemic Decay in AI-Assisted Survey Papers
von: İlter, H. Kemal
Veröffentlicht: (2026)

Large language models for automated scholarly paper review: A survey
von: Zhuang, Zhenzhen, et al.
Veröffentlicht: (2025)

Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis
von: Yu, Huizi, et al.
Veröffentlicht: (2024)

Disaster Informatics after the COVID-19 Pandemic: Bibliometric and Topic Analysis based on Large-scale Academic Literature
von: Tran, Ngan, et al.
Veröffentlicht: (2025)

Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models
von: Kelber, Florian, et al.
Veröffentlicht: (2026)

Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark
von: Wu, Yu, et al.
Veröffentlicht: (2025)

Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Papers
von: Geng, Mingmeng, et al.
Veröffentlicht: (2026)

Historical Ink: Exploring Large Language Models for Irony Detection in 19th-Century Spanish
von: Cohen, Kevin, et al.
Veröffentlicht: (2025)

PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Papers
von: Lee, Yoonjoo, et al.
Veröffentlicht: (2024)

Hidden Entity Detection from GitHub Leveraging Large Language Models
von: Gan, Lu, et al.
Veröffentlicht: (2025)

Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs
von: Thelwall, Mike
Veröffentlicht: (2024)

The Role of Large Language Models in Musicology: Are We Ready to Trust the Machines?
von: Ramoneda, Pedro, et al.
Veröffentlicht: (2024)

Fine-tuning and Prompt Engineering with Cognitive Knowledge Graphs for Scholarly Knowledge Organization
von: Rabby, Gollam, et al.
Veröffentlicht: (2024)

Interesting Scientific Idea Generation using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders
von: Gu, Xuemei, et al.
Veröffentlicht: (2024)

TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open Language Models
von: Nadas, Mihai, et al.
Veröffentlicht: (2025)

Automating Categorization of Scientific Texts with In-Context Learning and Prompt-Chaining in Large Language Models
von: Shahi, Gautam Kishore, et al.
Veröffentlicht: (2026)