Imagen de Portada

Evaluating the Performance of LLMs on Technical Language Processing tasks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kernycky, Andrew, Coleman, David, Spence, Christopher, Das, Udayan
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Information Retrieval
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Text2Cypher Across Languages: Evaluating and Finetuning LLMs
por: Ozsoy, Makbule Gulcin, et al.
Publicado: (2025)

Evaluating the Efficacy of Open-Source LLMs in Enterprise-Specific RAG Systems: A Comparative Study of Performance and Scalability
por: B, Gautam, et al.
Publicado: (2024)

Redefining Retrieval Evaluation in the Era of LLMs
por: Trappolini, Giovanni, et al.
Publicado: (2025)

FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
por: Thakur, Nandan, et al.
Publicado: (2025)

Evaluating LLMs for Gender Disparities in Notable Persons
por: Rhue, Lauren, et al.
Publicado: (2024)

UserGPT Technical Report
por: Xuan, Yunyi, et al.
Publicado: (2026)

RecGPT Technical Report
por: Yi, Chao, et al.
Publicado: (2025)

Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation
por: Liu, Qijiong, et al.
Publicado: (2025)

ThinkQE: Query Expansion via an Evolving Thinking Process
por: Lei, Yibin, et al.
Publicado: (2025)

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
por: Siro, Clemencia, et al.
Publicado: (2024)

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods
por: Li, Haitao, et al.
Publicado: (2024)

RecGPT-V2 Technical Report
por: Yi, Chao, et al.
Publicado: (2025)

Evaluating Small Open LLMs for Medical Question Answering: A Practical Framework
por: Buskila, Avi-ad Avraam
Publicado: (2026)

BioPulse-QA: A Dynamic Biomedical Question-Answering Benchmark for Evaluating Factuality, Robustness, and Bias in Large Language Models
por: Bhattarai, Kriti, et al.
Publicado: (2026)

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language Processing
por: Hsu, Enshuo, et al.
Publicado: (2024)

UniRetriever: Multi-task Candidates Selection for Various Context-Adaptive Conversational Retrieval
por: Wang, Hongru, et al.
Publicado: (2024)

Multilingual E5 Text Embeddings: A Technical Report
por: Wang, Liang, et al.
Publicado: (2024)

Large Language Models as Evaluators for Recommendation Explanations
por: Zhang, Xiaoyu, et al.
Publicado: (2024)

Hallucination Detection and Evaluation of Large Language Model
por: Zhang, Chenggong, et al.
Publicado: (2025)

Do Large Language Models Rank Fairly? An Empirical Study on the Fairness of LLMs as Rankers
por: Wang, Yuan, et al.
Publicado: (2024)

Evaluating Large Language Models for Cross-Lingual Retrieval
por: Zuo, Longfei, et al.
Publicado: (2025)

From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications
por: Ma, Yongqiang, et al.
Publicado: (2024)

Contrastive Learning Using Graph Embeddings for Domain Adaptation of Language Models in the Process Industry
por: Zhukova, Anastasia, et al.
Publicado: (2025)

Author Unknown: Evaluating Performance of Author Extraction Libraries on Global Online News Articles
por: Hatwar, Sriharsha, et al.
Publicado: (2024)

SLIMER-IT: Zero-Shot NER on Italian Language
por: Zamai, Andrew, et al.
Publicado: (2024)

Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models
por: Wang, Xiaolei, et al.
Publicado: (2023)

MDEval: Evaluating and Enhancing Markdown Awareness in Large Language Models
por: Chen, Zhongpu, et al.
Publicado: (2025)

Music Recommendation with Large Language Models: Challenges, Opportunities, and Evaluation
por: Epure, Elena V., et al.
Publicado: (2025)

Team LA at SCIDOCA shared task 2025: Citation Discovery via relation-based zero-shot retrieval
por: An, Trieu, et al.
Publicado: (2025)

Making Large Language Models Efficient Dense Retrievers
por: Lei, Yibin, et al.
Publicado: (2025)

Shaping the Future of Endangered and Low-Resource Languages -- Our Role in the Age of LLMs: A Keynote at ECIR 2024
por: Mothe, Josiane
Publicado: (2024)

Enhancing Lexicon-Based Text Embeddings with Large Language Models
por: Lei, Yibin, et al.
Publicado: (2025)

PRE: A Peer Review Based Large Language Model Evaluator
por: Chu, Zhumin, et al.
Publicado: (2024)

A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting
por: Chang, He, et al.
Publicado: (2024)

Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelines
por: Arabzadeh, Negar, et al.
Publicado: (2026)

Navigating Tomorrow: Reliably Assessing Large Language Models Performance on Future Event Prediction
por: Nako, Petraq, et al.
Publicado: (2025)

Analyticup E-commerce Product Search Competition Technical Report from Team Tredence_AICOE
por: R, Rakshith, et al.
Publicado: (2025)

Corpus-Steered Query Expansion with Large Language Models
por: Lei, Yibin, et al.
Publicado: (2024)

Evaluation of LLMs for Process Model Analysis and Optimization
por: Kumar, Akhil, et al.
Publicado: (2025)

Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation
por: Guinet, Gauthier, et al.
Publicado: (2024)