Imagen de Portada

A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ono, Shinnosuke, Sukeda, Issey, Fujii, Takuro, Buma, Kosei, Sasaki, Shunsuke
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resources
por: Sukeda, Issey
Publicado: (2024)

70B-parameter large language models in Japanese medical question-answering
por: Sukeda, Issey, et al.
Publicado: (2024)

Heron-Bench: A Benchmark for Evaluating Vision Language Models in Japanese
por: Inoue, Yuichi, et al.
Publicado: (2024)

JAPAGEN: Efficient Few/Zero-shot Learning via Japanese Training Dataset Generation with LLM
por: Fujii, Takuro, et al.
Publicado: (2024)

Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs
por: Chen, Yingjian, et al.
Publicado: (2025)

Minimum information Markov model
por: Sukeda, Issey, et al.
Publicado: (2026)

Frank copula is minimum information copula under fixed Kendall's $τ$
por: Sukeda, Issey, et al.
Publicado: (2024)

Relative local dependence of bivariate copulas
por: Sukeda, Issey, et al.
Publicado: (2024)

On the minimum information checkerboard copulas under fixed Kendall's rank correlation
por: Sukeda, Issey, et al.
Publicado: (2023)

Exploring the Effect of Segmentation and Vocabulary Size on Speech Tokenization for Speech Language Models
por: Kando, Shunsuke, et al.
Publicado: (2025)

BURMESE-SAN: Burmese NLP Benchmark for Evaluating Large Language Models
por: Aung, Thura, et al.
Publicado: (2026)

Privacy Evaluation Benchmarks for NLP Models
por: Huang, Wei, et al.
Publicado: (2024)

AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languages
por: Uemura, Kosei, et al.
Publicado: (2025)

JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Models
por: Jiang, Junfeng, et al.
Publicado: (2024)

Ebisu: Benchmarking Large Language Models in Japanese Finance
por: Peng, Xueqing, et al.
Publicado: (2026)

Textless Dependency Parsing by Labeled Sequence Prediction
por: Kando, Shunsuke, et al.
Publicado: (2024)

Construction of a Japanese Financial Benchmark for Large Language Models
por: Hirano, Masanori
Publicado: (2024)

NLP-ADBench: NLP Anomaly Detection Benchmark
por: Li, Yuangang, et al.
Publicado: (2024)

Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models
por: Poddar, Soham, et al.
Publicado: (2025)

Benchmarking Large Language Models on Multiple Tasks in Bioinformatics NLP with Prompting
por: Jiang, Jiyue, et al.
Publicado: (2025)

J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modeling
por: Nakata, Wataru, et al.
Publicado: (2024)

TurkicNLP: An NLP Toolkit for Turkic Languages
por: Hakimov, Sherzod
Publicado: (2026)

Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Concepts
por: Gao, Fan, et al.
Publicado: (2023)

Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks
por: Li, Qintong, et al.
Publicado: (2023)

Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness
por: Li, Mingchen, et al.
Publicado: (2024)

Foundations and Evaluations in NLP
por: Park, Jungyeul
Publicado: (2025)

Can Language Models Handle a Non-Gregorian Calendar? The Case of the Japanese wareki
por: Sasaki, Mutsumi, et al.
Publicado: (2025)

Beyond Benchmarking: A New Paradigm for Evaluation and Assessment of Large Language Models
por: Liu, Jin, et al.
Publicado: (2024)

BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP
por: Kabir, Mohsinul, et al.
Publicado: (2023)

SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Papers
por: Kawada, Takuro, et al.
Publicado: (2025)

DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages
por: Faisal, Fahim, et al.
Publicado: (2024)

Interpreting Multi-Attribute Confounding through Numerical Attributes in Large Language Models
por: Takagi, Hirohane, et al.
Publicado: (2025)

JBBQ: Japanese Bias Benchmark for Analyzing Social Biases in Large Language Models
por: Yanaka, Hitomi, et al.
Publicado: (2024)

EvalxNLP: A Framework for Benchmarking Post-Hoc Explainability Methods on NLP Models
por: Dhaini, Mahdi, et al.
Publicado: (2025)

A Survey on Out-of-Distribution Evaluation of Neural NLP Models
por: Li, Xinzhe, et al.
Publicado: (2023)

Langformers: Unified NLP Pipelines for Language Models
por: Lamsal, Rabindra, et al.
Publicado: (2025)

Active Learning for NLP with Large Language Models
por: Wang, Xuesong
Publicado: (2024)

ECBD: Evidence-Centered Benchmark Design for NLP
por: Liu, Yu Lu, et al.
Publicado: (2024)

Analysing the Language of Neural Audio Codecs
por: Park, Joonyong, et al.
Publicado: (2025)

JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models
por: Liu, Junyu, et al.
Publicado: (2026)