Image de couverture de livre

Exploring the Limits of Large Language Models: A Systematic Evaluation of Masked Text Processing Ability through MskQA and MskCal

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Matsuzaki, Fuka, Sato, Haru-Tada
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Ensemble Bayesian Inference: Leveraging Small Language Models to Achieve LLM-level Accuracy in Profile Matching Tasks
par: Sato, Haru-Tada, et autres
Publié: (2025)

MskAge —An Epigenetic Biomarker of Musculoskeletal Age Derived From a Genetic Algorithm Islands Model
par: Daniel C. Green, et autres
Publié: (2025)

IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce
par: Ding, Wenxuan, et autres
Publié: (2024)

Gauge Invariant and Generic Formulation of Magnetic Translations and so(3,1) Curtright-Zachos Generators
par: Sato, Haru-Tada
Publié: (2025)

Quantum Superspace and Bloch Electron Systems with Zeeman Effects: *-Bracket Formalism for Super Curtright-Zachos Algebras
par: Sato, Haru-Tada
Publié: (2024)

Curtright-Zachos Supersymmetric Deformations of the Virasoro algebra in Quantum Superspace and Bloch Electron Systems
par: Sato, Haru-Tada
Publié: (2024)

Moyal product and Generalized Hom-Lie-Virasoro symmetries in Bloch electron systems
par: Sato, Haru-Tada
Publié: (2024)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
par: Gu, Zhouhong, et autres
Publié: (2024)

SEC-QA: A Systematic Evaluation Corpus for Financial QA
par: Lai, Viet Dac, et autres
Publié: (2024)

KatotohananQA: Evaluating Truthfulness of Large Language Models in Filipino
par: Nery, Lorenzo Alfred, et autres
Publié: (2025)

LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models
par: Parmar, Mihir, et autres
Publié: (2024)

Exploring Continual Fine-Tuning for Enhancing Language Ability in Large Language Model
par: Aggarwal, Divyanshu, et autres
Publié: (2024)

Evaluating the Process Modeling Abilities of Large Language Models -- Preliminary Foundations and Results
par: Fettke, Peter, et autres
Publié: (2025)

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models
par: He, Yancheng, et autres
Publié: (2024)

Investigating Large Language Models' Linguistic Abilities for Text Preprocessing
par: Braga, Marco, et autres
Publié: (2025)

ICLEval: Evaluating In-Context Learning Ability of Large Language Models
par: Chen, Wentong, et autres
Publié: (2024)

Exploring Performance Contrasts in TableQA: Step-by-Step Reasoning Boosts Bigger Language Models, Limits Smaller Language Models
par: Yang, Haoyan, et autres
Publié: (2024)

Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?
par: Hu, Yutong, et autres
Publié: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
par: Svete, Anej, et autres
Publié: (2025)

TCMD: A Traditional Chinese Medicine QA Dataset for Evaluating Large Language Models
par: Yu, Ping, et autres
Publié: (2024)

Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data
par: Bellamy, David R., et autres
Publié: (2023)

Evaluating the Ability of Large Language Models to Reason about Cardinal Directions
par: Cohn, Anthony G, et autres
Publié: (2024)

Masking in Multi-hop QA: An Analysis of How Language Models Perform with Context Permutation
par: Huang, Wenyu, et autres
Publié: (2025)

Exploring Language Model Generalization in Low-Resource Extractive QA
par: Sengupta, Saptarshi, et autres
Publié: (2024)

RephQA: Evaluating Readability of Large Language Models in Public Health Question Answering
par: Qiu, Weikang, et autres
Publié: (2025)

BaziQA-Benchmark: Evaluating Symbolic and Temporally Compositional Reasoning in Large Language Models
par: Chen, Jiangxi, et autres
Publié: (2026)

Evaluating the Ability of Large Language Models to Reason about Cardinal Directions, Revisited
par: Cohn, Anthony G, et autres
Publié: (2025)

Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation
par: Hida, Rem, et autres
Publié: (2024)

Exploring the Limits of Model Compression in LLMs: A Knowledge Distillation Study on QA Tasks
par: Datta, Joyeeta, et autres
Publié: (2025)

Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QA
par: Baker, George Arthur, et autres
Publié: (2024)

Large Language Models for Healthcare Text Classification: A Systematic Review
par: Sakai, Hajar, et autres
Publié: (2025)

Exploring the Limitations of Large Language Models in Compositional Relation Reasoning
par: Zhao, Jinman, et autres
Publié: (2024)

ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language Models
par: Chen, Haibin, et autres
Publié: (2025)

FinanceQA: A Benchmark for Evaluating Financial Analysis Capabilities of Large Language Models
par: Mateega, Spencer, et autres
Publié: (2025)

Assessing Large Language Models for Medical QA: Zero-Shot and LLM-as-a-Judge Evaluation
par: Adib, Shefayat E Shams, et autres
Publié: (2026)

NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models
par: Han, Han, et autres
Publié: (2024)

A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Tasks
par: Jahan, Israt, et autres
Publié: (2023)

Exploring the Effects of Alignment on Numerical Bias in Large Language Models
par: Sato, Ayako, et autres
Publié: (2026)

Don't Take the Premise for Granted: Evaluating the Premise Critique Ability of Large Language Models
par: Li, Jinzhe, et autres
Publié: (2025)

Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability
par: Xu, Zhuoyan, et autres
Publié: (2024)