Copertina

Evaluating Large Language Models for Generalization and Robustness via Data Compression

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Yucheng, Guo, Yunhao, Guerin, Frank, Lin, Chenghua
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

An Open Source Data Contamination Report for Large Language Models
di: Li, Yucheng, et al.
Pubblicazione: (2023)

LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction
di: Li, Yucheng, et al.
Pubblicazione: (2023)

Finding Challenging Metaphors that Confuse Pretrained Language Models
di: Li, Yucheng, et al.
Pubblicazione: (2024)

Clickbait Detection via Large Language Models
di: Wang, Han, et al.
Pubblicazione: (2023)

PFME: A Modular Approach for Fine-grained Hallucination Detection and Editing of Large Language Models
di: Deng, Kunquan, et al.
Pubblicazione: (2024)

Tougher Text, Smarter Models: Raising the Bar for Adversarial Defence Benchmarks
di: Wang, Yang, et al.
Pubblicazione: (2025)

Information Capacity: Evaluating the Efficiency of Large Language Models via Text Compression
di: Yuan, Cheng, et al.
Pubblicazione: (2025)

Observing Micromotives and Macrobehavior of Large Language Models
di: Cheng, Yuyang, et al.
Pubblicazione: (2024)

Evaluating the Retrieval Robustness of Large Language Models
di: Cao, Shuyang, et al.
Pubblicazione: (2025)

A Survey on Model Compression for Large Language Models
di: Zhu, Xunyu, et al.
Pubblicazione: (2023)

Identifying Multiple Personalities in Large Language Models with External Evaluation
di: Song, Xiaoyang, et al.
Pubblicazione: (2024)

KGPA: Robustness Evaluation for Large Language Models via Cross-Domain Knowledge Graphs
di: Pei, Aihua, et al.
Pubblicazione: (2024)

Robustness of Prompting: Enhancing Robustness of Large Language Models Against Prompting Attacks
di: Mu, Lin, et al.
Pubblicazione: (2025)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
di: LI, Yizhi, et al.
Pubblicazione: (2024)

An Empirical Study on Prompt Compression for Large Language Models
di: Zhang, Zheng, et al.
Pubblicazione: (2025)

Evaluating Clinical Competencies of Large Language Models with a General Practice Benchmark
di: Li, Zheqing, et al.
Pubblicazione: (2025)

LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment
di: Yang, Ge, et al.
Pubblicazione: (2024)

When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models
di: Wang, Weilan, et al.
Pubblicazione: (2025)

Prompt Compression in Diffusion Large Language Models: Evaluating LLMLingua-2 on LLaDA
di: Huang, Sterling, et al.
Pubblicazione: (2026)

Evaluating Psychological Safety of Large Language Models
di: Li, Xingxuan, et al.
Pubblicazione: (2022)

Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
di: Li, Hang, et al.
Pubblicazione: (2025)

Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models?
di: Chen, Pinzhen, et al.
Pubblicazione: (2024)

FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models
di: Jung, Dahyun, et al.
Pubblicazione: (2025)

H2HTalk: Evaluating Large Language Models as Emotional Companion
di: Wang, Boyang, et al.
Pubblicazione: (2025)

Noise-Robust Abstractive Compression in Retrieval-Augmented Language Models
di: Kim, Singon
Pubblicazione: (2025)

PROXYQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models
di: Tan, Haochen, et al.
Pubblicazione: (2024)

Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Dataset
di: Zhu, Jie, et al.
Pubblicazione: (2024)

GenRES: Rethinking Evaluation for Generative Relation Extraction in the Era of Large Language Models
di: Jiang, Pengcheng, et al.
Pubblicazione: (2024)

Evaluating Morphological Compositional Generalization in Large Language Models
di: Ismayilzada, Mete, et al.
Pubblicazione: (2024)

BanglaLorica: Design and Evaluation of a Robust Watermarking Algorithm for Large Language Models in Bangla Text Generation
di: Tariqul, Amit Bin, et al.
Pubblicazione: (2026)

Concept-Reversed Winograd Schema Challenge: Evaluating and Improving Robust Reasoning in Large Language Models via Abstraction
di: Han, Kaiqiao, et al.
Pubblicazione: (2024)

Language Models Resist Alignment: Evidence From Data Compression
di: Ji, Jiaming, et al.
Pubblicazione: (2024)

FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models
di: Li, Yiyuan, et al.
Pubblicazione: (2024)

With Ears to See and Eyes to Hear: Sound Symbolism Experiments with Multimodal Large Language Models
di: Loakman, Tyler, et al.
Pubblicazione: (2024)

MEGen: Generative Backdoor into Large Language Models via Model Editing
di: Qiu, Jiyang, et al.
Pubblicazione: (2024)

Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions
di: Zhang, Kun, et al.
Pubblicazione: (2025)

RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing
di: Hu, Yucheng, et al.
Pubblicazione: (2024)

Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models
di: Xiong, Guangzhi, et al.
Pubblicazione: (2025)

RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning
di: Ye, Junjie, et al.
Pubblicazione: (2024)

Evaluation of Large Language Models via Coupled Token Generation
di: Benz, Nina Corvelo, et al.
Pubblicazione: (2025)