Imagen de Portada

EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zeng, Zhiyuan, Wang, Yizhong, Hajishirzi, Hannaneh, Koh, Pang Wei
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
por: Morrison, Jacob, et al.
Publicado: (2024)

APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
por: Zhao, Bowen, et al.
Publicado: (2024)

Reliable, Adaptable, and Attributable Language Models with Retrieval
por: Asai, Akari, et al.
Publicado: (2024)

CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
por: Chen, Tong, et al.
Publicado: (2024)

ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data
por: Chen, Tong, et al.
Publicado: (2025)

Fluid Language Model Benchmarking
por: Hofmann, Valentin, et al.
Publicado: (2025)

Learning to Detect Language Model Training Data via Active Reconstruction
por: Yin, Junjie Oscar, et al.
Publicado: (2026)

Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning
por: Kim, Joongwon, et al.
Publicado: (2024)

HREF: Human Response-Guided Evaluation of Instruction Following in Language Models
por: Lyu, Xinxi, et al.
Publicado: (2024)

BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models
por: Cao, Qingqing, et al.
Publicado: (2023)

RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments
por: Zeng, Zhiyuan, et al.
Publicado: (2025)

Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
por: Chen, Tong, et al.
Publicado: (2025)

Set the Clock: Temporal Alignment of Pretrained Language Models
por: Zhao, Bowen, et al.
Publicado: (2024)

Don't throw away your value model! Generating more preferable text with Value-Guided Monte-Carlo Tree Search decoding
por: Liu, Jiacheng, et al.
Publicado: (2023)

Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation
por: Heineman, David, et al.
Publicado: (2025)

SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
por: Min, Sewon, et al.
Publicado: (2023)

RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?
por: Sun, Yiyou, et al.
Publicado: (2025)

Fine-grained Hallucination Detection and Editing for Language Models
por: Mishra, Abhika, et al.
Publicado: (2024)

Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning
por: Jin, Jikai, et al.
Publicado: (2025)

TurnWise: The Gap between Single- and Multi-turn Language Model Capabilities
por: Graf, Victoria, et al.
Publicado: (2026)

Tree Search for Language Model Agents
por: Koh, Jing Yu, et al.
Publicado: (2024)

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
por: Li, Jianling, et al.
Publicado: (2025)

Meta-Reinforcement Learning with Self-Reflection for Agentic Search
por: Xiao, Teng, et al.
Publicado: (2026)

ScienceMeter: Tracking Scientific Knowledge Updates in Language Models
por: Wang, Yike, et al.
Publicado: (2025)

SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
por: Zhang, Taolin, et al.
Publicado: (2026)

OLMoE: Open Mixture-of-Experts Language Models
por: Muennighoff, Niklas, et al.
Publicado: (2024)

LIBRA: Measuring Bias of Large Language Model from a Local Context
por: Pang, Bo, et al.
Publicado: (2025)

Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
por: Hu, Zhiyuan, et al.
Publicado: (2024)

ALaRM: Align Language Models via Hierarchical Rewards Modeling
por: Lai, Yuhang, et al.
Publicado: (2024)

Next Semantic Scale Prediction via Hierarchical Diffusion Language Models
por: Zhou, Cai, et al.
Publicado: (2025)

Olmix: A Framework for Data Mixing Throughout LM Development
por: Chen, Mayee F., et al.
Publicado: (2026)

Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
por: Xia, Mengzhou, et al.
Publicado: (2023)

Instructional Fingerprinting of Large Language Models
por: Xu, Jiashu, et al.
Publicado: (2024)

SemEval-2025 Task 4: Unlearning sensitive content from Large Language Models
por: Ramakrishna, Anil, et al.
Publicado: (2025)

Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?
por: Zeng, Zhiyuan, et al.
Publicado: (2025)

Beyond Language: Format-Agnostic Reasoning Subspaces in Large Language Models
por: Yuan, Aojie, et al.
Publicado: (2026)

Evaluating Large Language Models at Evaluating Instruction Following
por: Zeng, Zhiyuan, et al.
Publicado: (2023)

Investigating Symbolic Capabilities of Large Language Models
por: Dave, Neisarg, et al.
Publicado: (2024)

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
por: Lu, Pan, et al.
Publicado: (2023)

Paloma: A Benchmark for Evaluating Language Model Fit
por: Magnusson, Ian, et al.
Publicado: (2023)