Imagen de Portada

SAGE: A Realistic Benchmark for Semantic Understanding

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Goel, Samarth, Lee, Reagan J., Ramchandran, Kannan
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Quantifying Positional Biases in Text Embedding Models
por: Lee, Reagan J., et al.
Publicado: (2024)

SAGE: A Service Agent Graph-guided Evaluation Benchmark
por: Shi, Ling, et al.
Publicado: (2026)

Towards Anytime-Valid Statistical Watermarking
por: Huang, Baihe, et al.
Publicado: (2026)

An Odd Estimator for Shapley Values
por: Fumagalli, Fabian, et al.
Publicado: (2026)

Introducing Visual Scenes and Reasoning: A More Realistic Benchmark for Spoken Language Understanding
por: Wu, Di, et al.
Publicado: (2025)

A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behavior
por: Mayne, Harry, et al.
Publicado: (2026)

EmbedLLM: Learning Compact Representations of Large Language Models
por: Zhuang, Richard, et al.
Publicado: (2024)

DMCD: Semantic-Statistical Framework for Causal Discovery
por: KaPatel, Samarth, et al.
Publicado: (2026)

ProxySPEX: Inference-Efficient Interpretability via Sparse Feature Interactions in LLMs
por: Butler, Landon, et al.
Publicado: (2025)

Agency in the Age of AI
por: Swarup, Samarth
Publicado: (2025)

Sample Complexity and Representation Ability of Test-time Scaling Paradigms
por: Huang, Baihe, et al.
Publicado: (2025)

SAGE: Steerable Agentic Data Generation for Deep Search with Execution Feedback
por: Xu, Fangyuan, et al.
Publicado: (2026)

SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
por: Lee, Chanuk, et al.
Publicado: (2026)

SAGE: Exploring the Boundaries of Unsafe Concept Domain with Semantic-Augment Erasing
por: Zhu, Hongguang, et al.
Publicado: (2025)

SAGE: Strategy-Adaptive Generation Engine for Query Rewriting
por: Wang, Teng, et al.
Publicado: (2025)

FHIR-AgentBench: Benchmarking LLM Agents for Realistic Interoperable EHR Question Answering
por: Lee, Gyubok, et al.
Publicado: (2025)

SAGE: Scalable AI Governance & Evaluation
por: Le, Benjamin, et al.
Publicado: (2026)

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis
por: Li, Yu, et al.
Publicado: (2026)

T-VEC: A Telecom-Specific Vectorization Model with Enhanced Semantic Understanding via Deep Triplet Loss Fine-Tuning
por: Ethiraj, Vignesh, et al.
Publicado: (2025)

SAGE: A Generic Framework for LLM Safety Evaluation
por: Jindal, Madhur, et al.
Publicado: (2025)

SAGE-Eval: Evaluating LLMs for Systematic Generalizations of Safety Facts
por: Yueh-Han, Chen, et al.
Publicado: (2025)

From Markov to Laplace: How Mamba In-Context Learns Markov Chains
por: Bondaschi, Marco, et al.
Publicado: (2025)

AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting
por: Xu, Xing, et al.
Publicado: (2026)

GAD in the Wild: Benchmarking Graph Anomaly Detection under Realistic Deployment Challenges
por: Zhou, Jingjing, et al.
Publicado: (2026)

New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark
por: Alavoine, Nadège, et al.
Publicado: (2024)

Advances and Challenges in Semantic Textual Similarity: A Comprehensive Survey
por: Kumar, Lokendra, et al.
Publicado: (2025)

SAGE Celer 2.6 Technical Card
por: SAGEA Research Team, et al.
Publicado: (2026)

MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs
por: Sirdeshmukh, Ved, et al.
Publicado: (2025)

MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use
por: Wu, Zijian, et al.
Publicado: (2025)

SPEX: Scaling Feature Interaction Explanations for LLMs
por: Kang, Justin Singh, et al.
Publicado: (2025)

DocPuzzle: A Process-Aware Benchmark for Evaluating Realistic Long-Context Reasoning Capabilities
por: Zhuang, Tianyi, et al.
Publicado: (2025)

$\texttt{SPECS}$: Faster Test-Time Scaling through Speculative Drafts
por: Cemri, Mert, et al.
Publicado: (2025)

ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments
por: Kim, Taewoong, et al.
Publicado: (2024)

SAGE: Multi-Agent Self-Evolution for LLM Reasoning
por: Peng, Yulin, et al.
Publicado: (2026)

Interpreting Affine Recurrence Learning in GPT-style Transformers
por: Bhargav, Samarth, et al.
Publicado: (2024)

Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation
por: Garg, Spandan, et al.
Publicado: (2025)

SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memory
por: Wang, Juntong, et al.
Publicado: (2026)

SAGE: A Framework of Precise Retrieval for RAG
por: Zhang, Jintao, et al.
Publicado: (2025)

BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
por: Su, Hongjin, et al.
Publicado: (2024)

A Timeline and Analysis for Representation Plasticity in Large Language Models
por: Kannan, Akshat
Publicado: (2024)