Imagen de Portada

SEAL: Suite for Evaluating API-use of LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kim, Woojeong, Jagmohan, Ashish, Vempaty, Aditya
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning API Functionality from In-Context Demonstrations for Tool-based Agents
por: Patel, Bhrij, et al.
Publicado: (2025)

Reflection-Based Memory For Web navigation Agents
por: Azam, Ruhana, et al.
Publicado: (2025)

Multimodal Auto Validation For Self-Refinement in Web Agents
por: Azam, Ruhana, et al.
Publicado: (2024)

Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems
por: Abuelsaad, Tamer, et al.
Publicado: (2024)

MathViz-E: A Case-study in Domain-Specialized Tool-Using Agents
por: Bulusu, Arya, et al.
Publicado: (2024)

Better RAG using Relevant Information Gain
por: Pickett, Marc, et al.
Publicado: (2024)

GOPO: Policy Optimization using Ranked Rewards
por: Choi, Kyuseong, et al.
Publicado: (2026)

From Chat Logs to Collective Insights: Aggregative Question Answering
por: Zhang, Wentao, et al.
Publicado: (2025)

Automated Consistency Analysis of LLMs
por: Patwardhan, Aditya, et al.
Publicado: (2025)

API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs
por: Basu, Kinjal, et al.
Publicado: (2024)

NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls
por: Basu, Kinjal, et al.
Publicado: (2024)

Building a Domain-specific Guardrail Model in Production
por: Niknazar, Mohammad, et al.
Publicado: (2024)

SEAL: Entangled White-box Watermarks on Low-Rank Adaptation
por: Oh, Giyeong, et al.
Publicado: (2025)

DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues
por: Jang, Kyochul, et al.
Publicado: (2025)

Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization
por: Mullick, Ankan, et al.
Publicado: (2024)

Evaluating LLMs on Sequential API Call Through Automated Test Generation
por: Huang, Yuheng, et al.
Publicado: (2025)

OverFill: Two-Stage Models for Efficient Language Model Decoding
por: Kim, Woojeong, et al.
Publicado: (2025)

AutoRestTest: A Tool for Automated REST API Testing Using LLMs and MARL
por: Stennett, Tyler, et al.
Publicado: (2025)

AXCEL: Automated eXplainable Consistency Evaluation using LLMs
por: Sreekar, P Aditya, et al.
Publicado: (2024)

SEAL: Systematic Error Analysis for Value ALignment
por: Revel, Manon, et al.
Publicado: (2024)

Application of LLMs to Multi-Robot Path Planning and Task Allocation
por: Kumar, Ashish
Publicado: (2025)

SEAL: Steerable Reasoning Calibration of Large Language Models for Free
por: Chen, Runjin, et al.
Publicado: (2025)

From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluation
por: Hong, Seokhee, et al.
Publicado: (2025)

BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics
por: Fa, Dionizije, et al.
Publicado: (2026)

Med42-v2: A Suite of Clinical LLMs
por: Christophe, Clément, et al.
Publicado: (2024)

MultiTab: A Comprehensive Benchmark Suite for Multi-Dimensional Evaluation in Tabular Domains
por: Lee, Kyungeun, et al.
Publicado: (2025)

SEAL: Scaling to Emphasize Attention for Long-Context Retrieval
por: Lee, Changhun, et al.
Publicado: (2025)

SEAL: An Open, Auditable, and Fair Data Generation Framework for AI-Native 6G Networks
por: Khowaja, Sunder Ali, et al.
Publicado: (2026)

SEAL-pose: Enhancing 3D Human Pose Estimation via a Learned Loss for Structural Consistency
por: Kim, Yeonsung, et al.
Publicado: (2026)

Expanding AI Awareness Through Everyday Interactions with AI: A Reflective Journal Study
por: Hingle, Ashish, et al.
Publicado: (2024)

SEAL: SEmantic-Augmented Imitation Learning via Language Model
por: Gu, Chengyang, et al.
Publicado: (2024)

How Good LLM-Generated Password Policies Are?
por: Vaidya, Vivek, et al.
Publicado: (2025)

DeepCodeSeek: Real-Time API Retrieval for Context-Aware Code Generation
por: Esakkiraja, Esakkivel, et al.
Publicado: (2025)

OCTO+: A Suite for Automatic Open-Vocabulary Object Placement in Mixed Reality
por: Sharma, Aditya, et al.
Publicado: (2024)

BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation
por: Kim, Eunsu, et al.
Publicado: (2025)

WebSuite: Systematically Evaluating Why Web Agents Fail
por: Li, Eric, et al.
Publicado: (2024)

NetFlowGen: Leveraging Generative Pre-training for Network Traffic Dynamics
por: Zhou, Jiawei, et al.
Publicado: (2024)

Identity Lock: Locking API Fine-tuned LLMs With Identity-based Wake Words
por: Su, Hongyu, et al.
Publicado: (2025)

SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs
por: Wang, Hao, et al.
Publicado: (2025)

SEAL: Speaker Error Correction using Acoustic-conditioned Large Language Models
por: Kumar, Anurag, et al.
Publicado: (2025)