Imagen de Portada

NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Basu, Kinjal, Abdelaziz, Ibrahim, Kate, Kiran, Agarwal, Mayank, Crouse, Maxwell, Rizk, Yara, Bradford, Kelsey, Munawar, Asim, Kumaravel, Sadhana, Goyal, Saurabh, Wang, Xin, Lastras, Luis A., Kapanipathi, Pavan
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs
por: Basu, Kinjal, et al.
Publicado: (2024)

ToolRM: Outcome Reward Models for Tool-Calling Large Language Models
por: Agarwal, Mayank, et al.
Publicado: (2025)

Simulating Complex Multi-Turn Tool Calling Interactions in Stateless Execution Environments
por: Crouse, Maxwell, et al.
Publicado: (2026)

Formally Specifying the High-Level Behavior of LLM-Based Agents
por: Crouse, Maxwell, et al.
Publicado: (2023)

Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks
por: Abdelaziz, Ibrahim, et al.
Publicado: (2024)

LongFuncEval: Measuring the effectiveness of long context models for function calling
por: Kate, Kiran, et al.
Publicado: (2025)

R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memory
por: Huang, Tenghao, et al.
Publicado: (2025)

Repairing Tool Calls Using Post-tool Execution Reflection and RAG
por: Tsay, Jason, et al.
Publicado: (2025)

Live API-Bench: 2500+ Live APIs for Testing Multi-Step Tool Calling
por: Elder, Benjamin, et al.
Publicado: (2025)

How Good Are LLMs at Processing Tool Outputs?
por: Kate, Kiran, et al.
Publicado: (2025)

Putting It All into Context: Simplifying Agents with LCLMs
por: Jiang, Mingjian, et al.
Publicado: (2025)

Towards LLMs Robustness to Changes in Prompt Format Styles
por: Ngweta, Lilian, et al.
Publicado: (2025)

When Agents go Astray: Course-Correcting SWE Agents with PRMs
por: Gandhi, Shubham, et al.
Publicado: (2025)

Improving Examples in Web API Specifications using Iterated-Calls In-Context Learning
por: Jain, Kush, et al.
Publicado: (2025)

Agent Lifecycle Toolkit (ALTK): Reusable Middleware Components for Robust AI Agents
por: Wright, Zidane, et al.
Publicado: (2026)

MiGrATe: Mixed-Policy GRPO for Adaptation at Test-Time
por: Phan, Peter, et al.
Publicado: (2025)

Tragico varamento masivo en Luisiana confirma la presencia de tortugas Kempis. / Deborah Crouse
por: Crouse, Deborah
Publicado: (1993)

On the Nature of Discrete Space-Time Part 2: Special Relativity in Discrete Space-Time
por: Crouse, David
Publicado: (2024)

Textbooks 101: Textbook Collection at the University of Minnesota
por: Crouse, Caroline
Publicado: (2007)

Granite Code Models: A Family of Open Foundation Models for Code Intelligence
por: Mishra, Mayank, et al.
Publicado: (2024)

Slope instability along the northeastern Iberian and Balearic continental margins
por: G. Lastras
Publicado: (2007)

API Pack: A Massive Multi-Programming Language Dataset for API Call Generation
por: Guo, Zhen, et al.
Publicado: (2024)

Analyzing child health and water, sanitation, hygiene facilities in Punjab, Pakistan: A multilevel and spatial approach
por: Muhammad Munawar Hussain, et al.
Publicado: (2024)

Water, Sanitation, Hygiene Facilities and Economic Well‐Being: A Multilevel and Spatial Analysis in Punjab, Pakistan
por: Muhammad Munawar Hussain, et al.
Publicado: (2024)

An analysis of project provenance through a novel method of framework analysis
por: Larson, T., et al.
Publicado: (2025)

Core Curriculum Project (September 15, 1986-September 14, 1988).
por: Crouse, Joan M.
Publicado: (1988)

ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs
por: Basu, Abhinaba, et al.
Publicado: (2026)

Budget-Sensitive Discovery Scoring: A Formally Verified Framework for Evaluating AI-Guided Scientific Selection
por: Basu, Abhinaba, et al.
Publicado: (2026)

Contextual StereoSet: Stress-Testing Bias Alignment Robustness in Large Language Models
por: Basu, Abhinaba, et al.
Publicado: (2026)

Measuring and curing reasoning rigidity: from decorative chain-of-thought to genuine faithfulness
por: Basu, Abhinaba, et al.
Publicado: (2026)

When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making
por: Basu, Abhinaba, et al.
Publicado: (2026)

Proof-Carrying Materials: Falsifiable Safety Certificates for Machine-Learned Interatomic Potentials
por: Basu, Abhinaba, et al.
Publicado: (2026)

Exploring Students' Perceptions on Need for Digital Citizenship through Life Skills Training
por: R, Anu, et al.
Publicado: (2025)

Doc To The Future: Infomorphs for Interactive, Multimodal Document Transformation and Generation
por: Kumaravel, Balasaravanan Thoravi
Publicado: (2025)

OASBuilder: Generating OpenAPI Specifications from Online API Documentation with Large Language Models
por: Lazar, Koren, et al.
Publicado: (2025)

Malware Detection based on API Calls: A Reproducibility Study
por: Merilehto, Juhani
Publicado: (2026)

Cache & Distil: Optimising API Calls to Large Language Models
por: Ramírez, Guillem, et al.
Publicado: (2023)

Demystifying Feature Engineering in Malware Analysis of API Call Sequences
por: Qu, Tianheng, et al.
Publicado: (2025)

TRASPLANTE CARDIORENAL COMBINADO EN LA ENFERMEDAD CARDÍACA Y RENAL AVANZADA
por: Margarita Peradejordi Lastras
Publicado: (2015)

Linear electro-optic reflectance modulated spectra of GaAs (001) around E1 and E1+1transitions
por: A. Lastras Martínez
Publicado: (1999)