Cover Image

LongFuncEval: Measuring the effectiveness of long context models for function calling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kate, Kiran, Pedapati, Tejaswini, Basu, Kinjal, Rizk, Yara, Chenthamarakshan, Vijil, Chaudhury, Subhajit, Agarwal, Mayank, Abdelaziz, Ibrahim
Format:	Preprint
Published:	2025
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ToolRM: Outcome Reward Models for Tool-Calling Large Language Models
by: Agarwal, Mayank, et al.
Published: (2025)

NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls
by: Basu, Kinjal, et al.
Published: (2024)

TabSketchFM: Sketch-based Tabular Representation Learning for Data Discovery over Data Lakes
by: Khatiwada, Aamod, et al.
Published: (2024)

Sparse Gradient Compression for Fine-Tuning Large Language Models
by: Yang, David H., et al.
Published: (2025)

How Good Are LLMs at Processing Tool Outputs?
by: Kate, Kiran, et al.
Published: (2025)

EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning
by: Basu, Kinjal, et al.
Published: (2024)

Towards LLMs Robustness to Changes in Prompt Format Styles
by: Ngweta, Lilian, et al.
Published: (2025)

API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs
by: Basu, Kinjal, et al.
Published: (2024)

ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval
by: Yang, David H., et al.
Published: (2026)

EpMAN: Episodic Memory AttentioN for Generalizing to Longer Contexts
by: Chaudhury, Subhajit, et al.
Published: (2025)

When Agents go Astray: Course-Correcting SWE Agents with PRMs
by: Gandhi, Shubham, et al.
Published: (2025)

Large Language Models can be Strong Self-Detoxifiers
by: Ko, Ching-Yun, et al.
Published: (2024)

R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memory
by: Huang, Tenghao, et al.
Published: (2025)

From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers
by: Runwal, Bharat, et al.
Published: (2024)

Larimar: Large Language Models with Episodic Memory Control
by: Das, Payel, et al.
Published: (2024)

Repairing Tool Calls Using Post-tool Execution Reflection and RAG
by: Tsay, Jason, et al.
Published: (2025)

Structure-Informed Protein Language Model
by: Zhang, Zuobai, et al.
Published: (2024)

ProtIR: Iterative Refinement between Retrievers and Predictors for Protein Function Annotation
by: Zhang, Zuobai, et al.
Published: (2024)

Modular Prompt Learning Improves Vision-Language Models
by: Huang, Zhenhan, et al.
Published: (2025)

Differentiable Prompt Learning for Vision Language Models
by: Huang, Zhenhan, et al.
Published: (2024)

Intermediate Representations are Strong AI-Generated Image Detectors
by: Huang, Zhenhan, et al.
Published: (2026)

FuncEvalGMN: Evaluating Functional Correctness of SQL via Graph Matching Network
by: Zhan, Yi, et al.
Published: (2024)

MrBlankness/HyFunc: HyFunc -- KDD'26
by: Weibin Liao
Published: (2026)

EvalAssist: A Human-Centered Tool for LLM-as-a-Judge
by: Ashktorab, Zahra, et al.
Published: (2025)

Live API-Bench: 2500+ Live APIs for Testing Multi-Step Tool Calling
by: Elder, Benjamin, et al.
Published: (2025)

Large Language Model Confidence Estimation via Black-Box Access
by: Pedapati, Tejaswini, et al.
Published: (2024)

Generation Constraint Scaling Can Mitigate Hallucination
by: Kollias, Georgios, et al.
Published: (2024)

GP-MoLFormer: A Foundation Model For Molecular Generation
by: Ross, Jerret, et al.
Published: (2024)

GP-MoLFormer-Sim: Test Time Molecular Optimization through Contextual Similarity Guidance
by: Navratil, Jiri, et al.
Published: (2025)

Aligning Protein Conformation Ensemble Generation with Physical Feedback
by: Lu, Jiarui, et al.
Published: (2025)

Graph is all you need? Lightweight data-agnostic neural architecture search without training
by: Huang, Zhenhan, et al.
Published: (2024)

Multi-Scale Representation Learning for Protein Fitness Prediction
by: Zhang, Zuobai, et al.
Published: (2024)

Simulating Complex Multi-Turn Tool Calling Interactions in Stateless Execution Environments
by: Crouse, Maxwell, et al.
Published: (2026)

Niveles de empatía según la escala de Jefferson en estudiantes de Medicina, Enfermería y Odontología de Honduras
by: Herman Rozengway Vijil
Published: (2016)

Algunos factores claves del contexto poselectoral y del gobierno de Xiomara Castro en Honduras
by: Rolando Canizales Vijil
Published: (2022)

Pautas de exámenes inteligentes
by: Herman Rozengway Vijil
Published: (2018)

quadram-institute-bioscience/FuncDarkMatt: FuncDarkMatt v1.0.1
by: Sumeet Tiwari
Published: (2026)

Aligning Human and LLM Judgments: Insights from EvalAssist on Task-Specific Evaluations and AI-assisted Assessment Strategy Preferences
by: Ashktorab, Zahra, et al.
Published: (2024)

Formally Specifying the High-Level Behavior of LLM-Based Agents
by: Crouse, Maxwell, et al.
Published: (2023)

On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning
by: Gruppi, Mauricio, et al.
Published: (2024)