Image de couverture de livre

Plancraft: an evaluation dataset for planning with LLM agents

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Dagan, Gautier, Keller, Frank, Lascarides, Alex
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

$How^{2}$: How to learn from procedural How-to questions
par: Dagan, Gautier, et autres
Publié: (2025)

SECURE: Semantics-aware Embodied Conversation under Unawareness for Lifelong Robot Learning
par: Rubavicius, Rimvydas, et autres
Publié: (2024)

Contrastive Learning with Narrative Twins for Modeling Story Salience
par: Sterner, Igor, et autres
Publié: (2026)

Understanding the planning of LLM agents: A survey
par: Huang, Xu, et autres
Publié: (2024)

Can LLM-Augmented autonomous agents cooperate?, An evaluation of their cooperative capabilities through Melting Pot
par: Mosquera, Manuel, et autres
Publié: (2024)

MovieSum: An Abstractive Summarization Dataset for Movie Screenplays
par: Saxena, Rohit, et autres
Publié: (2024)

Generating Visual Stories with Grounded and Coreferent Characters
par: Liu, Danyang, et autres
Publié: (2024)

End-to-End Long Document Summarization using Gradient Caching
par: Saxena, Rohit, et autres
Publié: (2025)

TripScore: Benchmarking and rewarding real-world travel planning with fine-grained evaluation
par: Qu, Yincen, et autres
Publié: (2025)

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain
par: Panagoulias, Dimitrios P., et autres
Publié: (2024)

Diverse And Private Synthetic Datasets Generation for RAG evaluation: A multi-agent framework
par: Driouich, Ilias, et autres
Publié: (2025)

CrisiText: A dataset of warning messages for LLM training in emergency communication
par: Gonella, Giacomo, et autres
Publié: (2025)

Talking with Oompa Loompas: A novel framework for evaluating linguistic acquisition of LLM agents
par: Swain, Sankalp Tattwadarshi, et autres
Publié: (2025)

Reliable and diverse evaluation of LLM medical knowledge mastery
par: Zhou, Yuxuan, et autres
Publié: (2024)

GenerationPrograms: Fine-grained Attribution with Executable Programs
par: Wan, David, et autres
Publié: (2025)

MARS: toward more efficient multi-agent collaboration for LLM reasoning
par: Wang, Xiao, et autres
Publié: (2025)

Exploring the features used for summary evaluation by Human and GPT
par: Sadeghi, Zahra, et autres
Publié: (2025)

AutoHarness: improving LLM agents by automatically synthesizing a code harness
par: Lou, Xinghua, et autres
Publié: (2026)

Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP
par: Goldman, Omer, et autres
Publié: (2024)

QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization
par: Zhang, Shiyue, et autres
Publié: (2024)

Identifying User Goals from UI Trajectories
par: Berkovitch, Omri, et autres
Publié: (2024)

PrefixNLI: Detecting Factual Inconsistencies as Soon as They Arise
par: Harary, Sapir, et autres
Publié: (2025)

Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino
par: Montalan, Jann Railey, et autres
Publié: (2024)

Faithfulness metric fusion: Improving the evaluation of LLM trustworthiness across domains
par: Malin, Ben, et autres
Publié: (2025)

Multi-Agent LLM Judge: automatic personalized LLM judge design for evaluating natural language generation applications
par: Cao, Hongliu, et autres
Publié: (2025)

Learning Visually Grounded Domain Ontologies via Embodied Conversation and Explanation
par: Park, Jonghyuk, et autres
Publié: (2024)

Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts
par: Golany, Lotem, et autres
Publié: (2024)

Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent
par: Nusrat, Humza, et autres
Publié: (2025)

Controlled LLM-based Reasoning for Clinical Trial Retrieval
par: Jullien, Mael, et autres
Publié: (2024)

PosterSum: A Multimodal Benchmark for Scientific Poster Summarization
par: Saxena, Rohit, et autres
Publié: (2025)

Automated test generation to evaluate tool-augmented LLMs as conversational AI agents
par: Arcadinho, Samuel, et autres
Publié: (2024)

How good is my story? Towards quantitative metrics for evaluating LLM-generated XAI narratives
par: Ichmoukhamedov, Timour, et autres
Publié: (2024)

Learn to Disguise: Avoid Refusal Responses in LLM's Defense via a Multi-agent Attacker-Disguiser Game
par: Xu, Qianqiao, et autres
Publié: (2024)

FinRpt: Dataset, Evaluation System and LLM-based Multi-agent Framework for Equity Research Report Generation
par: Jin, Song, et autres
Publié: (2025)

To what extent is ChatGPT useful for language teacher lesson plan creation?
par: Dornburg, Alex, et autres
Publié: (2024)

Small Models, Big Results: Achieving Superior Intent Extraction through Decomposition
par: Cohen, Danielle, et autres
Publié: (2025)

Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errors
par: Chandler, Alex, et autres
Publié: (2024)

LiTransProQA: an LLM-based Literary Translation evaluation metric with Professional Question Answering
par: Zhang, Ran, et autres
Publié: (2025)

DiagGPT: An LLM-based and Multi-agent Dialogue System with Automatic Topic Management for Flexible Task-Oriented Dialogue
par: Cao, Lang
Publié: (2023)

Designing Reliable LLM-Assisted Rubric Scoring for Constructed Responses: Evidence from Physics Exams
par: Tang, Xiuxiu, et autres
Publié: (2026)