Cover Image

LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Feng, Yukang, Sun, Jianwen, Yang, Zelai, Ai, Jiaxin, Li, Chuanhao, Li, Zizhen, Zhang, Fanrui, He, Kang, Ma, Rui, Lin, Jifan, Sun, Jie, Xiao, Yang, Zhou, Sizhuo, Wu, Wenxiao, Liu, Yiming, Liu, Pengfei, Qiao, Yu, Zhang, Shenglin, Zhang, Kaipeng
Format:	Preprint
Published:	2026
Subjects:	Software Engineering Multiagent Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ARMOR: Empowering Multimodal Understanding Model with Interleaved Multimodal Generation Capability
by: Sun, Jianwen, et al.
Published: (2025)

A High-Quality Dataset and Reliable Evaluation for Interleaved Image-Text Generation
by: Feng, Yukang, et al.
Published: (2025)

Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detection
by: Zhang, Fanrui, et al.
Published: (2025)

Closing the Expression Gap in LLM Instructions via Socratic Questioning
by: Sun, Jianwen, et al.
Published: (2025)

From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustration
by: Sun, Jianwen, et al.
Published: (2025)

World Craft: Agentic Framework to Create Visualizable Worlds via Text
by: Sun, Jianwen, et al.
Published: (2026)

ProSoftArena: Benchmarking Hierarchical Capabilities of Multimodal Agents in Professional Software Environments
by: Ai, Jiaxin, et al.
Published: (2025)

MeepleLM: A Virtual Playtester Simulating Diverse Subjective Experiences
by: Li, Zizhen, et al.
Published: (2026)

AutoBG: A Board Game Design Assistant with Interactive Ideation, Iterative Rulebook Generation, and Individualized Feedback
by: Li, Zizhen, et al.
Published: (2026)

InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles
by: Li, Zizhen, et al.
Published: (2025)

SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Model
by: Chang, Yifan, et al.
Published: (2025)

ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for MLLM-based Process Judges
by: Ai, Jiaxin, et al.
Published: (2025)

IA-T2I: Internet-Augmented Text-to-Image Generation
by: Li, Chuanhao, et al.
Published: (2025)

MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
by: Zhou, Pengfei, et al.
Published: (2025)

MDK12-Bench: A Comprehensive Evaluation of Multimodal Large Language Models on Multidisciplinary Exams
by: Zhou, Pengfei, et al.
Published: (2025)

LaGen: Towards Autoregressive LiDAR Scene Generation
by: Zhou, Sizhuo, et al.
Published: (2025)

Sekai: A Video Dataset towards World Exploration
by: Li, Zhen, et al.
Published: (2025)

PackForcing: Short Video Training Suffices for Long Video Sampling and Long Context Inference
by: Mao, Xiaofeng, et al.
Published: (2026)

Towards Long-horizon Agentic Multimodal Search
by: Du, Yifan, et al.
Published: (2026)

CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversion
by: Lin, Yusong, et al.
Published: (2026)

ConvBench: A Multi-Turn Conversation Evaluation Benchmark with Hierarchical Capability for Large Vision-Language Models
by: Liu, Shuo, et al.
Published: (2024)

LMEB: Long-horizon Memory Embedding Benchmark
by: Zhao, Xinping, et al.
Published: (2026)

Pruning Long Chain-of-Thought of Large Reasoning Models via Small-Scale Preference Optimization
by: Hong, Bin, et al.
Published: (2025)

KLong: Training LLM Agent for Extremely Long-horizon Tasks
by: Liu, Yue, et al.
Published: (2026)

Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understanding
by: Liu, Keliang, et al.
Published: (2025)

TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
by: Li, Ming, et al.
Published: (2025)

LongBench: Evaluating Robotic Manipulation Policies on Real-World Long-Horizon Tasks
by: Chen, Xueyao, et al.
Published: (2026)

CookBench: A Long-Horizon Embodied Planning Benchmark for Complex Cooking Scenarios
by: Cai, Muzhen, et al.
Published: (2025)

RoadmapBench: Evaluating Long-Horizon Agentic Software Development Across Version Upgrades
by: Xu, Xinbo, et al.
Published: (2026)

Implicit Graph, Explicit Retrieval: Towards Efficient and Interpretable Long-horizon Memory for Large Language Models
by: Zhang, Xin, et al.
Published: (2026)

SVBench: Evaluation of Video Generation Models on Social Reasoning
by: Peng, Wenshuo, et al.
Published: (2025)

VL-LN Bench: Towards Long-horizon Goal-oriented Navigation with Active Dialogs
by: Huang, Wensi, et al.
Published: (2025)

LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models
by: Tu, Shangqing, et al.
Published: (2025)

Diffusion Trajectory-guided Policy for Long-horizon Robot Manipulation
by: Fan, Shichao, et al.
Published: (2025)

VibeSearchBench: Benchmarking Long-horizon Proactive Search in the Wild
by: Inc, Xiaohongshu
Published: (2026)

Render CLI チュートリアル
by: Kawai, Katsuhiko
Published: (2026)

LongInsightBench: A Comprehensive Benchmark for Evaluating Omni-Modal Models on Human-Centric Long-Video Understanding
by: Han, ZhaoYang, et al.
Published: (2025)

LIVE: Long-horizon Interactive Video World Modeling
by: Huang, Junchao, et al.
Published: (2026)

Long‐term straw mulching alleviates microbial nutrient limitations and increases carbon‐use efficiency within aggregates
by: Yan Li, et al.
Published: (2024)

Local Policies Enable Zero-shot Long-horizon Manipulation
by: Dalal, Murtaza, et al.
Published: (2024)