Cover Image

ProcBench: Benchmark for Multi-Step Reasoning and Following Procedure

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fujisawa, Ippei, Nobe, Sensho, Seto, Hiroki, Onda, Rina, Uchida, Yoshiaki, Ikoma, Hiroki, Chien, Pei-Chun, Kanai, Ryota
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TOD-ProcBench: Benchmarking Complex Instruction-Following in Task-Oriented Dialogues
by: Ghazarian, Sarik, et al.
Published: (2025)

Decoding Vision Transformers: the Diffusion Steering Lens
by: Takatsuki, Ryota, et al.
Published: (2025)

Remembering Transformer for Continual Learning
by: Sun, Yuwei, et al.
Published: (2024)

MCM: Multi-layer Concept Map for Efficient Concept Learning from Masked Images
by: Sun, Yuwei, et al.
Published: (2025)

Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Games
by: Nonomura, Ryota, et al.
Published: (2024)

LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
by: Ye, Xi, et al.
Published: (2025)

The Volterra lattice, Abel's equation of the first kind, and the SIR epidemic models
by: Nobe, Atsushi
Published: (2024)

ProcObject-10K: Benchmarking Object-Centric Procedural Understanding in Instructional Videos
by: Guo, Wenliang, et al.
Published: (2025)

Sparse Identification of Nonlinear Dynamics Enhanced by Ensemble Learning, Multi-Step Prediction Evaluation, Elite Strategy, and Classification Techniques for Applications to Industrial Systems
by: Yahagi, Shuichi, et al.
Published: (2025)

Complexity of the Existence of Constrained Secure Equilibria in Multi-Player Games
by: Mizuno, Hiroki, et al.
Published: (2025)

SimpleProc: Fully Procedural Synthetic Data from Simple Rules for Multi-View Stereo
by: Ma, Zeyu, et al.
Published: (2026)

ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation
by: Feng, Youhe, et al.
Published: (2026)

Pencil Puzzle Bench: A Benchmark for Multi-Step Verifiable Reasoning
by: Waugh, Justin
Published: (2026)

Creatinine/cystatin C ratio‐guided selection of renal function marker in sarcopenia
by: Rina Kamiya, et al.
Published: (2026)

ProcFunc: Function-Oriented Abstractions for Procedural 3D Generation in Python
by: Raistrick, Alexander, et al.
Published: (2026)

Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians
by: Li, Yixuan, et al.
Published: (2024)

Early development of the calcified exoskeleton of the polyplacophoran mollusk, with insight into the evolutionary history of shell plates and spicules
by: Hiroki Yoshikawa, et al.
Published: (2025)

Canonical Functionalism: Defining Functional Structure without Observer-Relative Semantic Maps
by: Kanai, Ryota, et al.
Published: (2026)

Stimulation technology for brain and nerves, now and future
by: Kuwabara, Masaru, et al.
Published: (2024)

ProcTex: Consistent and Interactive Text-to-texture Synthesis for Part-based Procedural Models
by: Xu, Ruiqi, et al.
Published: (2025)

Phosphomimetic mutations near active sites of proteins in Thermus thermophilus suggest a widespread regulatory mechanism
by: Anzu Nishiwaki, et al.
Published: (2025)

Data-driven modelling of low-dimensional dynamical structures underlying complex full-body human movement
by: Takamido, Ryota, et al.
Published: (2026)

PassAI: explainable artificial intelligence algorithm for soccer pass analysis using multimodal information resources
by: Takamido, Ryota, et al.
Published: (2025)

Personalized Motion Guidance Framework for Athlete-Centric Coaching
by: Takamido, Ryota, et al.
Published: (2025)

Cross-individual generalizability of machine learning models for ball speed prediction in baseball pitching
by: Takamido, Ryota, et al.
Published: (2026)

Enhancing Output Diversity Improves Conjugate Gradient-based Adversarial Attacks
by: Yamamura, Keiichiro, et al.
Published: (2024)

MedRECT: A Medical Reasoning Benchmark for Error Correction in Clinical Texts
by: Iwase, Naoto, et al.
Published: (2025)

Step‐by‐Step Self‐Assembly of a Double‐Walled Knotted Cage With Increasing Topological Complexity
by: Hiroki Takezawa, et al.
Published: (2025)

Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scale
by: Jesson, Andrew, et al.
Published: (2024)

Utility of Laparoscopic Distal Pancreatectomy Following Esophagectomy With Gastric Roll Reconstruction Through the Retrosternal Route
by: Yusuke Yamamoto, et al.
Published: (2025)

TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models
by: Zhang, Yiran, et al.
Published: (2025)

ProcGen3D: Learning Neural Procedural Graph Representations for Image-to-3D Reconstruction
by: Zhang, Xinyi, et al.
Published: (2025)

ProcCtrlBench: Evaluating Process-Level Defects and Control Preservation in LLM Coding Agents
by: He, Jiawei, et al.
Published: (2026)

DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy
by: Wang, Erchi, et al.
Published: (2026)

Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Following
by: Inoue, Yuki, et al.
Published: (2022)

IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation
by: Wen, Bosi, et al.
Published: (2026)

Stealtooth: Breaking Bluetooth Security Abusing Silent Automatic Pairing
by: Kimura, Keiichiro, et al.
Published: (2025)

Eclipta thermalis , a previously common weed, threatened by the expansion of the exotic congener E. alba in Japanese rice paddies
by: Yoshiaki Kameyama, et al.
Published: (2024)

Comparative Evaluation of Two Microfluidic Sperm Sorting Devices: Laboratory Assessment of Sperm Quality and Retrospective Analysis of Embryological Outcomes Following Intracytoplasmic Sperm Injection
by: Ryota Tachibana, et al.
Published: (2026)

Invisible Orchestrators Suppress Protective Behavior and Dissociate Power-Holders: Safety Risks in Multi-Agent LLM Systems
by: Fukui, Hiroki
Published: (2026)