Copertina

SCICONVBENCH: Benchmarking LLMs on Multi-Turn Clarification for Task Formulation in Computational Science

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Somasekharan, Nithin, Hassan, Youssef, Lin, Shiyao, Panapitiya, Gihan, Emami, Patrick, Acharya, Anurag, Horawalavithana, Sameera, Pan, Shaowu
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence Computational Physics
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Beyond the Kolmogorov Barrier: A Learnable Weighted Hybrid Autoencoder for Model Order Reduction
di: Somasekharan, Nithin, et al.
Pubblicazione: (2024)

CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamics
di: Somasekharan, Nithin, et al.
Pubblicazione: (2025)

Evaluating Memory Condensation Strategies for Coding Agents in Data-Driven Scientific Discovery
di: Chintalapati, Renuka, et al.
Pubblicazione: (2026)

Foam-Agent 2.0: An End-to-End Composable Multi-Agent Framework for Automating CFD Simulation in OpenFOAM
di: Yue, Ling, et al.
Pubblicazione: (2025)

AutoLabs: Cognitive Multi-Agent Systems with Self-Correction for Autonomous Chemical Experimentation
di: Panapitiya, Gihan, et al.
Pubblicazione: (2025)

UniFoil: A Universal Dataset of Airfoils in Transitional and Turbulent Regimes for Subsonic and Transonic Flows
di: Kanchi, Rohit Sunil, et al.
Pubblicazione: (2025)

Evaluating the Robustness of Dense Retrievers in Interdisciplinary Domains
di: Chaturvedi, Sarthak, et al.
Pubblicazione: (2025)

AI CFD Scientist: Toward Open-Ended Computational Fluid Dynamics Discovery with Physics-Aware AI Agents
di: Somasekharan, Nithin, et al.
Pubblicazione: (2026)

WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain
di: Meyur, Rounak, et al.
Pubblicazione: (2024)

Foam-Agent: Towards Automated Intelligent CFD Workflows
di: Yue, Ling, et al.
Pubblicazione: (2025)

Reward Design for Physical Reasoning in Vision-Language Models
di: Lilienthal, Derek, et al.
Pubblicazione: (2026)

FragNet: A Graph Neural Network for Molecular Property Prediction with Four Levels of Interpretability
di: Panapitiya, Gihan, et al.
Pubblicazione: (2024)

Benchmarking LLMs for Environmental Review and Permitting
di: Meyur, Rounak, et al.
Pubblicazione: (2024)

Clarification Is Not Enough: Post-Clarification Answering Remains the Bottleneck in Multi-Turn QA
di: Su, Jinyan, et al.
Pubblicazione: (2026)

Useless but Safe? Benchmarking Utility Recovery with User Intent Clarification in Multi-Turn Conversations
di: Zheng, Mingqian, et al.
Pubblicazione: (2026)

ClarifyMT-Bench: Benchmarking and Improving Multi-Turn Clarification for Conversational Large Language Models
di: Luo, Sichun, et al.
Pubblicazione: (2025)

Surprisingly Fragile: Assessing and Addressing Prompt Instability in Multimodal Foundation Models
di: Stewart, Ian, et al.
Pubblicazione: (2024)

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions
di: Horawalavithana, Sameera, et al.
Pubblicazione: (2023)

Back to the Barn with LLAMAs: Evolving Pretrained LLM Backbones in Finetuning Vision Language Models
di: Horawalavithana, Sameera, et al.
Pubblicazione: (2026)

Multi-Turn Multi-Modal Question Clarification for Enhanced Conversational Understanding
di: Ramezan, Kimia, et al.
Pubblicazione: (2025)

Personality Matters: User Traits Predict LLM Preferences in Multi-Turn Collaborative Tasks
di: Yunusov, Sarfaroz, et al.
Pubblicazione: (2025)

Development and Formulation of Herbal Products- A Veterinary Herbal Care Perspective
di: Sameera A*
Pubblicazione: (2026)

Multi-Turn Reasoning LLMs for Task Offloading in Mobile Edge Computing
di: Yang, Ning, et al.
Pubblicazione: (2026)

A Multi-AI-agent Framework Enabling End-to-end Finite Element Analysis for Solid Mechanics Problems
di: Sarker, Titu Ranjan, et al.
Pubblicazione: (2026)

MSQA: Benchmarking LLMs on Graduate-Level Materials Science Reasoning and Knowledge
di: Cheung, Jerry Junyang, et al.
Pubblicazione: (2025)

PsychiatryBench: A Multi-Task Benchmark for LLMs in Psychiatry
di: Fouda, Aya E., et al.
Pubblicazione: (2025)

Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
di: He, Yun, et al.
Pubblicazione: (2024)

A Librarian-Teacher Collaboration: Integrating Information Literacy and Technology in the K-12 Classroom
di: Mohamad, Gihan
Pubblicazione: (2017)

Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processing
di: Raab, Reilly, et al.
Pubblicazione: (2025)

MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding
di: Munikoti, Sai, et al.
Pubblicazione: (2026)

A Cloud-based Multi-Agentic Workflow for Science
di: Acharya, Anurag, et al.
Pubblicazione: (2026)

Phytoextracted Formulations for Periodontitis: Formulation Strategies, Therapeutic Mechanisms, and Clinical Applications
di: Anuj Kumar, et al.
Pubblicazione: (2026)

Instantaneous Complex Phase and Frequency: Conceptual Clarification and Equivalence between Formulations
di: García-Veloso, César, et al.
Pubblicazione: (2025)

XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
di: Kabir, Mohsinul, et al.
Pubblicazione: (2026)

Generalist Multimodal AI: A Review of Architectures, Challenges and Opportunities
di: Munikoti, Sai, et al.
Pubblicazione: (2024)

Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
di: Cheng, Xiang, et al.
Pubblicazione: (2025)

BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting
di: Emami, Patrick, et al.
Pubblicazione: (2023)

On the lifting and reconstruction of nonlinear systems with multiple invariant sets
di: Pan, Shaowu, et al.
Pubblicazione: (2023)

Robust-Multi-Task Gradient Boosting
di: Emami, Seyedsaman, et al.
Pubblicazione: (2025)

ArgBench: Benchmarking LLMs on Computational Argumentation Tasks
di: Ajjour, Yamen, et al.
Pubblicazione: (2026)