Cover Image

LalaEval: A Holistic Human Evaluation Framework for Domain-Specific Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Chongyan, Lin, Ken, Wang, Shiwei, Wu, Hulong, Fu, Chengfei, Wang, Zhen
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Aligning Human and LLM Judgments: Insights from EvalAssist on Task-Specific Evaluations and AI-assisted Assessment Strategy Preferences
by: Ashktorab, Zahra, et al.
Published: (2024)

QueryGenie: Making LLM-Based Database Querying Transparent and Controllable
by: Chen, Longfei, et al.
Published: (2025)

Holistic Specification of the Human Digital Twin: Stakeholders, Users, Functionalities, and Applications
by: Mandischer, Nils, et al.
Published: (2025)

Human-Computer Interaction and Visualization in Natural Language Generation Models: Applications, Challenges, and Opportunities
by: Wang, Yunchao, et al.
Published: (2024)

The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers
by: Mozannar, Hussein, et al.
Published: (2024)

SycoEval-EM: Sycophancy Evaluation of Large Language Models in Simulated Clinical Encounters for Emergency Care
by: Peng, Dongshen, et al.
Published: (2026)

MI 2 MI: Training Dyad with Collaborative Brain-Computer Interface and Cooperative Motor Imagery Tasks for Better BCI Performance
by: Cheng, Shiwei, et al.
Published: (2024)

VisEval: A Benchmark for Data Visualization in the Era of Large Language Models
by: Chen, Nan, et al.
Published: (2024)

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction
by: Koike, Amy, et al.
Published: (2024)

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
by: Kim, Tae Soo, et al.
Published: (2023)

ComViewer: An Interactive Visual Tool to Help Viewers Seek Social Support in Online Mental Health Communities
by: Wu, Shiwei, et al.
Published: (2024)

Raiven: LLM-Based Visualization Authoring via Domain-Specific Language Mediation
by: Irger, Alexandra, et al.
Published: (2026)

EvalAssist: A Human-Centered Tool for LLM-as-a-Judge
by: Ashktorab, Zahra, et al.
Published: (2025)

Visualization Generation with Large Language Models: An Evaluation
by: Wang, Xinyu, et al.
Published: (2024)

Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework
by: Chakraborty, Mohna, et al.
Published: (2025)

MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models
by: Lee, Suhyun, et al.
Published: (2026)

From Human-Human Collaboration to Human-Agent Collaboration: A Vision, Design Philosophy, and an Empirical Framework for Achieving Successful Partnerships Between Humans and LLM Agents
by: Yao, Bingsheng, et al.
Published: (2026)

ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agents
by: Liu, Tianjian, et al.
Published: (2025)

MultEval: Supporting Collaborative Alignment for LLM-as-a-Judge Evaluation Criteria
by: Chiang, Charles, et al.
Published: (2026)

Towards Holistic Prompt Craft
by: Lindley, Joseph, et al.
Published: (2025)

Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition
by: Feng, Kehua, et al.
Published: (2024)

SteerEval: A Framework for Evaluating Steerability with Natural Language Profiles for Recommendation
by: Zhou, Joyce, et al.
Published: (2026)

Facilitating Holistic Evaluations with LLMs: Insights from Scenario-Based Experiments
by: Ishida, Toru, et al.
Published: (2024)

Generating Analytic Specifications for Data Visualization from Natural Language Queries using Large Language Models
by: Sah, Subham, et al.
Published: (2024)

Human and LLM-Based Voice Assistant Interaction: An Analytical Framework for User Verbal and Nonverbal Behaviors
by: Chan, Szeyi, et al.
Published: (2024)

Leveraging Large Language Models for Generating Mobile Sensing Strategies in Human Behavior Modeling
by: Gao, Nan, et al.
Published: (2023)

Evaluation of Large Language Model-Driven AutoML in Data and Model Management from Human-Centered Perspective
by: Yao, Jiapeng, et al.
Published: (2025)

FlowEval: Reference-based Evaluation of Generated User Interfaces
by: Wu, Jason, et al.
Published: (2026)

Large Language Model Agent Personality and Response Appropriateness: Evaluation by Human Linguistic Experts, LLM-as-Judge, and Natural Language Processing Model
by: Jayakumar, Eswari, et al.
Published: (2025)

TaleFrame: An Interactive Story Generation System with Fine-Grained Control and Large Language Models
by: Wang, Yunchao, et al.
Published: (2025)

EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
by: Lian, Zheng, et al.
Published: (2025)

Leveraging Large Language Models for Identifying Knowledge Components
by: Wang, Canwen, et al.
Published: (2025)

Are Humans as Brittle as Large Language Models?
by: Li, Jiahui, et al.
Published: (2025)

Understanding User Experience in Large Language Model Interactions
by: Wang, Jiayin, et al.
Published: (2024)

GlyphWeaver: Unlocking Glyph Design Creativity with Uniform Glyph DSL and AI
by: Liu, Can, et al.
Published: (2025)

MindChat: Enhancing BCI Spelling with Large Language Models in Realistic Scenarios
by: Wang, JIaheng, et al.
Published: (2025)

Exploring the Usage of Generative AI for Group Project-Based Offline Art Courses in Elementary Schools
by: Wang, Zhiqing, et al.
Published: (2025)

LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBot
by: Zhong, Shu, et al.
Published: (2024)

VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language Models
by: Wang, Zhan, et al.
Published: (2024)

Beyond Text: Probing K-12 Educators' Perspectives and Ideas for Learning Opportunities Leveraging Multimodal Large Language Models
by: Tseng, Tiffany, et al.
Published: (2025)