Image de couverture de livre

vla-eval: A Unified Evaluation Harness for Vision-Language-Action Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Choi, Suhwan, Lee, Yunsung, Park, Yubeen, Kim, Chris Dongjoo, Krishna, Ranjay, Fox, Dieter, Yu, Youngjae
Format:	Preprint
Publié:	2026
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

D2E: Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI
par: Choi, Suhwan, et autres
Publié: (2025)

Revisiting Residual Connections: Orthogonal Updates for Stable and Efficient Deep Networks
par: Oh, Giyeong, et autres
Publié: (2025)

RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics
par: Yuan, Wentao, et autres
Publié: (2024)

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation
par: Pumacay, Wilbert, et autres
Publié: (2024)

FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models
par: Lin, Zijun, et autres
Publié: (2025)

CostNav: A Navigation Benchmark for Real-World Economic-Cost Evaluation of Physical AI Agents
par: Seong, Haebin, et autres
Publié: (2025)

Stage-Adaptive Reliability Modeling for Continuous Valence-Arousal Estimation
par: Lee, Yubeen, et autres
Publié: (2026)

Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative Reasoning
par: Tur, Yalcin, et autres
Publié: (2026)

Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding
par: Clark, Christopher, et autres
Publié: (2026)

EmoVLM-KD: Fusing Distilled Expertise with Vision-Language Models for Visual Emotion Analysis
par: Lee, SangEun, et autres
Publié: (2025)

Hierarchical Vision Language Action Model Using Success and Failure Demonstrations
par: Park, Jeongeun, et autres
Publié: (2025)

CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot Interaction
par: Choi, Suhwan, et autres
Publié: (2024)

RoboAlign: Learning Test-Time Reasoning for Language-Action Alignment in Vision-Language-Action Models
par: Kim, Dongyoung, et autres
Publié: (2026)

Towards Acyclic Preference Evaluation of Language Models via Multiple Evaluators
par: Hu, Zhengyu, et autres
Publié: (2024)

HIPPO-Video: Simulating Watch Histories with Large Language Models for Personalized Video Highlighting
par: Lee, Jeongeun, et autres
Publié: (2025)

OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Model
par: Singh, Ishika, et autres
Publié: (2025)

Evalverse: Unified and Accessible Library for Large Language Model Evaluation
par: Kim, Jihoo, et autres
Publié: (2024)

Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact
par: Hardy, Michael, et autres
Publié: (2026)

Explainable Adversarial-Robust Vision-Language-Action Model for Robotic Manipulation
par: Kim, Ju-Young, et autres
Publié: (2025)

Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
par: Duan, Jiafei, et autres
Publié: (2024)

PPMI: Privacy-Preserving LLM Interaction with Socratic Chain-of-Thought Reasoning and Homomorphically Encrypted Vector Databases
par: Bae, Yubeen, et autres
Publié: (2025)

SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Models
par: Choi, Hyeonbeom, et autres
Publié: (2026)

ROSA: Harnessing Robot States for Vision-Language and Action Alignment
par: Wen, Yuqing, et autres
Publié: (2025)

LACY: A Vision-Language Model-based Language-Action Cycle for Self-Improving Robotic Manipulation
par: Hong, Youngjin, et autres
Publié: (2025)

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions
par: Choi, Suhwan, et autres
Publié: (2025)

SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models
par: Hyun, Lee, et autres
Publié: (2023)

VFIG: Vectorizing Complex Figures in SVG with Vision-Language Models
par: He, Qijia, et autres
Publié: (2026)

Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps
par: Chuang, Yung-Sung, et autres
Publié: (2024)

Addressing Negative Transfer in Diffusion Models
par: Go, Hyojun, et autres
Publié: (2023)

Transferable Model-agnostic Vision-Language Model Adaptation for Efficient Weak-to-Strong Generalization
par: Park, Jihwan, et autres
Publié: (2025)

V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models
par: Kim, Jisoo, et autres
Publié: (2025)

HELM: Harness-Enhanced Long-horizon Memory for Vision-Language-Action Manipulation
par: Zeng, Zijian, et autres
Publié: (2026)

Redefining Evaluation Standards: A Unified Framework for Evaluating the Korean Capabilities of Language Models
par: Lee, Hanwool, et autres
Publié: (2025)

CLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic Agents
par: Park, Jeongeun, et autres
Publié: (2023)

VisEscape: A Benchmark for Evaluating Exploration-driven Decision-making in Virtual Escape Rooms
par: Lim, Seungwon, et autres
Publié: (2025)

Continual Speaker Identity Unlearning with Minimal Interference
par: Kim, Jinju, et autres
Publié: (2026)

Zero-shot Multimodal Document Retrieval via Cross-modal Question Generation
par: Choi, Yejin, et autres
Publié: (2025)

3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
par: Lee, Seonho, et autres
Publié: (2025)

Sample Selection via Contrastive Fragmentation for Noisy Label Regression
par: Kim, Chris Dongjoo, et autres
Publié: (2025)

SPARO: Selective Attention for Robust and Compositional Transformer Encodings for Vision
par: Vani, Ankit, et autres
Publié: (2024)