Copertina

Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Chen, Xia, Fei, Yu, Wenhao, Zhang, Tingnan, Zhang, Ruohan, Liu, C. Karen, Fei-Fei, Li, Tan, Jie, Liang, Jacky
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Robotics Artificial Intelligence Human-Computer Interaction Machine Learning Multimedia
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Evaluating Magic Leap 2 Tool Tracking for AR Sensor Guidance in Industrial Inspections
di: Masuhr, Christian, et al.
Pubblicazione: (2025)

MotiBo: The Impact of Interactive Digital Storytelling Robots on Student Motivation through Self-Determination Theory
di: Fung, Ka Yan, et al.
Pubblicazione: (2026)

MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos
di: Ning, Zheng, et al.
Pubblicazione: (2024)

VCEMO: Multi-Modal Emotion Recognition for Chinese Voiceprints
di: Tang, Jinghua, et al.
Pubblicazione: (2024)

Explainable Multimodal Emotion Recognition
di: Lian, Zheng, et al.
Pubblicazione: (2023)

Towards Aligning Multimodal LLMs with Human Experts: A Focus on Parent-Child Interaction
di: Shi, Weiyan, et al.
Pubblicazione: (2025)

Multimodal Infusion Tuning for Large Models
di: Sun, Hao, et al.
Pubblicazione: (2024)

Language-Guided Multimodal Texture Authoring via Generative Models
di: Qian, Wanli, et al.
Pubblicazione: (2026)

SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimation
di: Yin, Wanqi, et al.
Pubblicazione: (2025)

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers
di: Ning, Zheng, et al.
Pubblicazione: (2024)

MambaGesture: Enhancing Co-Speech Gesture Generation with Mamba and Disentangled Multi-Modality Fusion
di: Fu, Chencan, et al.
Pubblicazione: (2024)

To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognition
di: Yu, Yangchen, et al.
Pubblicazione: (2026)

Anchorage: Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events
di: Wong, Kam Kwai, et al.
Pubblicazione: (2023)

Towards Interactive Multimodal Representation of ML Functions for Human Understanding of ML
di: Wang, Bokang, et al.
Pubblicazione: (2026)

Laugh at Your Own Pace: Basic Performance Evaluation of Language Learning Assistance by Adjustment of Video Playback Speeds Based on Laughter Detection
di: Nishida, Naoto, et al.
Pubblicazione: (2025)

Born to Run, Programmed to Play: Mapping the Extended Reality Exergames Landscape
di: Karaosmanoglu, Sukran, et al.
Pubblicazione: (2024)

From Multimodal Signals to Adaptive XR Experiences for De-escalation Training
di: Nierula, Birgit, et al.
Pubblicazione: (2026)

MV-Crafter: An Intelligent System for Music-guided Video Generation
di: Chen, Chuer, et al.
Pubblicazione: (2025)

Node-Based Editing for Multimodal Generation of Text, Audio, Image, and Video
di: Kyaw, Alexander Htet, et al.
Pubblicazione: (2025)

When Drawing Is Not Enough: Exploring Spontaneous Speech with Sketch for Intent Alignment in Multimodal LLMs
di: Shi, Weiyan, et al.
Pubblicazione: (2026)

MULTI-CASE: A Transformer-based Ethics-aware Multimodal Investigative Intelligence Framework
di: Fischer, Maximilian T., et al.
Pubblicazione: (2024)

Crafting Dynamic Virtual Activities with Advanced Multimodal Models
di: Li, Changyang, et al.
Pubblicazione: (2024)

CvhSlicer 2.0: Immersive and Interactive Visualization of Chinese Visible Human Data in XR Environments
di: Qiu, Yue, et al.
Pubblicazione: (2025)

Whispering Water: Materializing Human-AI Dialogue as Interactive Ripples
di: Wang, Ruipeng, et al.
Pubblicazione: (2026)

Dynamic Multimodal Expression Generation for LLM-Driven Pedagogical Agents: From User Experience Perspective
di: Wan, Ninghao, et al.
Pubblicazione: (2026)

T2VTree: User-Centered Visual Analytics for Agent-Assisted Thought-to-Video Authoring
di: Zheng, Zhuoyun, et al.
Pubblicazione: (2026)

Memento: Augmenting Personalized Memory via Practical Multimodal Wearable Sensing in Visual Search and Wayfinding Navigation
di: Ghosh, Indrajeet, et al.
Pubblicazione: (2025)

VisAug: Facilitating Speech-Rich Web Video Navigation and Engagement with Auto-Generated Visual Augmentations
di: Zhao, Baoquan, et al.
Pubblicazione: (2025)

Physical-aware Cross-modal Adversarial Network for Wearable Sensor-based Human Action Recognition
di: Ni, Jianyuan, et al.
Pubblicazione: (2023)

Multimodal Digital Sensing of Early-Life Laying Hens: A Pilot Study Integrating Thermal, Acoustic, Optical-Flow and Environmental Data
di: Dhaliwal, Yashan, et al.
Pubblicazione: (2026)

Human-Machine Collaboration-Guided Space Design: Combination of Machine Learning Models and Humanistic Design Concepts
di: Yang, Yuxuan
Pubblicazione: (2025)

Human Aesthetic Preference-Based Large Text-to-Image Model Personalization: Kandinsky Generation as an Example
di: Zhou, Aven-Le, et al.
Pubblicazione: (2024)

Feeling the Grass Grow: Making Midair Haptic Parameters Visible, Touchable and Controllable
di: Zhang, Mingxin, et al.
Pubblicazione: (2024)

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
di: Chen, Xiaolin, et al.
Pubblicazione: (2022)

Video-Mediated Emotion Disclosure: Expressions of Fear, Sadness, and Joy by People with Schizophrenia on YouTube
di: Liu, Jiaying Lizzy, et al.
Pubblicazione: (2025)

MindCine: Multimodal EEG-to-Video Reconstruction with Large-Scale Pretrained Models
di: Zhou, Tian-Yi, et al.
Pubblicazione: (2026)

On Parallelism in Music and Language: A Perspective from Symbol Emergence Systems based on Probabilistic Generative Models
di: Taniguchi, Tadahiro
Pubblicazione: (2025)

Talking-to-Build: How LLM-Assisted Interface Shapes Player Performance and Experience in Minecraft
di: Sun, Xin, et al.
Pubblicazione: (2025)

AVE Speech: A Comprehensive Multi-Modal Dataset for Speech Recognition Integrating Audio, Visual, and Electromyographic Signals
di: Zhou, Dongliang, et al.
Pubblicazione: (2025)

Photoshop Batch Rendering Using Actions for Stylistic Video Editing
di: De La Fuente, Tessa
Pubblicazione: (2025)