Gaze2Act: Gaze-Conditioned Vision-Language-Action Policies for Interactive Robot Manipulation
Fuente:
arXiv
Saved in:
| Main Authors: | Zuo, Kuangji, Li, Gen, Lyu, Bofan, Lu, Yanshuo, Ma, Boyu, Han, Shijia, Zhou, Xinyu, Yuan, Xichen, Zhou, Chuhao, Bai, Jiaqi, Li, Geng, Yang, Jianfei |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids
by: Yuan, Xichen, et al.
Published: (2026)
by: Yuan, Xichen, et al.
Published: (2026)
Feedback World Model Enables Precise Guidance of Diffusion Policy
by: An, Tuo, et al.
Published: (2026)
by: An, Tuo, et al.
Published: (2026)
OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning
by: Li, Geng, et al.
Published: (2026)
by: Li, Geng, et al.
Published: (2026)
Trace-Focused Diffusion Policy for Multi-Modal Action Disambiguation in Long-Horizon Robotic Manipulation
by: Hu, Yuxuan, et al.
Published: (2026)
by: Hu, Yuxuan, et al.
Published: (2026)
FLASH: Efficient Visuomotor Policy via Sparse Sampling
by: Bai, Jiaqi, et al.
Published: (2026)
by: Bai, Jiaqi, et al.
Published: (2026)
Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
by: Pani, Anupam, et al.
Published: (2026)
by: Pani, Anupam, et al.
Published: (2026)
CompassAD: Intent-Driven 3D Affordance Grounding in Functionally Competing Objects
by: Li, Jingliang, et al.
Published: (2026)
by: Li, Jingliang, et al.
Published: (2026)
WaveMan: mmWave-Based Room-Scale Human Interaction Perception for Humanoid Robots
by: Hu, Yuxuan, et al.
Published: (2026)
by: Hu, Yuxuan, et al.
Published: (2026)
RM-RL: Role-Model Reinforcement Learning for Precise Robot Manipulation
by: Chen, Xiangyu, et al.
Published: (2025)
by: Chen, Xiangyu, et al.
Published: (2025)
MARS Policy: Multimodality Only When It Matters
by: Jia, Jindou, et al.
Published: (2026)
by: Jia, Jindou, et al.
Published: (2026)
$\mathbf{M^3A}$ Policy: Mutable Material Manipulation Augmentation Policy through Photometric Re-rendering
by: Li, Jiayi, et al.
Published: (2025)
by: Li, Jiayi, et al.
Published: (2025)
Real-Time Human Activity Recognition on Edge Microcontrollers: Dynamic Hierarchical Inference with Multi-Spectral Sensor Fusion
by: Li, Boyu, et al.
Published: (2026)
by: Li, Boyu, et al.
Published: (2026)
GazeVLA: Learning Human Intention for Robotic Manipulation
by: Li, Chengyang, et al.
Published: (2026)
by: Li, Chengyang, et al.
Published: (2026)
HoloLLM: Multisensory Foundation Model for Language-Grounded Human Sensing and Reasoning
by: Zhou, Chuhao, et al.
Published: (2025)
by: Zhou, Chuhao, et al.
Published: (2025)
Humanizing Robot Gaze Shifts: A Framework for Natural Gaze Shifts in Humanoid Robots
by: Wei, Jingchao, et al.
Published: (2026)
by: Wei, Jingchao, et al.
Published: (2026)
Look, Focus, Act: Efficient and Robust Robot Learning via Human Gaze and Foveated Vision Transformers
by: Chuang, Ian, et al.
Published: (2025)
by: Chuang, Ian, et al.
Published: (2025)
GazeTarget360: Towards Gaze Target Estimation in 360-Degree for Robot Perception
by: Dai, Zhuangzhuang, et al.
Published: (2025)
by: Dai, Zhuangzhuang, et al.
Published: (2025)
Enhancing Gaze Reasoning in Vision Foundation Models for Gaze Following
by: Wang, Shijing, et al.
Published: (2026)
by: Wang, Shijing, et al.
Published: (2026)
Gaze-Guided Task Decomposition for Imitation Learning in Robotic Manipulation
by: Takizawa, Ryo, et al.
Published: (2025)
by: Takizawa, Ryo, et al.
Published: (2025)
Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation
by: Wang, Guokang, et al.
Published: (2024)
by: Wang, Guokang, et al.
Published: (2024)
VL4Gaze: Unleashing Vision-Language Models for Gaze Following
by: Wang, Shijing, et al.
Published: (2025)
by: Wang, Shijing, et al.
Published: (2025)
GazeQwen: Lightweight Gaze-Conditioned LLM Modulation for Streaming Video Understanding
by: Pham, Trong Thang, et al.
Published: (2026)
by: Pham, Trong Thang, et al.
Published: (2026)
RaycastGrasp: Eye-Gaze Interaction with Wearable Devices for Robotic Manipulation
by: Lin, Zitiantao, et al.
Published: (2025)
by: Lin, Zitiantao, et al.
Published: (2025)
Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention
by: Ozdel, Suleyman, et al.
Published: (2024)
by: Ozdel, Suleyman, et al.
Published: (2024)
GazeGrasp: DNN-Driven Robotic Grasping with Wearable Eye-Gaze Interface
by: Tokmurziyev, Issatay, et al.
Published: (2025)
by: Tokmurziyev, Issatay, et al.
Published: (2025)
Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)
by: Tabatabaei, Ramtin, et al.
Published: (2025)
GazeVLM: A Vision-Language Model for Multi-Task Gaze Understanding
by: Mathew, Athul M., et al.
Published: (2025)
by: Mathew, Athul M., et al.
Published: (2025)
REI-Bench: Can Embodied Agents Understand Vague Human Instructions in Task Planning?
by: Jiang, Chenxi, et al.
Published: (2025)
by: Jiang, Chenxi, et al.
Published: (2025)
GazeDETR: Gaze Detection using Disentangled Head and Gaze Representations
by: de Belen, Ryan Anthony Jalova, et al.
Published: (2025)
by: de Belen, Ryan Anthony Jalova, et al.
Published: (2025)
CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
by: Shi, Yingtian, et al.
Published: (2024)
by: Shi, Yingtian, et al.
Published: (2024)
Intent at a Glance: Gaze-Guided Robotic Manipulation via Foundation Models
by: Tay, Tracey Yee Hsin, et al.
Published: (2026)
by: Tay, Tracey Yee Hsin, et al.
Published: (2026)
GazePrompt: Enhancing Low Vision People's Reading Experience with Gaze-Aware Augmentations
by: Wang, Ru, et al.
Published: (2024)
by: Wang, Ru, et al.
Published: (2024)
Eyes on VLM: Benchmarking Gaze Following and Social Gaze Prediction in Vision Language Models
by: Wang, Hengfei, et al.
Published: (2026)
by: Wang, Hengfei, et al.
Published: (2026)
GazeMoE: Perception of Gaze Target with Mixture-of-Experts
by: Dai, Zhuangzhuang, et al.
Published: (2026)
by: Dai, Zhuangzhuang, et al.
Published: (2026)
Time-Unified Diffusion Policy with Action Discrimination for Robotic Manipulation
by: Niu, Ye, et al.
Published: (2025)
by: Niu, Ye, et al.
Published: (2025)
Gaze to Insight: A Scalable AI Approach for Detecting Gaze Behaviours in Face-to-Face Collaborative Learning
by: Liang, Junyuan, et al.
Published: (2026)
by: Liang, Junyuan, et al.
Published: (2026)
Enhancing Reusability of Learned Skills for Robot Manipulation via Gaze Information and Motion Bottlenecks
by: Takizawa, Ryo, et al.
Published: (2025)
by: Takizawa, Ryo, et al.
Published: (2025)
SGAP-Gaze: Scene Grid Attention Based Point-of-Gaze Estimation Network for Driver Gaze
by: Sharma, Pavan Kumar, et al.
Published: (2026)
by: Sharma, Pavan Kumar, et al.
Published: (2026)
The People's Gaze: Co-Designing and Refining Gaze Gestures with General Users and Gaze Interaction Experts
by: Lei, Yaxiong, et al.
Published: (2026)
by: Lei, Yaxiong, et al.
Published: (2026)
GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splatting
by: Wei, Xiaobao, et al.
Published: (2024)
by: Wei, Xiaobao, et al.
Published: (2024)
Similar Items
-
RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids
by: Yuan, Xichen, et al.
Published: (2026) -
Feedback World Model Enables Precise Guidance of Diffusion Policy
by: An, Tuo, et al.
Published: (2026) -
OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning
by: Li, Geng, et al.
Published: (2026) -
Trace-Focused Diffusion Policy for Multi-Modal Action Disambiguation in Long-Horizon Robotic Manipulation
by: Hu, Yuxuan, et al.
Published: (2026) -
FLASH: Efficient Visuomotor Policy via Sparse Sampling
by: Bai, Jiaqi, et al.
Published: (2026)