LISN: Language-Instructed Social Navigation with VLM-based Controller Modulating

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Junting, Li, Yunchuan, Jiang, Panfeng, Du, Jiacheng, Chen, Zixuan, Tie, Chenrui, Deng, Jiajun, Shao, Lin
Format:	Preprint
Published:	2025
Subjects:	Robotics Artificial Intelligence Computer Vision and Pattern Recognition I.2.9
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CropNav: a Framework for Autonomous Navigation in Real Farms
by: Gasparino, Mateus Valverde, et al.
Published: (2024)

Enabling Shared-Control for A Riding Ballbot System
by: Chen, Yu, et al.
Published: (2024)

Learning When to Ask for Help: Efficient Interactive Navigation via Implicit Uncertainty Estimation
by: Igbinedion, Ifueko, et al.
Published: (2023)

GuLu XuanYuan , a biomimetic Transformer that intergrates humanoid MIP, reptile UGV, and bird UAV
by: Chen, Le, et al.
Published: (2024)

Real-Time Synchronized Interaction Framework for Emotion-Aware Humanoid Robots
by: Chen, Yanrong, et al.
Published: (2026)

CogDDN: A Cognitive Demand-Driven Navigation with Decision Optimization and Dual-Process Thinking
by: Huang, Yuehao, et al.
Published: (2025)

Bilateral Teleoperation with Compliant 6-DOF Pose-and-Force Sensing
by: Feng, Yue, et al.
Published: (2026)

Roadmaps with Gaps over Controllers: Achieving Efficiency in Planning under Dynamics
by: Sivaramakrishnan, Aravind, et al.
Published: (2023)

Learning Adaptive Force Control for Contact-Rich Sample Scraping with Heterogeneous Materials
by: Cetin, Cenk, et al.
Published: (2026)

Modeling and Control of a Novel Variable Stiffness Three DoFs Wrist
by: Milazzo, Giuseppe, et al.
Published: (2023)

Contact-based Grasp Control and Inverse Kinematics for a Five-fingered Robotic Hand
by: Umeike, Robinson
Published: (2025)

UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers
by: Ha, Huy, et al.
Published: (2024)

CogExplore: Contextual Exploration with Language-Encoded Environment Representations
by: Biggie, Harel, et al.
Published: (2024)

Best of Sim and Real: Decoupled Visuomotor Manipulation via Learning Control in Simulation and Perception in Real
by: Huang, Jialei, et al.
Published: (2025)

Language models are robotic planners: reframing plans as goal refinement graphs
by: Sharfuddin, Ateeq, et al.
Published: (2024)

TacDexGrasp: Compliant and Robust Dexterous Grasping with Tactile Feedback
by: Ke, Yubin, et al.
Published: (2026)

OWMM-Agent: Open World Mobile Manipulation With Multi-modal Agentic Data Synthesis
by: Chen, Junting, et al.
Published: (2025)

MTIL: Encoding Full History with Mamba for Temporal Imitation Learning
by: Zhou, Yulin, et al.
Published: (2025)

Low-Cost Open-Source Ambidextrous Robotic Hand with 23 Direct-Drive servos for American Sign Language Alphabet
by: Amador, Kelvin Daniel Gonzalez
Published: (2025)

Kilometer-Scale GNSS-Denied UAV Navigation via Heightmap Gradients: A Winning System from the SPRIN-D Challenge
by: Werner, Michal, et al.
Published: (2025)

ScoRe-Flow: Complete Distributional Control via Score-Based Reinforcement Learning for Flow Matching
by: Qiu, Xiaotian, et al.
Published: (2026)

Semantic Risk-Aware Heuristic Planning for Robotic Navigation in Dynamic Environments: An LLM-Inspired Approach
by: Durrani, Hamza Ahmed, et al.
Published: (2026)

A Shank Angle-Based Control System Enables Soft Exoskeleton to Assist Human Non-Steady Locomotion
by: Tan, Xiaowei, et al.
Published: (2025)

CaMeRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environments
by: Hong, Hong, et al.
Published: (2026)

Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigation
by: Yang, Jonathan, et al.
Published: (2024)

Learning from Watching: Scalable Extraction of Manipulation Trajectories from Human Videos
by: Hu, X., et al.
Published: (2025)

StratXplore: Strategic Novelty-seeking and Instruction-aligned Exploration for Vision and Language Navigation
by: Gopinathan, Muraleekrishna, et al.
Published: (2024)

GS-Playground: A High-Throughput Photorealistic Simulator for Vision-Informed Robot Learning
by: Jia, Yufei, et al.
Published: (2026)

Look Further: Socially-Compliant Navigation System in Residential Buildings
by: Shiba, Akira, et al.
Published: (2026)

HS-SLAM: A Fast and Hybrid Strategy-Based SLAM Approach for Low-Speed Autonomous Driving
by: Kang, Bingxiang, et al.
Published: (2025)

Real-Time Whole-Body Teleoperation of a Humanoid Robot Using IMU-Based Motion Capture with Sim2Sim and Sim2Real Validation
by: Durrani, Hamza Ahmed, et al.
Published: (2026)

cHyRRT and cHySST: Two Motion Planning Tools for Hybrid Dynamical Systems
by: Xu, Beverly, et al.
Published: (2024)

Taxonomy and Modular Tool System for Versatile and Effective Non-Prehensile Manipulations
by: Sommer, Cedric-Pascal, et al.
Published: (2025)

A short methodological review on social robot navigation benchmarking
by: Chhetri, Pranup, et al.
Published: (2025)

World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy
by: Liu, Xiaokang, et al.
Published: (2026)

Learning Agile Gate Traversal via Analytical Optimal Policy Gradient
by: Sun, Tianchen, et al.
Published: (2025)

Reinforcement Learning Driven Multi-Robot Exploration via Explicit Communication and Density-Based Frontier Search
by: Calzolari, Gabriele, et al.
Published: (2024)

Diffusion for Multi-Embodiment Grasping
by: Freiberg, Roman, et al.
Published: (2024)

ERPoT: Effective and Reliable Pose Tracking for Mobile Robots Using Lightweight Polygon Maps
by: Gao, Haiming, et al.
Published: (2024)

Adaptive Distance Functions via Kelvin Transformation
by: Muchacho, Rafael I. Cabral, et al.
Published: (2024)