Cover Image

CognitiveOS: Large Multimodal Model based System to Endow Any Type of Robot with Generative AI

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lykov, Artem, Konenkov, Mikhail, Gbagbe, Koffivi Fidèle, Litvinov, Mikhail, Davletshin, Denis, Fedoseev, Aleksey, Cabrera, Miguel Altamirano, Peter, Robinroy, Tsetserukou, Dzmitry
Format:	Preprint
Published:	2024
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Robots Can Feel: LLM-based Framework for Robot Ethical Reasoning
by: Lykov, Artem, et al.
Published: (2024)

Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations
by: Gbagbe, Koffivi Fidèle, et al.
Published: (2024)

Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robots
by: Lykov, Artem, et al.
Published: (2024)

VR-GPT: Visual Language Model for Intelligent Virtual Reality Applications
by: Konenkov, Mikhail, et al.
Published: (2024)

FlockGPT: Guiding UAV Flocking with Linguistic Orchestration
by: Lykov, Artem, et al.
Published: (2024)

CognitiveDog: Large Multimodal Model Based System to Translate Vision and Language into Action of Quadruped Robot
by: Lykov, Artem, et al.
Published: (2024)

GestOS: Advanced Hand Gesture Interpretation via Large Language Models to control Any Type of Robot
by: Lykov, Artem, et al.
Published: (2025)

VLM-Auto: VLM-based Autonomous Driving Assistant with Human-like Behavior and Understanding for Complex Road Scenes
by: Guo, Ziang, et al.
Published: (2024)

SharpSLAM: 3D Object-Oriented Visual SLAM with Deblurring for Agile Drones
by: Davletshin, Denis, et al.
Published: (2024)

PhysicalAgent: Towards General Cognitive Robotics with Foundation World Models
by: Lykov, Artem, et al.
Published: (2025)

MAGNNET: Multi-Agent Graph Neural Network-based Efficient Task Allocation for Autonomous Vehicles with Deep Reinforcement Learning
by: Ratnabala, Lavanya, et al.
Published: (2025)

HIPPO-MAT: Decentralized Task Allocation Using GraphSAGE and Multi-Agent Deep Reinforcement Learning
by: Ratnabala, Lavanya, et al.
Published: (2025)

DiffusionCinema: Text-to-Aerial Cinematography
by: Serpiva, Valerii, et al.
Published: (2026)

GestLLM: Advanced Hand Gesture Interpretation via Large Language Models for Human-Robot Interaction
by: Kobzarev, Oleg, et al.
Published: (2025)

Lander.AI: Adaptive Landing Behavior Agent for Expertise in 3D Dynamic Platform Landings
by: Peter, Robinroy, et al.
Published: (2024)

TornadoDrone: Bio-inspired DRL-based Drone Landing on 6D Platform with Wind Force Disturbances
by: Peter, Robinroy, et al.
Published: (2024)

MARLander: A Local Path Planning for Drone Swarms using Multiagent Deep Reinforcement Learning
by: Aschu, Demetros, et al.
Published: (2024)

Evolution 6.0: Robot Evolution through Generative Design
by: Khan, Muhammad Haris, et al.
Published: (2025)

MorphoGear: An UAV with Multi-Limb Morphogenetic Gear for Rough-Terrain Locomotion
by: Martynov, Mikhail, et al.
Published: (2024)

HawkDrive: A Transformer-driven Visual Perception System for Autonomous Driving in Night Scene
by: Guo, Ziang, et al.
Published: (2024)

DogSurf: Quadruped Robot Capable of GRU-based Surface Recognition for Blind Person Navigation
by: Bazhenov, Artem, et al.
Published: (2024)

LLM-MARS: Large Language Model for Behavior Tree Generation and NLP-enhanced Dialogue in Multi-Agent Robot Systems
by: Lykov, Artem, et al.
Published: (2023)

H-RINS: Hierarchical Tightly-coupled Radar-Inertial Navigation via Smoothing and Mapping
by: Abdulkarim, Ali Alridha, et al.
Published: (2026)

FlightDiffusion: Revolutionising Autonomous Drone Training with Diffusion Models Generating FPV Video
by: Serpiva, Valerii, et al.
Published: (2025)

SwarmVLM: VLM-Guided Impedance Control for Autonomous Navigation of Heterogeneous Robots in Dynamic Warehousing
by: Zafar, Malaika, et al.
Published: (2025)

Hybrid F' and ROS2 Architecture for Vision-Based Autonomous Flight: Design and Experimental Validation
by: Metwally, Abdelrahman, et al.
Published: (2026)

GazeRace: Revolutionizing Remote Piloting with Eye-Gaze Control
by: Tokmurziyev, Issatay, et al.
Published: (2024)

Dynamic Subgoal based Path Formation and Task Allocation: A NeuroFleets Approach to Scalable Swarm Robotics
by: Peter, Robinroy, et al.
Published: (2024)

Closed-Loop Verbal Reinforcement Learning for Task-Level Robotic Planning
by: Plotnikov, Dmitrii, et al.
Published: (2026)

FADet: A Multi-sensor 3D Object Detection Network based on Local Featured Attention
by: Guo, Ziang, et al.
Published: (2024)

MissionGPT: Mission Planner for Mobile Robot based on Robotics Transformer Model
by: Berman, Vladimir, et al.
Published: (2024)

SafeHumanoid: VLM-RAG-driven Control of Upper Body Impedance for Humanoid Robot
by: Mahmoud, Yara, et al.
Published: (2025)

TiltXter: CNN-based Electro-tactile Rendering of Tilt Angle for Telemanipulation of Pasteur Pipettes
by: Cabrera, Miguel Altamirano, et al.
Published: (2024)

DeepXPalm: Tilt and Position Rendering using Palm-worn Haptic Display and CNN-based Tactile Pattern Recognition
by: Miguel, Altamirano Cabrera, et al.
Published: (2022)

UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generation
by: Sautenkov, Oleg, et al.
Published: (2025)

DreamToNav: Generalizable Navigation for Robots via Generative Video Planning
by: Serpiva, Valerii, et al.
Published: (2026)

FlyNeRF: NeRF-Based Aerial Mapping for High-Quality 3D Scene Reconstruction
by: Dronova, Maria, et al.
Published: (2024)

CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVs
by: Lykov, Artem, et al.
Published: (2025)

HyperSurf: Quadruped Robot Leg Capable of Surface Recognition with GRU and Real-to-Sim Transferring
by: Satsevich, Sergei, et al.
Published: (2024)

UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescue
by: Yaqoot, Yasheerah, et al.
Published: (2025)