Robust Embodied Perception in Dynamic Environments via Disentangled Weight Fusion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Juncen, Zhu, Xiaoguang, Wu, Jingyi, Zhang, Jingyu, Cai, Jingnan, Niu, Zhenghao, Song, Liang
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908933296226304
author Guo, Juncen
Zhu, Xiaoguang
Wu, Jingyi
Zhang, Jingyu
Cai, Jingnan
Niu, Zhenghao
Song, Liang
author_facet Guo, Juncen
Zhu, Xiaoguang
Wu, Jingyi
Zhang, Jingyu
Cai, Jingnan
Niu, Zhenghao
Song, Liang
contents Embodied perception systems face severe challenges of dynamic environment distribution drift when they continuously interact in open physical spaces. However, the existing domain incremental awareness methods often rely on the domain id obtained in advance during the testing phase, which limits their practicability in unknown interaction scenarios. At the same time, the model often overfits to the context-specific perceptual noise, which leads to insufficient generalization ability and catastrophic forgetting. To address these limitations, we propose a domain-id and exemplar-free incremental learning framework for embodied multimedia systems, which aims to achieve robust continuous environment adaptation. This method designs a disentangled representation mechanism to remove non-essential environmental style interference, and guide the model to focus on extracting semantic intrinsic features shared across scenes, thereby eliminating perceptual uncertainty and improving generalization. We further use the weight fusion strategy to dynamically integrate the old and new environment knowledge in the parameter space, so as to ensure that the model adapts to the new distribution without storing historical data and maximally retains the discrimination ability of the old environment. Extensive experiments on multiple standard benchmark datasets show that the proposed method significantly reduces catastrophic forgetting in a completely exemplar-free and domain-id free setting, and its accuracy is better than the existing state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2604_01669
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Robust Embodied Perception in Dynamic Environments via Disentangled Weight Fusion
Guo, Juncen
Zhu, Xiaoguang
Wu, Jingyi
Zhang, Jingyu
Cai, Jingnan
Niu, Zhenghao
Song, Liang
Computer Vision and Pattern Recognition
Artificial Intelligence
Embodied perception systems face severe challenges of dynamic environment distribution drift when they continuously interact in open physical spaces. However, the existing domain incremental awareness methods often rely on the domain id obtained in advance during the testing phase, which limits their practicability in unknown interaction scenarios. At the same time, the model often overfits to the context-specific perceptual noise, which leads to insufficient generalization ability and catastrophic forgetting. To address these limitations, we propose a domain-id and exemplar-free incremental learning framework for embodied multimedia systems, which aims to achieve robust continuous environment adaptation. This method designs a disentangled representation mechanism to remove non-essential environmental style interference, and guide the model to focus on extracting semantic intrinsic features shared across scenes, thereby eliminating perceptual uncertainty and improving generalization. We further use the weight fusion strategy to dynamically integrate the old and new environment knowledge in the parameter space, so as to ensure that the model adapts to the new distribution without storing historical data and maximally retains the discrimination ability of the old environment. Extensive experiments on multiple standard benchmark datasets show that the proposed method significantly reduces catastrophic forgetting in a completely exemplar-free and domain-id free setting, and its accuracy is better than the existing state-of-the-art methods.
title Robust Embodied Perception in Dynamic Environments via Disentangled Weight Fusion
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2604.01669