Saved in:
Bibliographic Details
Main Authors: Cao, Yue, He, Quansong, Wang, Kaishen, Xiong, Jianlong, Yi, Zhang, He, Tao
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.14610
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912940674777088
author Cao, Yue
He, Quansong
Wang, Kaishen
Xiong, Jianlong
Yi, Zhang
He, Tao
author_facet Cao, Yue
He, Quansong
Wang, Kaishen
Xiong, Jianlong
Yi, Zhang
He, Tao
contents U-like networks have become fundamental frameworks in medical image segmentation through skip connections that bridge high-level semantics and low-level spatial details. Despite their success, conventional skip connections exhibit two key limitations: inter-feature constraints and intra-feature constraints. The inter-feature constraint refers to the static nature of feature fusion in traditional skip connections, where information is transmitted along fixed pathways regardless of feature content. The intra-feature constraint arises from the insufficient modeling of multi-scale feature interactions, thereby hindering the effective aggregation of global contextual information. To overcome these limitations, we propose a novel Dynamic Skip Connection (DSC) block that fundamentally enhances cross-layer connectivity through adaptive mechanisms. The DSC block integrates two complementary components. (1) Test-Time Training (TTT) module. This module addresses the inter-feature constraint by enabling dynamic adaptation of hidden representations during inference, facilitating content-aware feature refinement. (2) Dynamic Multi-Scale Kernel (DMSK) module. To mitigate the intra-feature constraint, this module adaptively selects kernel sizes based on global contextual cues, enhancing the network capacity for multi-scale feature integration. The DSC block is architecture-agnostic and can be seamlessly incorporated into existing U-like network structures. Extensive experiments demonstrate the plug-and-play effectiveness of the proposed DSC block across CNN-based, Transformer-based, hybrid CNN-Transformer, and Mamba-based U-like networks.
format Preprint
id arxiv_https___arxiv_org_abs_2509_14610
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connections
Cao, Yue
He, Quansong
Wang, Kaishen
Xiong, Jianlong
Yi, Zhang
He, Tao
Computer Vision and Pattern Recognition
U-like networks have become fundamental frameworks in medical image segmentation through skip connections that bridge high-level semantics and low-level spatial details. Despite their success, conventional skip connections exhibit two key limitations: inter-feature constraints and intra-feature constraints. The inter-feature constraint refers to the static nature of feature fusion in traditional skip connections, where information is transmitted along fixed pathways regardless of feature content. The intra-feature constraint arises from the insufficient modeling of multi-scale feature interactions, thereby hindering the effective aggregation of global contextual information. To overcome these limitations, we propose a novel Dynamic Skip Connection (DSC) block that fundamentally enhances cross-layer connectivity through adaptive mechanisms. The DSC block integrates two complementary components. (1) Test-Time Training (TTT) module. This module addresses the inter-feature constraint by enabling dynamic adaptation of hidden representations during inference, facilitating content-aware feature refinement. (2) Dynamic Multi-Scale Kernel (DMSK) module. To mitigate the intra-feature constraint, this module adaptively selects kernel sizes based on global contextual cues, enhancing the network capacity for multi-scale feature integration. The DSC block is architecture-agnostic and can be seamlessly incorporated into existing U-like network structures. Extensive experiments demonstrate the plug-and-play effectiveness of the proposed DSC block across CNN-based, Transformer-based, hybrid CNN-Transformer, and Mamba-based U-like networks.
title Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connections
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.14610