Copertina

Ablate and Rescue: A Causal Analysis of Residual Stream Hyper-Connections

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Peng, William, Rai, Josheev, Tseng, Kevin, Wang, Siwei, Wu, Sean
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Residual Stream Analysis of Overfitting And Structural Disruptions
di: Liu, Quan, et al.
Pubblicazione: (2026)

Frac-Connections: Fractional Extension of Hyper-Connections
di: Zhu, Defa, et al.
Pubblicazione: (2025)

Gradient Residual Connections
di: Pan, Yangchen, et al.
Pubblicazione: (2026)

JPmHC Dynamical Isometry via Orthogonal Hyper-Connections
di: Sengupta, Biswa, et al.
Pubblicazione: (2026)

ResidualDroppath: Enhancing Feature Reuse over Residual Connections
di: Park, Sejik
Pubblicazione: (2024)

Beyond the Birkhoff Polytope: Spectral-Sphere-Constrained Hyper-Connections
di: Liu, Zhaoyi, et al.
Pubblicazione: (2026)

mHC: Manifold-Constrained Hyper-Connections
di: Xie, Zhenda, et al.
Pubblicazione: (2025)

mHC-GNN: Manifold-Constrained Hyper-Connections for Graph Neural Networks
di: Mishra, Subhankar
Pubblicazione: (2026)

Fairness-Aware Streaming Feature Selection with Causal Graphs
di: Zhang, Leizhen, et al.
Pubblicazione: (2024)

DSPR: Dual-Stream Physics-Residual Networks for Trustworthy Industrial Time Series Forecasting
di: Zhang, Yeran, et al.
Pubblicazione: (2026)

DeepBooTS: Dual-Stream Residual Boosting for Drift-Resilient Time-Series Forecasting
di: Liang, Daojun, et al.
Pubblicazione: (2025)

Dynamics of the Transformer Residual Stream: Coupling Spectral Geometry to Network Topology
di: Fernando, Jesseba, et al.
Pubblicazione: (2026)

The Residual Stream Is All You Need: On the Redundancy of the KV Cache in Transformer Inference
di: Qasim, Kaleem Ullah, et al.
Pubblicazione: (2026)

Residual Stream Duality in Modern Transformer Architectures
di: Zhang, Yifan
Pubblicazione: (2026)

Neural Causal Abstractions
di: Xia, Kevin, et al.
Pubblicazione: (2024)

HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representation
di: Hu, Zhiwei, et al.
Pubblicazione: (2024)

Temporal Fact Reasoning over Hyper-Relational Knowledge Graphs
di: Ding, Zifeng, et al.
Pubblicazione: (2023)

The Estimation of Continual Causal Effect for Dataset Shifting Streams
di: Chen, Baining, et al.
Pubblicazione: (2025)

Support Vector Boosting Machine (SVBM): Enhancing Classification Performance with AdaBoost and Residual Connections
di: Lian, Junbo Jacob
Pubblicazione: (2024)

Theory Foundation of Physics-Enhanced Residual Learning
di: Liang, Shixiao, et al.
Pubblicazione: (2025)

Causal Component Analysis
di: Wendong, Liang, et al.
Pubblicazione: (2023)

HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
di: Zhao, Hao, et al.
Pubblicazione: (2024)

How to Marginalize in Causal Structure Learning?
di: Zhao, William, et al.
Pubblicazione: (2025)

Climate Downscaling: A Deep-Learning Based Super-resolution Model of Precipitation Data with Attention Block and Skip Connections
di: Chiang, Chia-Hao, et al.
Pubblicazione: (2024)

Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and Gated Residual Connections
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2024)

NeuroPathNet: Dynamic Path Trajectory Learning for Brain Functional Connectivity Analysis
di: Guo, Tianqi, et al.
Pubblicazione: (2025)

From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modeling
di: Komanduri, Aneesh, et al.
Pubblicazione: (2023)

Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient
di: Wang, Shaoqi, et al.
Pubblicazione: (2024)

Unveiling Covert Toxicity in Multimodal Data via Toxicity Association Graphs: A Graph-Based Metric and Interpretable Detection Framework
di: Wu, Guanzong, et al.
Pubblicazione: (2026)

Confounded Causal Imitation Learning with Instrumental Variables
di: Zeng, Yan, et al.
Pubblicazione: (2025)

HT-GNN: Hyper-Temporal Graph Neural Network for Customer Lifetime Value Prediction in Baidu Ads
di: Zhao, Xiaohui, et al.
Pubblicazione: (2026)

CausalTAD: Injecting Causal Knowledge into Large Language Models for Tabular Anomaly Detection
di: Wang, Ruiqi, et al.
Pubblicazione: (2026)

FedAGHN: Personalized Federated Learning with Attentive Graph HyperNetworks
di: Song, Jiarui, et al.
Pubblicazione: (2025)

Low-Cost Labels, Reliable Choices: Rollout-Calibrated Hyper-Heuristics for Job Shop Scheduling
di: Wei, Junhao, et al.
Pubblicazione: (2026)

Local Causal Structure Learning in the Presence of Latent Variables
di: Xie, Feng, et al.
Pubblicazione: (2024)

LLM Enhancers for GNNs: An Analysis from the Perspective of Causal Mechanism Identification
di: Gao, Hang, et al.
Pubblicazione: (2025)

MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections
di: Xiao, Da, et al.
Pubblicazione: (2025)

HyperFast: Instant Classification for Tabular Data
di: Bonet, David, et al.
Pubblicazione: (2024)

HyperAdapt: Simple High-Rank Adaptation
di: Gurung, Abel, et al.
Pubblicazione: (2025)

HCP-DCNet: A Hierarchical Causal Primitive Dynamic Composition Network for Self-Improving Causal Understanding
di: Lei, Ming, et al.
Pubblicazione: (2026)