Cover Image

The Impact of Model Zoo Size and Composition on Weight Space Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Falk, Damian, Schürholt, Konstantin, Borth, Damian
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Model Zoo of Vision Transformers
by: Falk, Damian, et al.
Published: (2025)

Towards Scalable and Versatile Weight Space Learning
by: Schürholt, Konstantin, et al.
Published: (2024)

Learning Model Representations Using Publicly Available Model Hubs
by: Falk, Damian, et al.
Published: (2025)

A Model Zoo on Phase Transitions in Neural Networks
by: Schürholt, Konstantin, et al.
Published: (2025)

Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction
by: Meynent, Léo, et al.
Published: (2025)

Sample Weight Estimation Using Meta-Updates for Online Continual Learning
by: Hemati, Hamed, et al.
Published: (2024)

Hyper-Representations: Learning from Populations of Neural Networks
by: Schürholt, Konstantin
Published: (2024)

FedTabDiff: Federated Learning of Diffusion Probabilistic Models for Synthetic Mixed-Type Tabular Data Generation
by: Sattarov, Timur, et al.
Published: (2024)

Privacy Preserving Diffusion Models for Mixed-Type Tabular Data Generation
by: Sattarov, Timur, et al.
Published: (2025)

GraphGuard: Contrastive Self-Supervised Learning for Credit-Card Fraud Detection in Multi-Relational Dynamic Graphs
by: Reynisson, Kristófer, et al.
Published: (2024)

Federated Diffusion Modeling with Differential Privacy for Tabular Data Synthesis
by: Sattarov, Timur, et al.
Published: (2024)

Diffusion-Scheduled Denoising Autoencoders for Anomaly Detection in Tabular Data
by: Sattarov, Timur, et al.
Published: (2025)

Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights
by: Liang, Zhiyuan, et al.
Published: (2025)

A Survey of Weight Space Learning: Understanding, Representation, and Generation
by: Han, Xiaolong, et al.
Published: (2026)

GeoSANE: Learning Geospatial Representations from Models, Not Data
by: Hanna, Joelle, et al.
Published: (2026)

MD tree: a model-diagnostic tree grown on loss landscape
by: Zhou, Yefan, et al.
Published: (2024)

Toward Dynamic Stability Assessment of Power Grid Topologies using Graph Neural Networks
by: Nauck, Christian, et al.
Published: (2022)

Are Smaller Open-Weight LLMs Closing the Gap to Proprietary Models for Biomedical Question Answering?
by: Stachura, Damian, et al.
Published: (2025)

Dirac--Bianconi Graph Neural Networks -- Enabling Non-Diffusive Long-Range Graph Predictions
by: Nauck, Christian, et al.
Published: (2024)

Recurrent Diffusion for Large-Scale Parameter Generation
by: Wang, Kai, et al.
Published: (2025)

The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models
by: Damian, Alex, et al.
Published: (2025)

Know Your Attention Maps: Class-specific Token Masking for Weakly Supervised Semantic Segmentation
by: Hanna, Joelle, et al.
Published: (2025)

Learning Compositional Functions with Transformers from Easy-to-Hard Data
by: Wang, Zixuan, et al.
Published: (2025)

Learning to Dissipate Energy in Oscillatory State-Space Models
by: Boyer, Jared, et al.
Published: (2025)

Robustness of Algorithms for Causal Structure Learning to Hyperparameter Choice
by: Machlanski, Damian, et al.
Published: (2023)

Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
by: Nichani, Eshaan, et al.
Published: (2023)

MAPEX: Modality-Aware Pruning of Experts for Remote Sensing Foundation Models
by: Hanna, Joelle, et al.
Published: (2025)

HiPPO Zoo: Explicit Memory Mechanisms for Interpretable State Space Models
by: Goffinet, Jack, et al.
Published: (2026)

Imitation Learning by State-Only Distribution Matching
by: Boborzi, Damian, et al.
Published: (2022)

How Transformers Learn Causal Structure with Gradient Descent
by: Nichani, Eshaan, et al.
Published: (2024)

Subspace Optimization for Backpropagation-Free Continual Test-Time Adaptation
by: Sójka, Damian, et al.
Published: (2026)

Model Zoo: A Growing "Brain" That Learns Continually
by: Ramesh, Rahul, et al.
Published: (2021)

Oscillatory State-Space Models
by: Rusch, T. Konstantin, et al.
Published: (2024)

The Challenges of Hyperparameter Tuning for Accurate Causal Effect Estimation
by: Machlanski, Damian, et al.
Published: (2023)

Undersmoothing Causal Estimators with Generative Trees
by: Machlanski, Damian, et al.
Published: (2022)

A Machine Learning Approach For Bitcoin Forecasting
by: Sossi-Rojas, Stefano, et al.
Published: (2025)

Computational-Statistical Gaps in Gaussian Single-Index Models
by: Damian, Alex, et al.
Published: (2024)

Improved high-dimensional estimation with Langevin dynamics and stochastic weight averaging
by: Wei, Stanley, et al.
Published: (2026)

HiPPO-Prophecy: State-Space Models can Provably Learn Dynamical Systems in Context
by: Joseph, Federico Arangath, et al.
Published: (2024)

Model Selection with Model Zoo via Graph Learning
by: Li, Ziyu, et al.
Published: (2024)