Test-Time Instance-Specific Parameter Composition: A New Paradigm for Adaptive Generative Modeling

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tran, Minh-Tuan, Le, Xuan-May, Tran, Quan Hung, Harandi, Mehrtash, Phung, Dinh, Le, Trung
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911551181553664
author Tran, Minh-Tuan
Le, Xuan-May
Tran, Quan Hung
Harandi, Mehrtash
Phung, Dinh
Le, Trung
author_facet Tran, Minh-Tuan
Le, Xuan-May
Tran, Quan Hung
Harandi, Mehrtash
Phung, Dinh
Le, Trung
contents Existing generative models, such as diffusion and auto-regressive networks, are inherently static, relying on a fixed set of pretrained parameters to handle all inputs. In contrast, humans flexibly adapt their internal generative representations to each perceptual or imaginative context. Inspired by this capability, we introduce Composer, a new paradigm for adaptive generative modeling based on test-time instance-specific parameter composition. Composer generates input-conditioned parameter adaptations at inference time, which are injected into the pretrained model's weights, enabling per-input specialization without fine-tuning or retraining. Adaptation occurs once prior to multi-step generation, yielding higher-quality, context-aware outputs with minimal computational and memory overhead. Experiments show that Composer substantially improves performance across diverse generative models and use cases, including lightweight/quantized models and test-time scaling. By leveraging input-aware parameter composition, Composer establishes a new paradigm for designing generative models that dynamically adapt to each input, moving beyond static parameterization.
format Preprint
id arxiv_https___arxiv_org_abs_2603_27665
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Test-Time Instance-Specific Parameter Composition: A New Paradigm for Adaptive Generative Modeling
Tran, Minh-Tuan
Le, Xuan-May
Tran, Quan Hung
Harandi, Mehrtash
Phung, Dinh
Le, Trung
Computer Vision and Pattern Recognition
Machine Learning
Existing generative models, such as diffusion and auto-regressive networks, are inherently static, relying on a fixed set of pretrained parameters to handle all inputs. In contrast, humans flexibly adapt their internal generative representations to each perceptual or imaginative context. Inspired by this capability, we introduce Composer, a new paradigm for adaptive generative modeling based on test-time instance-specific parameter composition. Composer generates input-conditioned parameter adaptations at inference time, which are injected into the pretrained model's weights, enabling per-input specialization without fine-tuning or retraining. Adaptation occurs once prior to multi-step generation, yielding higher-quality, context-aware outputs with minimal computational and memory overhead. Experiments show that Composer substantially improves performance across diverse generative models and use cases, including lightweight/quantized models and test-time scaling. By leveraging input-aware parameter composition, Composer establishes a new paradigm for designing generative models that dynamically adapt to each input, moving beyond static parameterization.
title Test-Time Instance-Specific Parameter Composition: A New Paradigm for Adaptive Generative Modeling
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2603.27665