Variable Fusion and Selection via a Spike-and-Slab Approach with Nonlocal Priors

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Miyake, Junya, Okazaki, Akira, Kawano, Shuichi
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910173062234112
author Miyake, Junya
Okazaki, Akira
Kawano, Shuichi
author_facet Miyake, Junya
Okazaki, Akira
Kawano, Shuichi
contents Variable fusion in linear regression models is a statistical method that identifies covariates making similar contributions to the response variable and imposes the same coefficient values on them. Many methods for variable fusion also incorporate variable selection for practical reasons. In this paper, within the Bayesian model averaging (BMA) framework, we propose a spike-and-slab-based Bayesian method that performs both variable fusion and selection. This is challenging in the BMA framework because one must construct a discrete model space that accommodates both selection and fusion and assign suitable priors over that space. In the proposed method, we present a way to explore a model space for variable fusion and selection based on Gibbs sampling by devising a prior distribution for latent variables representing the model. Furthermore, among non-local priors with superior model selection properties, we construct a prior tailored for variable fusion and use it as the slab distribution. We examine the effectiveness of the proposed method through theoretical and empirical studies.
format Preprint
id arxiv_https___arxiv_org_abs_2604_25268
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Variable Fusion and Selection via a Spike-and-Slab Approach with Nonlocal Priors
Miyake, Junya
Okazaki, Akira
Kawano, Shuichi
Methodology
62F15, 62J05, 62J07
Variable fusion in linear regression models is a statistical method that identifies covariates making similar contributions to the response variable and imposes the same coefficient values on them. Many methods for variable fusion also incorporate variable selection for practical reasons. In this paper, within the Bayesian model averaging (BMA) framework, we propose a spike-and-slab-based Bayesian method that performs both variable fusion and selection. This is challenging in the BMA framework because one must construct a discrete model space that accommodates both selection and fusion and assign suitable priors over that space. In the proposed method, we present a way to explore a model space for variable fusion and selection based on Gibbs sampling by devising a prior distribution for latent variables representing the model. Furthermore, among non-local priors with superior model selection properties, we construct a prior tailored for variable fusion and use it as the slab distribution. We examine the effectiveness of the proposed method through theoretical and empirical studies.
title Variable Fusion and Selection via a Spike-and-Slab Approach with Nonlocal Priors
topic Methodology
62F15, 62J05, 62J07
url https://arxiv.org/abs/2604.25268