Typical reconstruction limit and phase transition of maximum entropy method

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hitomi, Masaru, Ohzeki, Masayuki
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918153435480064
author Hitomi, Masaru
Ohzeki, Masayuki
author_facet Hitomi, Masaru
Ohzeki, Masayuki
contents We investigate the dependence of the maximum entropy method (MEM) reconstruction performance on the default model. The maximum entropy method is a reconstruction technique that utilizes prior information, referred to as the default model, to recover original signals from observed data, and it is widely used in underdetermined systems. The broad applications have been reported in fields ranging from the analysis of observational data in seismology and astronomy, to large-scale computations in quantum chemistry, and even in social sciences such as linguistics. However, a known drawback of MEM is that its results depend on the assumed default model. In this study, we employ the replica method to elucidate how discrepancies in the default model affect the reconstruction of signals with specific distributions. We report that in certain cases, even small discrepancies can induce phase transitions, leading to reconstruction failure. Additionally, by comparing MEM with reconstruction based on L1-norm optimization, a method proposed in recent years, we demonstrate that MEM exhibits lower reconstruction accuracy under certain conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2504_03095
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Typical reconstruction limit and phase transition of maximum entropy method
Hitomi, Masaru
Ohzeki, Masayuki
Statistical Mechanics
We investigate the dependence of the maximum entropy method (MEM) reconstruction performance on the default model. The maximum entropy method is a reconstruction technique that utilizes prior information, referred to as the default model, to recover original signals from observed data, and it is widely used in underdetermined systems. The broad applications have been reported in fields ranging from the analysis of observational data in seismology and astronomy, to large-scale computations in quantum chemistry, and even in social sciences such as linguistics. However, a known drawback of MEM is that its results depend on the assumed default model. In this study, we employ the replica method to elucidate how discrepancies in the default model affect the reconstruction of signals with specific distributions. We report that in certain cases, even small discrepancies can induce phase transitions, leading to reconstruction failure. Additionally, by comparing MEM with reconstruction based on L1-norm optimization, a method proposed in recent years, we demonstrate that MEM exhibits lower reconstruction accuracy under certain conditions.
title Typical reconstruction limit and phase transition of maximum entropy method
topic Statistical Mechanics
url https://arxiv.org/abs/2504.03095