| _version_ | 1866901876420640768 |
|---|---|
| author | Lightholder, Jack Hardgrove, Craig |
| author_facet | Lightholder, Jack Hardgrove, Craig |
| contents | <h1>DAN One-Layer Retrieval Data Release (Sols 751–4050)</h1> <p>This repository contains processed Dynamic Albedo of Neutrons (DAN) one-layer retrieval products and supporting summary products for Curiosity observations spanning sols 751–4050. The release is organized into region-level summary products and per-location retrieval products. File names use a consistent `site / drive / start_sol / stop_sol` convention so that products from different subdirectories can be matched directly. Retrievals are performed on coadds of all observations at a given site/drive, producing one retrieval per location.</p> <h2>Repository structure</h2> <p>1_layer_DAN_sols_751_4050/<br>├── regional_summaries/<br>└── retrieval_products/</p> <h3>regional_summaries/</h3> <p>This directory contains region-scale summary tables and regional overlay figures. Each region contained in the data volume contains three files. One file stores per-observation summary statistics, the second stores bulk region summary statistics and the third is a plot of the regions retrieval results.</p> <p>Example:</p> <p>- region_<region>_per_observation_stats_snr5_sub50_hdi68.csv<br>- region_<region>_region_summary_stats_snr5_sub50_hdi68.csv<br>- region_<region>_overlay_COMBINED_snr5_sub50.png</p> <p>The same naming pattern is used across regions.</p> <h3>retrieval_products/</h3> <p>This directory contains the observation-level retrieval products and diagnostics.</p> <p>retrieval_products/<br>├── background_subtracted_coadd/<br>├── coadd_observations/<br>├── coadd_product/<br>├── corner_plots/<br>├── GMMs/<br>│ ├── unmix_2/<br>│ │ └── gmm_mix/<br>│ └── unmix_variable/<br>│ ├── gmm_mix/<br>│ └── gmm_selection/<br>├── MCMC_backend/<br>├── SNR/<br>├── times/<br>└── walker_plots/<br><br></p> <h3>Naming convention</h3> <p>Most files share a common stem:</p> <p>site_<SITE>_drive_<DRIVE>_start_sol_<START>_stop_sol_<STOP></p> <p>For example:</p> <p>site_026_drive_1274_start_sol_542_stop_sol_542<br>This stem is followed by a product-specific suffix, for example:</p> <p>- _bg_dat.npy<br>- _label_matched.txt<br>- _coadded.npy<br>- _corner_plot.png<br>- _gmm_mix.png<br>- _gmm_selection.png<br>- _MCMC.h5.zip<br>- _CETN_SNR.npy<br>- _CTN_SNR.npy<br>- _times.npy<br>- _walker_plot.png</p> <p>This convention allows all products associated with a given coadded retrieval to be aligned by filename.</p> <h3>Retrieval content</h3> <p>The products in this release correspond to a one-layer retrieval framework. The primary retrieved physical parameters are:</p> <p>- <strong>WEH</strong>: water-equivalent hydrogen, in wt%<br>- <strong>Σ_abs</strong>: bulk macroscopic neutron absorption cross section (BNACS), in cm^2/g</p> <p>Posterior diagnostics may also include an additional logf[counts] fit parameter in the MCMC products.</p> <h2>Observation-level products</h2> <p>Each retrieval generally includes one file in each of the subdirectories below.</p> <h3>background_subtracted_coadd/</h3> <p>Files ending in _bg_dat.npy contain the background-subtracted count data used in retrieval processing.</p> <h3>coadd_observations/</h3> <p>Files ending in _label_matched.txt list the DAN observation label or labels contributing to the coadded retrieval product. These files provide the traceability link between the retrieval and the original contributing observation set.</p> <h3>coadd_product/</h3> <p>Files ending in _coadded.npy contain the coadded observation-space product used as the retrieval input.</p> <h3>corner_plots/</h3> <p>Files ending in _corner_plot.png`are posterior diagnostic figures showing parameter distributions and pairwise covariances.</p> <p>For one-layer retrievals, these figures are expected to show the posterior structure for WEH and Σ_abs, and logf[counts].</p> <h3>GMMs/</h3> <p>This directory contains Gaussian mixture model post-processing products.</p> <p>- unmix_2/ contains fixed two-component mixture summaries.<br>- unmix_variable/ contains variable-component mixture exploration products.</p> <p>Within these directories:</p> <p>- gmm_mix/ contains posterior unmixing summary plots.<br>- gmm_selection/ contains model-selection plots used to compare mixture counts.</p> <p>These products support interpretation of multimodal posterior structure.</p> <h3>MCMC_backend/</h3> <p>Files ending in _MCMC.h5.zip are compressed HDF5 backends containing the archived MCMC chains. These are the primary reproducibility products for users who want to regenerate posterior summaries, diagnostics, or alternate post-processing results.</p> <h3>SNR/</h3> <p>This directory contains per-observation signal-to-noise products:</p> <p>- *_CETN_SNR.npy<br>- *_CTN_SNR.npy</p> <p>These arrays store time-bin-level SNR values associated with the retrieval input data.</p> <h3>times/</h3> <p>Files ending in _times.npy contain the time-bin definitions associated with the DAN die-away measurement.</p> <h3>walker_plots/</h3> <p>Files ending in _walker_plot.png show the evolution of the MCMC walkers as a function of iteration number and are intended for quality control and convergence assessment.</p> <h2>Regional summary products</h2> <h3>Per-observation regional statistics</h3> <p>Files named region_<region>_per_observation_stats_snr5_sub50_hdi68.csv contain one row per parameter per observation for all observations assigned to a region. These tables provide per-observation posterior summary statistics and identifying metadata such as sol, site, drive, start/stop sol, and source retrieval filename. Coadded observations are only included in regional summaries if their SNR is greater than or equal to 5.</p> <p>Summary statistics include quantities such as:</p> <p>- number of posterior samples<br>- mean<br>- standard deviation<br>- median<br>- KDE mode<br>- percentile-based intervals<br>- mode-centered interval terms<br>- 68% highest-density interval bounds and width</p> <p>These files are intended for downstream analysis, filtering, and custom regional comparisons.</p> <h3>Region-level summary statistics</h3> <p>Files named region_<region>_region_summary_stats_snr5_sub50_hdi68.csv contain region-level aggregate summaries for each retrieval parameter. These include statistics derived from the distribution of per-observation medians, modes, interval widths, and mixture-distribution summaries.</p> <p>These products are designed for compact regional characterization without requiring users to reprocess all observation-level posterior samples.</p> <h3>Regional overlay figures</h3> <p>Files named region_<region>_overlay_COMBINED_snr5_sub50.png show the combined regional posterior-density overlays for the one-layer retrieval parameters. These figures provide a visual summary of how posterior structure varies across all observations within a region.</p> <h3>Processing tags in filenames</h3> <p>Several filenames include processing tags that encode how the products were generated:</p> <p>- snr5: products generated using an SNR threshold of 5<br>- sub50: products generated using a 50% posterior subsampling step<br>- hdi68: summary statistics reported using 68% highest-density intervals</p> <p>These tags are part of the product identity and should be preserved when referencing or redistributing derivative products.</p> <h2>Recommended use</h2> <p>A typical use pattern is:</p> <p>1. Start with regional_summaries/ to review region-scale behavior and identify observations of interest.<br>2. Use coadd_observations/ to trace a retrieval back to the contributing DAN observation labels.<br>3. Use coadd_product/, background_subtracted_coadd/, SNR/, and times/ for observation-space analysis.<br>4. Use corner_plots/, walker_plots/, and GMMs/ for posterior interpretation and quality control.<br>5. Use MCMC_backend/ when full reproducibility or custom post-processing is required.</p> <h2>Acknowledgment</h2> <p>If you use these products in published work, please cite the associated data release and the relevant scientific publications describing the DAN retrieval methodology.</p> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_19211633 |
| institution | Zenodo |
| language | |
| publishDate | 2026 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | DAN One Layer Retrievals - Sols 751-4050 Lightholder, Jack Hardgrove, Craig <h1>DAN One-Layer Retrieval Data Release (Sols 751–4050)</h1> <p>This repository contains processed Dynamic Albedo of Neutrons (DAN) one-layer retrieval products and supporting summary products for Curiosity observations spanning sols 751–4050. The release is organized into region-level summary products and per-location retrieval products. File names use a consistent `site / drive / start_sol / stop_sol` convention so that products from different subdirectories can be matched directly. Retrievals are performed on coadds of all observations at a given site/drive, producing one retrieval per location.</p> <h2>Repository structure</h2> <p>1_layer_DAN_sols_751_4050/<br>├── regional_summaries/<br>└── retrieval_products/</p> <h3>regional_summaries/</h3> <p>This directory contains region-scale summary tables and regional overlay figures. Each region contained in the data volume contains three files. One file stores per-observation summary statistics, the second stores bulk region summary statistics and the third is a plot of the regions retrieval results.</p> <p>Example:</p> <p>- region_<region>_per_observation_stats_snr5_sub50_hdi68.csv<br>- region_<region>_region_summary_stats_snr5_sub50_hdi68.csv<br>- region_<region>_overlay_COMBINED_snr5_sub50.png</p> <p>The same naming pattern is used across regions.</p> <h3>retrieval_products/</h3> <p>This directory contains the observation-level retrieval products and diagnostics.</p> <p>retrieval_products/<br>├── background_subtracted_coadd/<br>├── coadd_observations/<br>├── coadd_product/<br>├── corner_plots/<br>├── GMMs/<br>│ ├── unmix_2/<br>│ │ └── gmm_mix/<br>│ └── unmix_variable/<br>│ ├── gmm_mix/<br>│ └── gmm_selection/<br>├── MCMC_backend/<br>├── SNR/<br>├── times/<br>└── walker_plots/<br><br></p> <h3>Naming convention</h3> <p>Most files share a common stem:</p> <p>site_<SITE>_drive_<DRIVE>_start_sol_<START>_stop_sol_<STOP></p> <p>For example:</p> <p>site_026_drive_1274_start_sol_542_stop_sol_542<br>This stem is followed by a product-specific suffix, for example:</p> <p>- _bg_dat.npy<br>- _label_matched.txt<br>- _coadded.npy<br>- _corner_plot.png<br>- _gmm_mix.png<br>- _gmm_selection.png<br>- _MCMC.h5.zip<br>- _CETN_SNR.npy<br>- _CTN_SNR.npy<br>- _times.npy<br>- _walker_plot.png</p> <p>This convention allows all products associated with a given coadded retrieval to be aligned by filename.</p> <h3>Retrieval content</h3> <p>The products in this release correspond to a one-layer retrieval framework. The primary retrieved physical parameters are:</p> <p>- <strong>WEH</strong>: water-equivalent hydrogen, in wt%<br>- <strong>Σ_abs</strong>: bulk macroscopic neutron absorption cross section (BNACS), in cm^2/g</p> <p>Posterior diagnostics may also include an additional logf[counts] fit parameter in the MCMC products.</p> <h2>Observation-level products</h2> <p>Each retrieval generally includes one file in each of the subdirectories below.</p> <h3>background_subtracted_coadd/</h3> <p>Files ending in _bg_dat.npy contain the background-subtracted count data used in retrieval processing.</p> <h3>coadd_observations/</h3> <p>Files ending in _label_matched.txt list the DAN observation label or labels contributing to the coadded retrieval product. These files provide the traceability link between the retrieval and the original contributing observation set.</p> <h3>coadd_product/</h3> <p>Files ending in _coadded.npy contain the coadded observation-space product used as the retrieval input.</p> <h3>corner_plots/</h3> <p>Files ending in _corner_plot.png`are posterior diagnostic figures showing parameter distributions and pairwise covariances.</p> <p>For one-layer retrievals, these figures are expected to show the posterior structure for WEH and Σ_abs, and logf[counts].</p> <h3>GMMs/</h3> <p>This directory contains Gaussian mixture model post-processing products.</p> <p>- unmix_2/ contains fixed two-component mixture summaries.<br>- unmix_variable/ contains variable-component mixture exploration products.</p> <p>Within these directories:</p> <p>- gmm_mix/ contains posterior unmixing summary plots.<br>- gmm_selection/ contains model-selection plots used to compare mixture counts.</p> <p>These products support interpretation of multimodal posterior structure.</p> <h3>MCMC_backend/</h3> <p>Files ending in _MCMC.h5.zip are compressed HDF5 backends containing the archived MCMC chains. These are the primary reproducibility products for users who want to regenerate posterior summaries, diagnostics, or alternate post-processing results.</p> <h3>SNR/</h3> <p>This directory contains per-observation signal-to-noise products:</p> <p>- *_CETN_SNR.npy<br>- *_CTN_SNR.npy</p> <p>These arrays store time-bin-level SNR values associated with the retrieval input data.</p> <h3>times/</h3> <p>Files ending in _times.npy contain the time-bin definitions associated with the DAN die-away measurement.</p> <h3>walker_plots/</h3> <p>Files ending in _walker_plot.png show the evolution of the MCMC walkers as a function of iteration number and are intended for quality control and convergence assessment.</p> <h2>Regional summary products</h2> <h3>Per-observation regional statistics</h3> <p>Files named region_<region>_per_observation_stats_snr5_sub50_hdi68.csv contain one row per parameter per observation for all observations assigned to a region. These tables provide per-observation posterior summary statistics and identifying metadata such as sol, site, drive, start/stop sol, and source retrieval filename. Coadded observations are only included in regional summaries if their SNR is greater than or equal to 5.</p> <p>Summary statistics include quantities such as:</p> <p>- number of posterior samples<br>- mean<br>- standard deviation<br>- median<br>- KDE mode<br>- percentile-based intervals<br>- mode-centered interval terms<br>- 68% highest-density interval bounds and width</p> <p>These files are intended for downstream analysis, filtering, and custom regional comparisons.</p> <h3>Region-level summary statistics</h3> <p>Files named region_<region>_region_summary_stats_snr5_sub50_hdi68.csv contain region-level aggregate summaries for each retrieval parameter. These include statistics derived from the distribution of per-observation medians, modes, interval widths, and mixture-distribution summaries.</p> <p>These products are designed for compact regional characterization without requiring users to reprocess all observation-level posterior samples.</p> <h3>Regional overlay figures</h3> <p>Files named region_<region>_overlay_COMBINED_snr5_sub50.png show the combined regional posterior-density overlays for the one-layer retrieval parameters. These figures provide a visual summary of how posterior structure varies across all observations within a region.</p> <h3>Processing tags in filenames</h3> <p>Several filenames include processing tags that encode how the products were generated:</p> <p>- snr5: products generated using an SNR threshold of 5<br>- sub50: products generated using a 50% posterior subsampling step<br>- hdi68: summary statistics reported using 68% highest-density intervals</p> <p>These tags are part of the product identity and should be preserved when referencing or redistributing derivative products.</p> <h2>Recommended use</h2> <p>A typical use pattern is:</p> <p>1. Start with regional_summaries/ to review region-scale behavior and identify observations of interest.<br>2. Use coadd_observations/ to trace a retrieval back to the contributing DAN observation labels.<br>3. Use coadd_product/, background_subtracted_coadd/, SNR/, and times/ for observation-space analysis.<br>4. Use corner_plots/, walker_plots/, and GMMs/ for posterior interpretation and quality control.<br>5. Use MCMC_backend/ when full reproducibility or custom post-processing is required.</p> <h2>Acknowledgment</h2> <p>If you use these products in published work, please cite the associated data release and the relevant scientific publications describing the DAN retrieval methodology.</p> |
| title | DAN One Layer Retrievals - Sols 751-4050 |
| url | https://doi.org/10.5281/zenodo.19211633 |