Skip to content

Commit

Permalink
add more information on diagnosing runs
Browse files Browse the repository at this point in the history
  • Loading branch information
JohannesBuchner committed Apr 6, 2021
1 parent 564d168 commit 84972ab
Show file tree
Hide file tree
Showing 2 changed files with 44 additions and 0 deletions.
36 changes: 36 additions & 0 deletions paper.bib
Original file line number Diff line number Diff line change
Expand Up @@ -236,3 +236,39 @@ @ARTICLE{Speagle2020
primaryclass = {astro-ph.IM},
timestamp = {2020.06.17}
}
@ARTICLE{Higson2019,
author = {{Higson}, Edward and {Handley}, Will and {Hobson}, Michael and {Lasenby},
Anthony},
title = {{NESTCHECK: diagnostic tests for nested sampling calculations}},
journal = {\mnras},
year = {2019},
volume = {483},
pages = {2044-2056},
number = {2},
month = {Feb},
adsnote = {Provided by the SAO/NASA Astrophysics Data System},
adsurl = {https://ui.adsabs.harvard.edu/abs/2019MNRAS.483.2044H},
archiveprefix = {arXiv},
doi = {10.1093/mnras/sty3090},
eprint = {1804.06406},
file = {arXiv v1:Higson2019-eprintv1.pdf:PDF},
keywords = {methods: data analysis, methods: numerical, methods: statistical,
Statistics - Computation, Astrophysics - Cosmology and Nongalactic
Astrophysics, Astrophysics - Instrumentation and Methods for Astrophysics,
Physics - Data Analysis, Statistics and Probability},
owner = {user},
primaryclass = {stat.CO},
review = {contributions:
* diagram - show uncertainty in posterior using bootstrapping
* diagram - logX vs samples
* multirun - BS vs multirun mean uncertainties per parameter
* pairtest - KS test of means from two runs
* diagnostic -},
timestamp = {2019.10.05}
}
8 changes: 8 additions & 0 deletions paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -128,6 +128,14 @@ perform Bayesian inference.
Since v4.0, BXA uses the Python package UltraNest [@ultranest],
which is easier to install.

For diagnosing the quality of BXA outputs, verifying the stability
over two or more runs is recommended, in particular of
the marginal posterior distributions and excess scatter of logZ [@Higson2019].

To determine reliable model selection thresholds, parametric bootstrap is recommended.
This involves simulating many data sets under one model and deriving Bayes factor distributions
with BXA runs [e.g., Appendix of @Buchner2014].

# Documentation

[Extensive documentation](https://johannesbuchner.github.io/BXA/) is available.
Expand Down

0 comments on commit 84972ab

Please sign in to comment.