FABADA is a novel non-parametric noise reduction technique which arise from the point of view of Bayesian inference that iteratively evaluates possible smoothed models of the data, obtaining an estimation of the underlying signal that is statistically compatible with the noisy measurements.
Iterations stop based on the evidence
Explore the results »
View Demo
·
Report Bug
·
Request Feature
Table of Contents
This automatic method is focused in astronomical data, such as images (2D) or spectra (1D). Although, this doesn't mean it can be treat like a general noise reduction algorithm and can be use in any kind of two and one-dimensional data reproducing reliable results. The only requisite of the input data is an estimation of its associated variance.
We try to make the usage of FABADA as simple as possible. For that purpose, we have create a PyPI package to install FABADA.
The first requirement is to have a version of Python greater than 3.5. Although PyPI install the prerequisites itself, FABADA has two dependecies.
Using pip you can either install the last relase by
pip install fabadaor you can install the latest version of the code as
git clone git@github.com:PabloMSanAla/fabada.git
cd fabada
pip install -e .For the Astronomical community we give another file, the fabadaCMD.py file that will help you run fabada for a fits file from the command line. The requisites to use this file is to have installed the astropy and argparse packages. The positional arguments of this file are:
- filename: Which is the string variable of the localization and name of the image fits file
- noise: Either a float number of the estimation of the variance of the image or a string for the containing fits file
In this example you will use fabada to denoise a SDSS mosaic image of the NGC2870 galaxy using the fabadaCMD.py file. The image file ngc2870_sloan_r.fits is a mosaic image in the R band with an associate noise of roughly 0.001 counts, which is also located in the file ngc2870_sloan_r_noise.fits. This value of the noise is a simple estimation of the variance of the image but you can either give your own estimation or fits file of the error. To run fabada from the command line you only have to run
python fabadaCMD.py ngc2870_sloan_r.fits ngc2870_sloan_r_noise.fitsand the result will be saved in a fits file called in this case ngc2870_sloan_r_fabada.fits. The next figure shows the differences between the two images:
If you want to see the other optional parameters you only have to run
python fabadaCMD.py -hin the shell and the optional parameters along a short description will be shown.
Along with the package two examples are given.
- fabada_demo_image.py
In here we show how to use fabada for an astronomical grey image (two dimensional) First of all we have to import our library previously install and some dependecies
from fabada import fabada
import numpy as np
from PIL import ImageThen we read the bubble image borrowed from the Hubble Space Telescope gallery. In our case we use the Pillow library for that. We also add some random Gaussian white noise using numpy.random.
# IMPORTING IMAGE
y = np.array(Image.open("bubble.png").convert('L'))
# ADDING RANDOM GAUSSIAN NOISE
np.random.seed(12431)
sig = 15 # Standard deviation of noise
noise = np.random.normal(0, sig ,y.shape)
z = y + noise
variance = sig**2Once the noisy image is generated we can apply fabada to produce an estimation of the underlying image, which we only have to call fabada and give it the variance of the noisy image
y_recover = fabada(z,variance)And its done 😉
As easy as one line of code.
The results obtained running this example would be:
The left, middle and right panel corresponds to the true signal, the noisy meassurents and the estimation of fabada respectively. There is also shown the Peak Signal to Noise Ratio (PSNR) in dB and the Structural Similarity Index Measure (SSIM) at the bottom of the middle and right panel (PSNR/SSIM).
- fabada_demo_spectra.py
In here we show how to use fabada for an astronomical spectrum (one dimensional), basically is the same as the example above since fabada is the same for one and two-dimensional data. First of all, we have to import our library previously install and some dependecies
from fabada import fabada
import pandas as pd
import numpy as npThen we read the interacting galaxy pair Arp 256 spectra, taken from the ASTROLIB PYSYNPHOT package which is store in arp256.csv. Again we add some random Gaussian white noise
# IMPORTING SPECTRUM
y = np.array(pd.read_csv('arp256.csv').flux)
y = (y/y.max())*255 # Normalize to 255
# ADDING RANDOM GAUSSIAN NOISE
np.random.seed(12431)
sig = 10 # Standard deviation of noise
noise = np.random.normal(0, sig ,y.shape)
z = y + noise
variance = sig**2Once the noisy image is generated we can, again, apply fabada to produce an estimation of the underlying spectrum, which we only have to call fabada and give it the variance of the noisy image
y_recover = fabada(z,variance)And done again 😉
Which is exactly the same as for two dimensional data.
The results obtained running this example would be:
The red, grey and black line represents the true signal, the noisy meassurents and the estimation of fabada respectively. There is also shown the Peak Signal to Noise Ratio (PSNR) in dB and the Structural Similarity Index Measure (SSIM) in the legend of the figure (PSNR/SSIM).
All the results of the paper of this algorithm can be found in the folder results along with a jupyter notebook that allows to explore all of them through an interactive interface. You can run the jupyter notebook through Google Colab in this link --> Explore the results.
Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.
If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request
Distributed under the GNU General Public License. See LICENSE.txt for more information.
Pablo M Sánchez Alarcón - pmsa.astro@gmail.com
Yago Ascasibar Sequeiros - yago.ascasibar@uam.es
Project Link: https://github.com/PabloMSanAla/fabada
Thank you for using FABADA.
Citations and acknowledgement are vital for the continued work on this kind of algorithms.
Please cite the following record if you used FABADA in any of your publications.
@ARTICLE{2022arXiv220105145S,
author = {{Sanchez-Alarcon}, Pablo M and {Ascasibar Sequeiros}, Yago},
title = "{Fully Adaptive Bayesian Algorithm for Data Analysis, FABADA}",
journal = {arXiv e-prints},
keywords = {Astrophysics - Instrumentation and Methods for Astrophysics, Astrophysics - Astrophysics of Galaxies, Astrophysics - Solar and Stellar Astrophysics, Computer Science - Computer Vision and Pattern Recognition, Physics - Data Analysis, Statistics and Probability},
year = 2022,
month = jan,
eid = {arXiv:2201.05145},
pages = {arXiv:2201.05145},
archivePrefix = {arXiv},
eprint = {2201.05145},
primaryClass = {astro-ph.IM},
adsurl = {https://ui.adsabs.harvard.edu/abs/2022arXiv220105145S}
}
Sanchez-Alarcon, P. M. and Ascasibar Sequeiros, Y., “Fully Adaptive Bayesian Algorithm for Data Analysis, FABADA”, arXiv e-prints, 2022.
https://arxiv.org/abs/2201.05145
Readme file taken from Best README Template.