Skip to content

tg12/fitter

 
 

Repository files navigation

FITTER documentation

https://github.com/cokelaer/fitter/actions/workflows/main.yml/badge.svg?branch=main https://coveralls.io/repos/cokelaer/fitter/badge.png?branch=main Documentation Status

Compatible with Python 3.7, and 3.8, 3.9

What is it ?

The fitter package is a Python library used for fitting probability distributions to data. It provides a straightforward and and intuitive interface to estimate parameters for various types of distributions, both continuous and discrete. Using fitter, you can easily fit a range of distributions to your data and compare their fit, aiding in the selection of the most suitable distribution. The package is designed to be user-friendly and requires minimal setup, making it a useful tool for data scientists and statisticians working with probability distributions.

I'm deeply appreciative of the excellent work done by the original creator of fitter (https://github.com/cokelaer/fitter). Their thoughtful implementation of distribution fitting algorithms provided a solid foundation that inspired me to create this fork. While maintaining full respect for their valuable contribution, I've enhanced the package with several key improvements including better NumPy 2.0 compatibility, comprehensive test coverage with an improved test runner, optimized parallel processing for faster distribution fitting, and cleaner code following PEP 8 standards. These quality-of-life improvements aim to extend the package's utility while preserving the brilliant core functionality and intuitive design that made the original so valuable to the data science community. All credit for the original concept and implementation remains with the original author.

Installation

git clone https://github.com/tg12/fitter
cd fitter
pip install .

Run Tests

git clone https://github.com/tg12/fitter
cd fitter
pip3 install -e ".[dev]"
cd tests
python3 run_tests.py -v

Usage

standalone

A standalone application (very simple) is also provided and works with input CSV files:

fitter fitdist data.csv --column-number 1 --distributions gamma,normal

It creates a file called fitter.png and a log fitter.log

From Python shell

First, let us create a data samples with N = 10,000 points from a gamma distribution:

from scipy import stats
data = stats.gamma.rvs(2, loc=1.5, scale=2, size=10000)

Note

the fitting is slow so keep the size value to reasonable value.

Now, without any knowledge about the distribution or its parameter, what is the distribution that fits the data best ? Scipy has 80 distributions and the Fitter class will scan all of them, call the fit function for you, ignoring those that fail or run forever and finally give you a summary of the best distributions in the sense of sum of the square errors. The best is to give an example:

from fitter import Fitter
f = Fitter(data)
f.fit()
# may take some time since by default, all distributions are tried
# but you call manually provide a smaller set of distributions
f.summary()
http://pythonhosted.org/fitter/_images/index-1.png

See the online documentation for details.

Contributors

Setting up and maintaining Fitter has been possible thanks to users and contributors. Thanks to all:

https://contrib.rocks/image?repo=cokelaer/fitter

Changelog

Version Description
1.7.1
  • integrate PR github.com/cokelaer/pull/100 from @vitorandreazza to speedup multiprocessing run.
1.7.0
  • replace logging with loguru
  • main application update to add missing --output-image option and use rich_click
  • replace pkg_resources with importlib
1.6.0
  • for developers: uses pyproject.toml instead of setup.py
  • Fix progress bar fixing cokelaer#74
  • Fix BIC formula cokelaer#77
1.5.2
1.5.1
  • fixed regression putting back joblib
1.5.0
  • removed easydev and replaced by tqdm for progress bar
  • progressbar from tqdm also allows replacement of joblib need
1.4.1
  • Update timeout in docs from 10 to 30 seconds by @mpadge in cokelaer#47
  • Add Kolmogorov-Smirnov goodness-of-fit statistic by @lahdjirayhan in cokelaer#58
  • switch branch from master to main
1.4.0
  • get_best function now returns the parameters as a dictionary of parameter names and their values rather than just a list of values (cokelaer#23) thanks to contributor @kabirmdasraful
  • Accepting PR to fix progress bar issue reported in cokelaer#37
1.3.0
  • parallel process implemented cokelaer#25 thanks to @arsenyinfo
1.2.3
  • remove vervose arguments in Fitter class. Using the logging module instead
  • the Fitter.fit has now a progress bar
  • add a standalone application called … fitter (see the doc)
1.2.2 was not released
1.2.1 adding new class called histfit (see documentation)
1.2
  • Fixed the version. Previous version switched from 1.0.9 to 1.1.11. To start a fresh version, we increase to 1.2.0
  • Merged pull request required by bioconda
  • Merged pull request related to implementation of AIC/BIC/KL criteria (cokelaer#19). This also fixes cokelaer#9
  • Implement two functions to get all distributions, or a list of common distributions to help users decreading computational time (cokelaer#20). Also added a FAQS section.
  • travis tested Python 3.6 and 3.7 (not 3.5 anymore)
1.1
  • Fixed deprecated warning
  • fitter is now in readthedocs at fitter.readthedocs.io
1.0.9
1.0.6
  • summary() now returns the dataframe (instead of printing it)
1.0.5 https://github.com/cokelaer/fitter/issues
1.0.2 add manifest to fix missing source in the pypi repository.

About

Fit data to many distributions

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%