Skip to content

mtaung/sufficient_analysis

Repository files navigation

Sufficient_Analysis, or "How to do statistics with lost data"

A real world example of salvaging lost statistical data, to carry out an ANOVA and independent samples t-test from only sufficient statistics in python.

Why would you/I need sufficient statistics?

In some cases, as things go in real world projects, data is collected, aggregated, and then unfortunately lost due to unforseen circumstances. In this particular instance, data was collected during a short course on AI. Performance of the AI was to be compared against a benchmark, but due to an unexpected bug the data was lost after training. Given a time constraint to produce a statistical comparison, it was not reasonable to re-train the AI to collect data again. So I was called in to try and salvage the situation as best as possible.

What are sufficient statistics?

If you're lucky, you might be able to surrogate your previous data with a synthetic set based on some aggregate information such as your sample means. It's not perfect, and you lose a lot of information this way, but it will at least give you some core results that might still be informative of data that's otherwise lost forever. For such tests, it's also possible to just calculate your test statistics with the minimal required information - the so called sufficient statistics.

Using this repository

I recommend just reading the ANOVA notebook in the root directory, which is written to explain the process of computing a surrogate based analysis of variance. That's the purpose of setting up this repository at all, on my part.

Closing

I hope you never have to use anything like this, but maybe it'll help.

References

Larson, D. A. (1992). Analysis of variance with just summary statistics as input. The American Statistician, 46(2), 151-152.

About

Carrying out an ANOVA and independent samples t-test from sufficient statistics in python

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published