Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Protection against (extreme) outliers in sparse histograms #215

Merged
merged 1 commit into from
Jun 5, 2022

Conversation

mbaak
Copy link
Contributor

@mbaak mbaak commented Jun 4, 2022

  • Protection against outliers in sparse histograms
    o Protect against extreme outliers in sparse histograms by avoiding the use of its dense representation where possible.
  • Performance speedup in histogram summation
    o Replace for loop with np.sum
  • Working analysis function unit tests
    o black histogram_section code
    o update of test_report_generator
    o section_generator now passes np arrays to plot_bars_b64, no longer pd.Series.
  • Bump up versions of histogrammar and popmon

@mbaak mbaak force-pushed the protection_against_outliers branch 4 times, most recently from 74201ff to 0f84ce8 Compare June 4, 2022 12:27
@mbaak mbaak requested a review from sbrugman June 4, 2022 12:57
@mbaak mbaak force-pushed the protection_against_outliers branch from 0f84ce8 to 584a692 Compare June 5, 2022 09:05
- Performance speedup in histogram summation
  o Replace for loop with np.sum
- Protection against outliers in sparse histograms
  o Protect against extreme outliers in sparse histograms by avoiding the use
    of its dense representation where possible.
- black histogram_section code
- Working analysis function unit tests
  o update of test_report_generator
  o section_generator now passes np arrays to plot_bars_b64, no longer pd.Series.
- Bump up versions of histogrammar and popmon
- Added crop_range option to get_consistent_numpy_1dhists function
  o return a cropped range version of the histogram, between 5-95% quantiles.
  o Plot cropped histograms in histogram section of report.
@mbaak mbaak force-pushed the protection_against_outliers branch from 584a692 to 384d9c7 Compare June 5, 2022 12:12
@sbrugman sbrugman merged commit dc37a00 into develop Jun 5, 2022
@sbrugman sbrugman deleted the protection_against_outliers branch June 5, 2022 20:18
sbrugman pushed a commit that referenced this pull request Jun 14, 2022
- Performance speedup in histogram summation
  o Replace for loop with np.sum
- Protection against outliers in sparse histograms
  o Protect against extreme outliers in sparse histograms by avoiding the use
    of its dense representation where possible.
- Working analysis function unit tests
  o update of test_report_generator
  o section_generator now passes np arrays to plot_bars_b64, no longer pd.Series.
- Added crop_range option to get_consistent_numpy_1dhists function
  o return a cropped range version of the histogram, between 5-95% quantiles.
  o Plot cropped histograms in histogram section of report.
- Bump up versions of histogrammar
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants