Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add engine="numbagg" #72

Merged
merged 49 commits into from
Oct 7, 2023
Merged

Add engine="numbagg" #72

merged 49 commits into from
Oct 7, 2023

Conversation

dcherian
Copy link
Collaborator

@dcherian dcherian commented Feb 4, 2022

xref numbagg/numbagg#131

* main:
  Fix benchmarks
  Fix engine='numba' (#73)
  Switch to pre-commit.ci (#71)
* main:
  Fix datetime binning
  Fix simple_combine
  Cleanups from multiple groupers PR
  Improvements to reindex
  Testing improvements
  Clean up binning by using pd.Index for expected_groups
  Minor comment update
  Add pre-commit.ci badge
  pre-commit.ci updates quarterly
  [pre-commit.ci] pre-commit autoupdate (#74)
* main:
  Smol docstring improvement
  [pre-commit.ci] auto fixes from pre-commit.com hooks
  Add aggregation as top-level import
  Updates to notebook
  Add custom aggregations user story
  Add user stories (#81)
  Add ignore_old_chunks for rechunk_for_cohorts
  Skip reindexing in finalize_results if reindex is True
  Fix multiple grouper, same dim
  Pass reindex to _reduce_blockwise
  Better IntervalIndex creation
  Fix tests
  Multiple groupers v3 (#76)
  More consistent fill_value handling.
  isnull instead of isnan
  Add funding badge (#77)
  Handle sorting in factorize_
  Handle reindex in factorize_
  Small refactor
  Extra test and comment
ci/environment.yml Outdated Show resolved Hide resolved
dcherian and others added 3 commits July 13, 2022 10:55
* main: (44 commits)
  Rename repo to xarray-contrib/flox (#125)
  Propagate attrs better (#124)
  Update README.md (#123)
  Update README.md
  micromamba in CI (#122)
  Many optimizations (#120)
  Add xarray groupby test (#121)
  Update README.md
  Update README.md
  Add NASA Xarray grant
  [pre-commit.ci] pre-commit autoupdate (#118)
  Allow custom numpy aggregations for "blockwise" (#117)
  Don't execute hourly climatology notebook (#98)
  Bump actions/setup-python from 3 to 4 (#116)
  Fix factorizing some more. (#115)
  Correctly factorize values outside bin edges
  Better error message
  Avoid a copy.
  Fix bug where we had extra groups in expected_groups. (#112)
  Fix binning by nD variable
  ...
* main: (29 commits)
  Major fix to subset_to_blocks (#173)
  Performance improvements for cohorts detection (#172)
  Remove split_out (#170)
  Deprecate resample_reduce (#169)
  More efficient cohorts. (#165)
  Allow specifying output dtype (#131)
  Add a dtype check for numpy arrays in assert_equal (#158)
  Update ci-additional.yaml (#167)
  Refactor before redoing cohorts (#164)
  Fix mypy errors in core.py (#150)
  Add link to numpy_groupies (#160)
  Bump codecov/codecov-action from 3.1.0 to 3.1.1 (#159)
  Use math.prod instead of np.prod (#157)
  Remove None output from _get_expected_groups (#152)
  Fix mypy errors in xarray.py, xrutils.py, cache.py (#144)
  Raise error if multiple by's are used with Ellipsis (#149)
  pre-commit autoupdate (#148)
  Add mypy ignores (#146)
  Get pre commit bot to update (#145)
  Remove duplicate examples headers (#147)
  ...
dcherian and others added 12 commits September 28, 2023 15:27
* main: (68 commits)
  convert datetime: micro-optimizations (#261)
  compatibility with `numpy>=2.0` (#257)
  replace the deprecated `provision-with-micromamba` with `setup-micromamba` (#258)
  Fix some typing errors in asv_bench and tests (#253)
  [pre-commit.ci] pre-commit autoupdate (#250)
  typing fixes (#235)
  Fix test failure on i386 (#248)
  Delete resample_reduce (#246)
  Bump codecov/codecov-action from 3.1.3 to 3.1.4 (#243)
  Enable nanargmax, nanargmin (#171)
  Support nanfirst, nanlast with simple combine algo (#240)
  Check method only for dask reductions. (#241)
  Optimize broadcasting (#230)
  Handle min_count=0 (#238)
  Try and fix dtypes on 3.8,3.10 windows
  Preserve input dtypes now that pandas can do it.
  Add pytest-pretty to envs
  factorize early as much as possible
  Bump codecov/codecov-action from 3.1.1 to 3.1.3 (#239)
  [pre-commit.ci] pre-commit autoupdate (#229)
  ...
* upstream/main:
  tests: move xfail out of functions (#265)
@dcherian dcherian marked this pull request as ready for review October 2, 2023 22:26
@dcherian dcherian closed this Oct 6, 2023
@dcherian dcherian reopened this Oct 6, 2023
@dcherian dcherian mentioned this pull request Oct 7, 2023
@dcherian dcherian merged commit 9f82e19 into main Oct 7, 2023
16 of 18 checks passed
@dcherian dcherian deleted the numbagg branch October 7, 2023 14:33
dcherian added a commit to mathause/flox that referenced this pull request Oct 7, 2023
dcherian added a commit that referenced this pull request Nov 3, 2023
* main: (24 commits)
  Add `packaging` as dependency
  use engine flox for ordered groups (#266)
  Update pyproject.toml: py3.12
  Bump numpy to >=1.22 (#278)
  Cleanups (#276)
  benchmarks updates (#273)
  repo-review comments (#270)
  Significantly faster cohorts detection. (#272)
  Add engine="numbagg" (#72)
  Support quantile, median, mode with method="blockwise". (#269)
  Add multidimensional binning demo (#203)
  [pre-commit.ci] pre-commit autoupdate (#268)
  Drop python 3.8, test python 3.11 (#209)
  tests: move xfail out of functions (#265)
  Bump actions/checkout from 3 to 4 (#267)
  convert datetime: micro-optimizations (#261)
  compatibility with `numpy>=2.0` (#257)
  replace the deprecated `provision-with-micromamba` with `setup-micromamba` (#258)
  Fix some typing errors in asv_bench and tests (#253)
  [pre-commit.ci] pre-commit autoupdate (#250)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add engine="numbagg"
1 participant