Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve aggregate(), sum() #72

Merged
merged 19 commits into from Sep 27, 2022
Merged

Improve aggregate(), sum() #72

merged 19 commits into from Sep 27, 2022

Conversation

khaeru
Copy link
Owner

@khaeru khaeru commented Sep 20, 2022 •
edited

  • Add new computations assign_units(), convert_units()
  • Use pd.Series.groupby(), instead of .stack() in AttrSeries.sum() to handle larger data without memory issues.
  • Remove support for Python 3.7.

PR checklist

  • Checks all ✅
  • Update documentation
  • Update doc/whatsnew.rst

@khaeru khaeru added the enh New feature or request label Sep 20, 2022
@khaeru khaeru self-assigned this Sep 20, 2022
@khaeru
Extend add_large_data()
7b0b4db 
- Argument N_data allows specifying arbitrary length.
- Allow up to 11 dimensions.
- Use categoricals to improve performance in get_large_quantity().
@khaeru
Add two failing tests of AttrSeries.sum()
afe7683 
- Duplicate indices.
- Large data.

Both fail with the v1.13.0 implementation using .unstack()
@khaeru
Use pd.Series.groupby() in AttrSeries.sum()
dae2986 
Tolerates larger data and duplicate indices.
@khaeru
Avoid pandas 1.5.0 FutureWarning in get_large_quantity()
1dd8d6c
@khaeru
Remove old warnings filters from setup.cfg
76b4b98
@khaeru
Update actions versions in CI workflows
7c94de1
@khaeru
Reenable windows-latest-py3.10 job for "pytest" CI workflow
370ae39
@khaeru
Warn in aggregate(…, keep=True) if target label already exists
585631d
@khaeru
Add .computations.assign_units and .convert_units
a19c9ff 
These are alternatives to apply_units with simpler behaviour.
@khaeru khaeru merged commit 0f557c3 into main Sep 27, 2022
@khaeru khaeru deleted the enh/2022-W38 branch September 27, 2022 14:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@khaeru khaeru

Labels
enh New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@khaeru