Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Python binary wheels #861

Closed
occasionallydavid opened this issue Aug 23, 2020 · 3 comments
Closed

Python binary wheels #861

occasionallydavid opened this issue Aug 23, 2020 · 3 comments

Comments

@occasionallydavid
Copy link

The DuckDB build process is fairly heavyweight, I guess due to lots of templated C++ (haven't checked the code yet ;)). Additionally I notice cc1 using at least 5GB memory during build, limiting the kinds of VMs DuckDB could even be installed.

Would it be possible to provide binary wheels for PyPI instead, at least for Linux? Assuming the dependency situation is straightforward (just libstdc++ for example), this may be as straightforward as 'pip install wheel twine' 'python setup.py bdist_whl', 'twine upload dist/*.whl' or similar.

Thanks
@hannes
Copy link
Member

hannes commented Aug 24, 2020

We have those, what platform are you trying to install DuckDB on? See for example here: https://pypi.org/project/duckdb/#files

@hannes hannes changed the title [feature request] Python binary wheels Python binary wheels Aug 24, 2020
@hannes
Copy link
Member

hannes commented Aug 27, 2020

@occasionallydavid ?

@Mytherin
Copy link
Collaborator

Closing this issue for now. We have revamped the build process for Python/R so it should not use as much memory, and we do already provide binary wheels. Feel free to re-open if you encounter an issue with the binary wheels.

hawkfish added a commit to hawkfish/duckdb that referenced this issue Dec 11, 2023
@hawkfish
Internal duckdb#861: Aggregation Absorb API
fac754c 
Add an optional destructive combine API called "absorb".
hawkfish pushed a commit to hawkfish/duckdb that referenced this issue Dec 12, 2023
Internal duckdb#861: Aggregation Absorb API
ed6b6e3 
* Implement absorb for LIST and remove custom window hack
* Add test for LIST segment trees and verify it doesn't trash anything
* Fix a small API wart in the list segment code.
hawkfish added a commit to hawkfish/duckdb that referenced this issue Dec 15, 2023
@hawkfish
Internal duckdb#861: Aggregation Absorb API
cfe756d 
PR feedback:

* Change header variable name
* Document new API in the README.
hawkfish added a commit to hawkfish/duckdb that referenced this issue Dec 21, 2023
@hawkfish
Internal duckdb#861: Aggregation Absorb API
3e991b5 
First refactor of segment trees for order-sensitive aggregates.
hawkfish added a commit to hawkfish/duckdb that referenced this issue Dec 21, 2023
@hawkfish
Internal duckdb#861: Aggregation Absorb API
08d282a 
Handle order-sensitive aggregates segment trees.
hawkfish added a commit to hawkfish/duckdb that referenced this issue Jan 8, 2024
@hawkfish
Internal duckdb#861: Aggregation Absorb Functionality
4700e9a 
Use an enum in AggregateInputData instead of creating a new API.
hawkfish added a commit to hawkfish/duckdb that referenced this issue Jan 8, 2024
@hawkfish
Internal duckdb#861: Aggregation Absorb Functionality
cb32170 
Generate AggregateCombineType enum strings...
hawkfish added a commit to hawkfish/duckdb that referenced this issue Jan 9, 2024
@hawkfish
Internal duckdb#861: Aggregation Absorb API
6503d14 
Remove last references to the destructive combine API called "absorb".
Mytherin added a commit that referenced this issue Jan 15, 2024
@Mytherin
Merge pull request #9971 from hawkfish/absorb
41d90ca 
Internal #861: Aggregation Absorb API
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hannes @Mytherin @occasionallydavid