Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs(blog): blog on why DuckDB is the default backend #8378

Merged
merged 2 commits into from
Feb 20, 2024

Conversation

cpcloud
Copy link
Member

@cpcloud cpcloud commented Feb 16, 2024

Closes #8230.

@cpcloud cpcloud added this to the 9.0 milestone Feb 16, 2024
@cpcloud cpcloud added docs Documentation related issues or PRs duckdb The DuckDB backend labels Feb 16, 2024
@cpcloud cpcloud force-pushed the why-duckdb branch 2 times, most recently from 81978da to 94e59b7 Compare February 16, 2024 12:18
@cpcloud cpcloud added the docs-preview Add this label to trigger a docs preview label Feb 16, 2024
@ibis-docs-bot ibis-docs-bot bot removed the docs-preview Add this label to trigger a docs preview label Feb 16, 2024
@ibis-docs-bot
Copy link

ibis-docs-bot bot commented Feb 16, 2024

@cpcloud cpcloud force-pushed the why-duckdb branch 3 times, most recently from 50d2984 to 5c011eb Compare February 16, 2024 12:55
@ianmcook
Copy link
Contributor

This is great, thanks @cpcloud!

per https://pandas.pydata.org/about/citing.html:

When using the project name pandas, please use it in lower case, even at the beginning of a sentence.

could you change it to lowercase everywhere? thanks!

Copy link
Member

@gforsyth gforsyth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good!

Some small nits.

One larger point that we can raise (but we don't have to since it's increasing the scope of the post a bit) is that, in re: memory concerns with pandas and our considerations when choosing a default backend, that general feature parity between local and remote backends was (and is) desirable.

Develop locally then go brrrr on the production system is less tractable if you have to be very careful around memory usage fo rthe local development part.

docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
@cpcloud cpcloud force-pushed the why-duckdb branch 2 times, most recently from fd84893 to 096c122 Compare February 16, 2024 14:33
@cpcloud
Copy link
Member Author

cpcloud commented Feb 16, 2024

@ianmcook

could you change it to lowercase everywhere? thanks!

Done!

@gforsyth

One larger point that we can raise (but we don't have to since it's increasing the scope of the post a bit) is that, in re: memory concerns with pandas and our considerations when choosing a default backend, that general feature parity between local and remote backends was (and is) desirable.

I will add a short bit about this.

docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
docs/posts/why-duckdb/index.qmd Outdated Show resolved Hide resolved
@cpcloud cpcloud marked this pull request as ready for review February 16, 2024 14:43
Copy link
Member

@lostmygithubaccount lostmygithubaccount left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm. I would kinda like to see something on how we think about DataFusion/Polars today -- i.e. are they great local options? would we consider switching the default?

perhaps worth pointing out if you do prefer one of them, it's easy to change the backend. but feel free to ignore

@lostmygithubaccount
Copy link
Member

also timing-wise, I think we should wait to post this Monday or next Wednesday/Thursday depending on #8293

@cpcloud cpcloud added the docs-preview Add this label to trigger a docs preview label Feb 16, 2024
@ibis-docs-bot ibis-docs-bot bot removed the docs-preview Add this label to trigger a docs preview label Feb 16, 2024
@ibis-docs-bot
Copy link

ibis-docs-bot bot commented Feb 16, 2024

@lostmygithubaccount lostmygithubaccount merged commit c916f6a into ibis-project:main Feb 20, 2024
15 checks passed
@cpcloud cpcloud deleted the why-duckdb branch February 20, 2024 14:37
ncclementi pushed a commit to ncclementi/ibis that referenced this pull request Feb 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Documentation related issues or PRs duckdb The DuckDB backend
Projects
None yet
Development

Successfully merging this pull request may close these issues.

docs: blog on why DuckDB is the default backend
4 participants