Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add composable data ecosystem concept #7898

Merged
merged 6 commits into from Jan 5, 2024

Conversation

lostmygithubaccount
Copy link
Member

@lostmygithubaccount lostmygithubaccount commented Jan 4, 2024

Description of changes

add conceptual article for the composable data ecosystem, explaining the relationship between Ibis and other key projects (Apache Arrow, ADBC, Substrait)

very WIP. some TODOs:

  • finish prose
  • formatting
  • share w/ other projects for review/feedback/contribution

I plan to finish my first pass on this ~tomorrow and share w/ other projects. some open questions:

  • is it worth mentioning Flight and FlightSQL? I kinda feel like it's confusing and focusing on ADBC as the connectivity layer is better
  • are there other projects we should mention? perhaps SQLGlot fits in here?
  • Substrait: working through the finer points of why SQL isn't sufficient and Substrait is needed

Issues closed

closes #6618

@lostmygithubaccount
Copy link
Member Author

first pass done, need to re-read and share w/ other project maintainers etc.

@lostmygithubaccount lostmygithubaccount added the docs-preview Add this label to trigger a docs preview label Jan 4, 2024
@ibis-docs-bot ibis-docs-bot bot removed the docs-preview Add this label to trigger a docs preview label Jan 4, 2024
@ibis-docs-bot
Copy link

ibis-docs-bot bot commented Jan 4, 2024

@lostmygithubaccount lostmygithubaccount marked this pull request as ready for review January 4, 2024 16:10
@lostmygithubaccount lostmygithubaccount added the docs-preview Add this label to trigger a docs preview label Jan 4, 2024
@ibis-docs-bot ibis-docs-bot bot removed the docs-preview Add this label to trigger a docs preview label Jan 4, 2024
@ibis-docs-bot
Copy link

ibis-docs-bot bot commented Jan 4, 2024

@cpcloud cpcloud added this to the 8.0 milestone Jan 5, 2024
@cpcloud cpcloud added the docs Documentation related issues or PRs label Jan 5, 2024
Copy link
Member

@cpcloud cpcloud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you!

@cpcloud cpcloud merged commit d78a887 into ibis-project:main Jan 5, 2024
21 checks passed

[Apache Arrow Database Connectivity
(ADBC)](https://arrow.apache.org/docs/format/ADBC.html) is a relatively new
standard for database connectivity. It is a low-level protocol for exchanging
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
standard for database connectivity. It is a low-level protocol for exchanging
standard for database connectivity. It is an API for exchanging

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah whoops, I didn't get to this in time

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll make a PR to update

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR here: #7941

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Documentation related issues or PRs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

docs: conceptual explanation of Ibis, ADBC, Substrait relationships
3 participants