Skip to content

feat: support two-hop queries of the datafusion execution#20

Merged
beinan merged 3 commits into
lance-format:mainfrom
ChunxuTang:two-hop
Oct 29, 2025
Merged

feat: support two-hop queries of the datafusion execution#20
beinan merged 3 commits into
lance-format:mainfrom
ChunxuTang:two-hop

Conversation

@ChunxuTang

Copy link
Copy Markdown
Collaborator

This PR

  • adds the support of two-hop queries in the datafusion execution. It analyzes the graph query logical plan, converts it into datafusion's logical plan, and then executes the plan.
  • refactors the datafusion planner into multiple components. The implementation of the native lance planner could follow a similar pattern.
  • add two-hop query tests in the datafusion integration test.

The benchmark result (graph_bench) shows that the datafusion-based execution is ~20% slower than the current dataframe-based approach on basic node filtering/projection, but is ~10% faster on one-hop and two-hop queries.

@beinan beinan merged commit 76966d6 into lance-format:main Oct 29, 2025
9 checks passed
@ChunxuTang ChunxuTang deleted the two-hop branch November 3, 2025 01:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants