FEAT: GIL release and LOB fast-path for parallel execution#471
Closed
wiederMatan wants to merge 4 commits intomicrosoft:mainfrom
Closed
FEAT: GIL release and LOB fast-path for parallel execution#471wiederMatan wants to merge 4 commits intomicrosoft:mainfrom
wiederMatan wants to merge 4 commits intomicrosoft:mainfrom
Conversation
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Author
|
@microsoft-github-policy-service agree |
wiederMatan
changed the title
Remove CLAUDE.md, preflight_check.py, and verify_performance.py to keep the PR focused on driver performance changes. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
wiederMatan
changed the title
5 tasks
…ipts Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Contributor
|
Why did you delete the files? |
Author
|
Hi @saurabh500, my apologies for the noise on this PR. A local development CLI I was using for the migration had a critical issue with its cleanup routine, which incorrectly staged deletions for the entire repository tree in the most recent commit. I’m closing this PR now to avoid further confusion and will perform a manual restore of the environment. I'll submit a clean, verified PR once the repository structure is intact and the C++ optimizations are ready for review. Thanks for catching this. |
Contributor
|
You are not allowed to delete the mandatory files in this repo. Total execution time: 4.54 seconds |
Contributor
|
Looking forward to the re-submission. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Work Item / Issue Reference
Summary
The Problem: High-concurrency tools like dbt are bottlenecked by the GIL and slow row-by-row LOB fetching in the native driver.
The Solution:
py::call_guard<py::gil_scoped_release>for core ODBC operations (connect, execute, fetch).SQLFetchScroll(Batch Mode) for most metadata queries.std::mutex.Results: 8-thread
WAITFORtest dropped from ~16s to ~2.1s. Verified on both MacBook (Apple Silicon) and Windows (MSVC).