Skip to content

Conversation

@jackye1995
Copy link
Contributor

@jackye1995 jackye1995 commented Jan 17, 2026

Fixing hanging Spark test: lance-format/lance-spark#177

Without this fix, the additioanl azure and gcp dependencies in credentials vending featrues pulled in native-tls, which requires installing openssl 1.1. When not present, Spark hangs because rust execution fails in a separated thread and it fails silently, and then a semaphore keeps waiting for result.

For why it fails silently rather than propagating back, that's another fix needed in Spark, but should not block the release of 2.0.0

@github-actions github-actions bot added bug Something isn't working python java labels Jan 17, 2026
@github-actions
Copy link
Contributor

PR Review

Summary: This PR removes credential vending features (credential-vendor-aws, credential-vendor-gcp, credential-vendor-azure) from Python and Java bindings to fix a hanging Spark test caused by OpenSSL 1.1 dependency issues.

Assessment

No P0/P1 issues identified. The change is straightforward:

  • Removes optional credential vending features from lance-namespace-impls in both Python and Java bindings
  • Lock file changes are routine version bumps

One consideration

The PR disables credential vending features without providing an alternative. From the PR description, this is intentional for the 2.0.0 release to avoid the OpenSSL compatibility issue. However:

  • Is this a temporary workaround or permanent change? If temporary, consider adding a comment or tracking issue.
  • Impact on users: Users relying on credential vending through Python/Java bindings will lose this functionality. Ensure this is documented in release notes.

The core REST functionality remains enabled, so basic namespace operations should still work.

Verdict

✅ LGTM for merge - the fix addresses a real blocking issue for the release.

@bryanck
Copy link
Contributor

bryanck commented Jan 17, 2026

This also fixes an issue we are running into involving native-tls, where CA certs aren't loaded.

@bryanck bryanck self-requested a review January 17, 2026 02:07
Copy link
Contributor

@jtuglu1 jtuglu1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This fixes rest namespace for us

@jackye1995 jackye1995 merged commit b65e2cd into lance-format:main Jan 17, 2026
21 checks passed
jackye1995 added a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
…lance-format#5737)

Fixing hanging Spark test:
lance-format/lance-spark#177

Without this fix, the additioanl azure and gcp dependencies in
credentials vending featrues pulled in native-tls, which requires
installing openssl 1.1. When not present, Spark hangs because rust
execution fails in a separated thread and it fails silently, and then a
semaphore keeps waiting for result.

For why it fails silently rather than propagating back, that's another
fix needed in Spark, but should not block the release of 2.0.0
Xuanwo pushed a commit that referenced this pull request Jan 26, 2026
…#5737)

Fixing hanging Spark test:
lance-format/lance-spark#177

Without this fix, the additioanl azure and gcp dependencies in
credentials vending featrues pulled in native-tls, which requires
installing openssl 1.1. When not present, Spark hangs because rust
execution fails in a separated thread and it fails silently, and then a
semaphore keeps waiting for result.

For why it fails silently rather than propagating back, that's another
fix needed in Spark, but should not block the release of 2.0.0
jackye1995 added a commit that referenced this pull request Jan 26, 2026
…#5737)

Fixing hanging Spark test:
lance-format/lance-spark#177

Without this fix, the additioanl azure and gcp dependencies in
credentials vending featrues pulled in native-tls, which requires
installing openssl 1.1. When not present, Spark hangs because rust
execution fails in a separated thread and it fails silently, and then a
semaphore keeps waiting for result.

For why it fails silently rather than propagating back, that's another
fix needed in Spark, but should not block the release of 2.0.0
vivek-bharathan pushed a commit to vivek-bharathan/lance that referenced this pull request Feb 2, 2026
…lance-format#5737)

Fixing hanging Spark test:
lance-format/lance-spark#177

Without this fix, the additioanl azure and gcp dependencies in
credentials vending featrues pulled in native-tls, which requires
installing openssl 1.1. When not present, Spark hangs because rust
execution fails in a separated thread and it fails silently, and then a
semaphore keeps waiting for result.

For why it fails silently rather than propagating back, that's another
fix needed in Spark, but should not block the release of 2.0.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working java python

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants