Repository navigation
Releases
Releases · adbc-drivers/spark
ADBC Driver Foundry Driver for Apache Spark 0.4.0 (2026-11-11)
Immutable
release. Only release title and notes can be modified.
New Features
- add logical plan passthrough for Spark Connect (#120)
- add a streaming Spark Connect client (#101)
- enable win-arm64 build (#111)
Bug Fixes
Detailed Changelog
- 17d6c34: feat(go): add logical plan passthrough for Spark Connect (#120)
- d505841: refactor(go): address some nits (#118)
- 8673d73: refactor(go): remove now-unused Spark Connect client (#117)
- a03b118: chore: update workflows and go, pixi, pre-commit dependencies (#121)
- 283fda3: feat(go): add a streaming Spark Connect client (#101)
- db69261: fix: don't include URI in errors (#115)
- 2502e45: test(go): add Spark 4.2, 4.3 to test matrix (#114)
- 1d6d96c: fix(go): list only the schema's own tables over Thrift (#113)
- 5c09bac: feat: enable win-arm64 build (#111)
- 10cb338: test: update tested Spark versions (#110)
ADBC Driver Foundry Driver for Apache Spark 0.3.0 (2026-10-22)
ADBC Driver Foundry Driver for Apache Spark 0.2.2 (2026-10-14)
Immutable
release. Only release title and notes can be modified.
Bug Fixes
- map gRPC status codes to ADBC statuses (#99)
Detailed Changelog
- 9204b1a: chore: update workflows and go, pixi, pre-commit dependencies (#95)
- e2d0b65: refactor(go): move the Spark Connect protos out of connectclient (#100)
- 2685b99: fix(go): map gRPC status codes to ADBC statuses (#99)
- 1532d80: test: update validation suite (#94)
- de01c88: chore: replace MinIO with Silo (#93)
ADBC Driver Foundry Driver for Apache Spark 0.2.1 (2026-09-09)
Immutable
release. Only release title and notes can be modified.
ADBC Driver Foundry Driver for Apache Spark 0.2.0 (2026-08-18)
Immutable
release. Only release title and notes can be modified.
New Features
- support Microsoft Fabric Lakehouse with Livy (#78)
Documentation Updates
- remove prerelease from spark driver (#79)
Detailed Changelog
- 7ddf6f6: chore(go): bump go and build tools (#86)
- e31ee31: chore(go): use modernized build config (#85)
- eb777ea: test: update validation suite (#84)
- b9dbb8f: ci: terminate EMR session after CI run (#83)
- ba8cafd: feat(go): support Microsoft Fabric Lakehouse with Livy (#78)
- 31a3228: ci: fix repo name and regenerate (#82)
- 055be0f: chore(go): bump google.golang.org/grpc from 1.82.0 to 1.82.1 (#81)
- c570668: docs: remove prerelease from spark driver (#79)
ADBC Driver Foundry Driver for Apache Spark 0.1.0 (2026-07-20)
Immutable
release. Only release title and notes can be modified.
New Features
- implement GetTableSchema (#73)
- add option to set catalog on initial connect (#70)
- add basic support for Azure Synapse Analytics (#67)
Bug Fixes
Documentation Updates
- update docs generator (#74)
Detailed Changelog
- 1993577: test(go): fix EMR (#77)
- a633977: fix(go): implement and test alternate catalogs/schemas (#76)
- c72488d: test(go): unskip fixed_size_binary for Connect (#75)
- 5fdf0dd: docs: update docs generator (#74)
- b6a1424: feat(go): implement GetTableSchema (#73)
- e823a8c: fix(go): guard against panic in Livy (#72)
- 3ac1cad: test(go): run validation against Iceberg catalog (#71)
- b26262e: feat(go): add option to set catalog on initial connect (#70)
- 97fc6c0: test(go): add Spark 4.1 to the test matrix (#69)
- 725ce9e: feat(go): add basic support for Azure Synapse Analytics (#67)
- e3ceacb: test(go): enable testing against Amazon EMR (#66)
- be0598d: test(go): configure validation tests for EMR (#65)
- 61eff2f: test(go): add remaining overrides for EMR (#64)
ADBC Driver Foundry Driver for Apache Spark 0.1.0a3 (2026-07-10)
Immutable
release. Only release title and notes can be modified.
New Features
- properly release Connect session on disconnect (#63)
- add
spark.ingest.locationoption, improve EMR testing (#60) - basic Spark Connect/AWS EMR compatibility (#58)
- improve Livy/AWS EMR compatibility (#55)
Bug Fixes
Documentation Updates
- document more Livy caveats (#56)
Detailed Changelog
- 50eeed6: feat(go): properly release Connect session on disconnect (#63)
- 455306a: test(go): override queries with EMR-specific syntax (#62)
- 546ee86: chore(go): regenerate workflows, bump go version and dependencies (#61)
- 9b7abcb: feat(go): add
spark.ingest.locationoption, improve EMR testing (#60) - ec2780b: refactor(go): get rid of param -> string -> param round trip (#59)
- 58648ed: feat(go): basic Spark Connect/AWS EMR compatibility (#58)
- ef0f88d: refactor(go): vendor spark-connect-go in preparation for fork (#57)
- 5cd30df: docs(go): document more Livy caveats (#56)
- b89872d: feat(go): improve Livy/AWS EMR compatibility (#55)
- 727e829: fix(go): accept auth_type=none for Livy (#53)
- bf35c28: fix(go): accept no username with Spark Connect and auth_type=none (#54)
ADBC Driver Foundry Driver for Apache Spark 0.1.0a2 (2026-06-03)
New Features
- allow configuring S3 endpoint for ingest (#49)
- parse username/password from URI (#48)
- support TLS configuration (#46)
- include backend name in version (#42)
- add support for Spark 3.5 + Livy (#41)
- implement GetObjects for Spark Connect (#37)
- support 'spark://' scheme (#35)
- implement columns in GetObjects (#29)
- implement vendor version via Thrift GetInfo (#25)
- Add Spark Connect client implementation (#20)
Bug Fixes
- don't hardcode minio test credentials (#50)
- also enable thrift+http path (#44)
- properly release memory internally (#33)
- return proper error code from SetOption (#23)
- transport wrap order (#17)
- Don't require AWS region (#16)
Documentation Updates
Detailed Changelog
- 53f3a4b: docs: note limitations on Amazon EMR compatibility (#51)
- 7e084b5: fix(go): don't hardcode minio test credentials (#50)
- 38b98b9: feat(go): allow configuring S3 endpoint for ingest (#49)
- 4c00fce: feat(go): parse username/password from URI (#48)
- c78a4c0: chore: check over repo standards (#47)
- 0a4227d: feat(go): support TLS configuration (#46)
- a88676b: test(go): at least exercise all auth methods (#45)
- 53df5dc: fix(go): also enable thrift+http path (#44)
- 2da58e5: docs: improve type table and docs (#43)
- da4d215: feat(go): include backend name in version (#42)
- f56b1ce: feat(go): add support for Spark 3.5 + Livy (#41)
- e39eecf: test(go): override remaining cases for Spark Connect (#40)
- 73cc2fc: test(go): override timestamp cases for Spark Connect (#39)
- abdce27: feat(go): implement GetObjects for Spark Connect (#37)
- 8a45aac: test(go): set up Spark Connect test config (#36)
- ddd09f0: feat(go): support 'spark://' scheme (#35)
- 5e77373: test(go): get Go validation to pass (#34)
- 02c1e22: fix(go): properly release memory internally (#33)
- 5828b2f: test(go): get validation tests passing (#31)
- 447c18f: test(go): test against Spark 3.5 and Spark 4 (#30)
- 84544fe: feat(go): implement columns in GetObjects (#29)
- 07ebe4d: test(go): skip/override some ingest cases (#28)
- 8801084: test(go): re-enable minio/ingest in validation (#27)
- fe2ae64: chore: add pytest.ini/fix NOTICE.txt (#26)
- 3efc7a2: feat(go): implement vendor version via Thrift GetInfo (#25)
- a273f34: test(go): fix minor validation config issues (#24)
- 75394ea: fix(go): return proper error code from SetOption (#23)
- 4b5a7b8: chore: update conftest.py to use platform file extension (#7)
- 07177de: refactor(go): upgrade driverbase, arrow-go, other dependencies (#22)
- f197221: test(go): update validation suite [still failing] (#21)
- cbc578d: feat(go): Add Spark Connect client implementation (#20)
- b810d05: chore(go): Docker compose setup for Spark Connect (#19)
- f3c816f: chore(go): update CI, fix lints, license headers (#18)
- 6c19e6d: fix(go): transport wrap order (#17)
- 2d1a6bb: fix(go): Don't require AWS region (#16)
- 378008e: chore(go): docker compose setup improvements (#15)
- 7e4bf64: chore(go): Inline
sasl-goasinternal/sasl(#14) - a272520: ci: add Go workflows (#12)
- 6b394df: chore: update repo to standards (#11)
ADBC Driver Foundry Driver for Apache Spark 0.1.0a1 (2026-06-01)
New Features
- support TLS configuration (#46)
- include backend name in version (#42)
- add support for Spark 3.5 + Livy (#41)
- implement GetObjects for Spark Connect (#37)
- support 'spark://' scheme (#35)
- implement columns in GetObjects (#29)
- implement vendor version via Thrift GetInfo (#25)
- Add Spark Connect client implementation (#20)
Bug Fixes
- also enable thrift+http path (#44)
- properly release memory internally (#33)
- return proper error code from SetOption (#23)
- transport wrap order (#17)
- Don't require AWS region (#16)
Documentation Updates
- improve type table and docs (#43)
Detailed Changelog
- c78a4c0: chore: check over repo standards (#47)
- 0a4227d: feat(go): support TLS configuration (#46)
- a88676b: test(go): at least exercise all auth methods (#45)
- 53df5dc: fix(go): also enable thrift+http path (#44)
- 2da58e5: docs: improve type table and docs (#43)
- da4d215: feat(go): include backend name in version (#42)
- f56b1ce: feat(go): add support for Spark 3.5 + Livy (#41)
- e39eecf: test(go): override remaining cases for Spark Connect (#40)
- 73cc2fc: test(go): override timestamp cases for Spark Connect (#39)
- abdce27: feat(go): implement GetObjects for Spark Connect (#37)
- 8a45aac: test(go): set up Spark Connect test config (#36)
- ddd09f0: feat(go): support 'spark://' scheme (#35)
- 5e77373: test(go): get Go validation to pass (#34)
- 02c1e22: fix(go): properly release memory internally (#33)
- 5828b2f: test(go): get validation tests passing (#31)
- 447c18f: test(go): test against Spark 3.5 and Spark 4 (#30)
- 84544fe: feat(go): implement columns in GetObjects (#29)
- 07ebe4d: test(go): skip/override some ingest cases (#28)
- 8801084: test(go): re-enable minio/ingest in validation (#27)
- fe2ae64: chore: add pytest.ini/fix NOTICE.txt (#26)
- 3efc7a2: feat(go): implement vendor version via Thrift GetInfo (#25)
- a273f34: test(go): fix minor validation config issues (#24)
- 75394ea: fix(go): return proper error code from SetOption (#23)
- 4b5a7b8: chore: update conftest.py to use platform file extension (#7)
- 07177de: refactor(go): upgrade driverbase, arrow-go, other dependencies (#22)
- f197221: test(go): update validation suite [still failing] (#21)
- cbc578d: feat(go): Add Spark Connect client implementation (#20)
- b810d05: chore(go): Docker compose setup for Spark Connect (#19)
- f3c816f: chore(go): update CI, fix lints, license headers (#18)
- 6c19e6d: fix(go): transport wrap order (#17)
- 2d1a6bb: fix(go): Don't require AWS region (#16)
- 378008e: chore(go): docker compose setup improvements (#15)
- 7e4bf64: chore(go): Inline
sasl-goasinternal/sasl(#14) - a272520: ci: add Go workflows (#12)
- 6b394df: chore: update repo to standards (#11)