Skip to content

Releases

ADBC Driver Foundry Driver for Apache Spark 0.4.0 (2026-11-11)

Choose a tag to compare

@github-actions github-actions released this 11 Nov 04:50
Immutable release. Only release title and notes can be modified.
17d6c34

New Features

  • add logical plan passthrough for Spark Connect (#120)
  • add a streaming Spark Connect client (#101)
  • enable win-arm64 build (#111)

Bug Fixes

  • don't include URI in errors (#115)
  • list only the schema's own tables over Thrift (#113)

Detailed Changelog

  • 17d6c34: feat(go): add logical plan passthrough for Spark Connect (#120)
  • d505841: refactor(go): address some nits (#118)
  • 8673d73: refactor(go): remove now-unused Spark Connect client (#117)
  • a03b118: chore: update workflows and go, pixi, pre-commit dependencies (#121)
  • 283fda3: feat(go): add a streaming Spark Connect client (#101)
  • db69261: fix: don't include URI in errors (#115)
  • 2502e45: test(go): add Spark 4.2, 4.3 to test matrix (#114)
  • 1d6d96c: fix(go): list only the schema's own tables over Thrift (#113)
  • 5c09bac: feat: enable win-arm64 build (#111)
  • 10cb338: test: update tested Spark versions (#110)

ADBC Driver Foundry Driver for Apache Spark 0.3.0 (2026-10-22)

Choose a tag to compare

@github-actions github-actions released this 22 Oct 18:58
Immutable release. Only release title and notes can be modified.
a8a8461

New Features

  • support dictionary-encoded bulk ingestion (#108)

Bug Fixes

  • keep listing tables when DESCRIBE TABLE fails (#103)

Detailed Changelog

  • a8a8461: feat(go): support dictionary-encoded bulk ingestion (#108)
  • d172a74: chore: update workflows and go, pixi, pre-commit dependencies (#106)
  • 3728919: chore: update workflows and go, pixi, pre-commit dependencies (#105)
  • 7ce8a42: fix(go): keep listing tables when DESCRIBE TABLE fails (#103)

ADBC Driver Foundry Driver for Apache Spark 0.2.2 (2026-10-14)

Choose a tag to compare

@github-actions github-actions released this 14 Oct 18:43
Immutable release. Only release title and notes can be modified.
9204b1a

Bug Fixes

  • map gRPC status codes to ADBC statuses (#99)

Detailed Changelog

  • 9204b1a: chore: update workflows and go, pixi, pre-commit dependencies (#95)
  • e2d0b65: refactor(go): move the Spark Connect protos out of connectclient (#100)
  • 2685b99: fix(go): map gRPC status codes to ADBC statuses (#99)
  • 1532d80: test: update validation suite (#94)
  • de01c88: chore: replace MinIO with Silo (#93)

ADBC Driver Foundry Driver for Apache Spark 0.2.1 (2026-09-09)

Choose a tag to compare

@github-actions github-actions released this 10 Sep 16:51
Immutable release. Only release title and notes can be modified.
fd9a465

Detailed Changelog

  • fd9a465: ci(go): build shared Docker images and push to ghcr.io (#90)
  • 373a4c0: ci(go): use our own hive images (#89)
  • eb4ca58: chore: update workflows and go dependencies (#88)
  • 37c381e: chore: update workflows and go dependencies (#87)

ADBC Driver Foundry Driver for Apache Spark 0.2.0 (2026-08-18)

Choose a tag to compare

@github-actions github-actions released this 19 Aug 00:31
Immutable release. Only release title and notes can be modified.
7ddf6f6

New Features

  • support Microsoft Fabric Lakehouse with Livy (#78)

Documentation Updates

  • remove prerelease from spark driver (#79)

Detailed Changelog

  • 7ddf6f6: chore(go): bump go and build tools (#86)
  • e31ee31: chore(go): use modernized build config (#85)
  • eb777ea: test: update validation suite (#84)
  • b9dbb8f: ci: terminate EMR session after CI run (#83)
  • ba8cafd: feat(go): support Microsoft Fabric Lakehouse with Livy (#78)
  • 31a3228: ci: fix repo name and regenerate (#82)
  • 055be0f: chore(go): bump google.golang.org/grpc from 1.82.0 to 1.82.1 (#81)
  • c570668: docs: remove prerelease from spark driver (#79)

ADBC Driver Foundry Driver for Apache Spark 0.1.0 (2026-07-20)

Choose a tag to compare

@github-actions github-actions released this 20 Jul 23:07
Immutable release. Only release title and notes can be modified.
1993577

New Features

  • implement GetTableSchema (#73)
  • add option to set catalog on initial connect (#70)
  • add basic support for Azure Synapse Analytics (#67)

Bug Fixes

  • implement and test alternate catalogs/schemas (#76)
  • guard against panic in Livy (#72)

Documentation Updates

  • update docs generator (#74)

Detailed Changelog

  • 1993577: test(go): fix EMR (#77)
  • a633977: fix(go): implement and test alternate catalogs/schemas (#76)
  • c72488d: test(go): unskip fixed_size_binary for Connect (#75)
  • 5fdf0dd: docs: update docs generator (#74)
  • b6a1424: feat(go): implement GetTableSchema (#73)
  • e823a8c: fix(go): guard against panic in Livy (#72)
  • 3ac1cad: test(go): run validation against Iceberg catalog (#71)
  • b26262e: feat(go): add option to set catalog on initial connect (#70)
  • 97fc6c0: test(go): add Spark 4.1 to the test matrix (#69)
  • 725ce9e: feat(go): add basic support for Azure Synapse Analytics (#67)
  • e3ceacb: test(go): enable testing against Amazon EMR (#66)
  • be0598d: test(go): configure validation tests for EMR (#65)
  • 61eff2f: test(go): add remaining overrides for EMR (#64)

ADBC Driver Foundry Driver for Apache Spark 0.1.0a3 (2026-07-10)

Choose a tag to compare

@github-actions github-actions released this 10 Jul 17:41
Immutable release. Only release title and notes can be modified.
50eeed6

New Features

  • properly release Connect session on disconnect (#63)
  • add spark.ingest.location option, improve EMR testing (#60)
  • basic Spark Connect/AWS EMR compatibility (#58)
  • improve Livy/AWS EMR compatibility (#55)

Bug Fixes

  • accept auth_type=none for Livy (#53)
  • accept no username with Spark Connect and auth_type=none (#54)

Documentation Updates

  • document more Livy caveats (#56)

Detailed Changelog

  • 50eeed6: feat(go): properly release Connect session on disconnect (#63)
  • 455306a: test(go): override queries with EMR-specific syntax (#62)
  • 546ee86: chore(go): regenerate workflows, bump go version and dependencies (#61)
  • 9b7abcb: feat(go): add spark.ingest.location option, improve EMR testing (#60)
  • ec2780b: refactor(go): get rid of param -> string -> param round trip (#59)
  • 58648ed: feat(go): basic Spark Connect/AWS EMR compatibility (#58)
  • ef0f88d: refactor(go): vendor spark-connect-go in preparation for fork (#57)
  • 5cd30df: docs(go): document more Livy caveats (#56)
  • b89872d: feat(go): improve Livy/AWS EMR compatibility (#55)
  • 727e829: fix(go): accept auth_type=none for Livy (#53)
  • bf35c28: fix(go): accept no username with Spark Connect and auth_type=none (#54)

ADBC Driver Foundry Driver for Apache Spark 0.1.0a2 (2026-06-03)

Choose a tag to compare

@github-actions github-actions released this 03 Jun 02:53
53f3a4b

New Features

  • allow configuring S3 endpoint for ingest (#49)
  • parse username/password from URI (#48)
  • support TLS configuration (#46)
  • include backend name in version (#42)
  • add support for Spark 3.5 + Livy (#41)
  • implement GetObjects for Spark Connect (#37)
  • support 'spark://' scheme (#35)
  • implement columns in GetObjects (#29)
  • implement vendor version via Thrift GetInfo (#25)
  • Add Spark Connect client implementation (#20)

Bug Fixes

  • don't hardcode minio test credentials (#50)
  • also enable thrift+http path (#44)
  • properly release memory internally (#33)
  • return proper error code from SetOption (#23)
  • transport wrap order (#17)
  • Don't require AWS region (#16)

Documentation Updates

  • note limitations on Amazon EMR compatibility (#51)
  • improve type table and docs (#43)

Detailed Changelog

  • 53f3a4b: docs: note limitations on Amazon EMR compatibility (#51)
  • 7e084b5: fix(go): don't hardcode minio test credentials (#50)
  • 38b98b9: feat(go): allow configuring S3 endpoint for ingest (#49)
  • 4c00fce: feat(go): parse username/password from URI (#48)
  • c78a4c0: chore: check over repo standards (#47)
  • 0a4227d: feat(go): support TLS configuration (#46)
  • a88676b: test(go): at least exercise all auth methods (#45)
  • 53df5dc: fix(go): also enable thrift+http path (#44)
  • 2da58e5: docs: improve type table and docs (#43)
  • da4d215: feat(go): include backend name in version (#42)
  • f56b1ce: feat(go): add support for Spark 3.5 + Livy (#41)
  • e39eecf: test(go): override remaining cases for Spark Connect (#40)
  • 73cc2fc: test(go): override timestamp cases for Spark Connect (#39)
  • abdce27: feat(go): implement GetObjects for Spark Connect (#37)
  • 8a45aac: test(go): set up Spark Connect test config (#36)
  • ddd09f0: feat(go): support 'spark://' scheme (#35)
  • 5e77373: test(go): get Go validation to pass (#34)
  • 02c1e22: fix(go): properly release memory internally (#33)
  • 5828b2f: test(go): get validation tests passing (#31)
  • 447c18f: test(go): test against Spark 3.5 and Spark 4 (#30)
  • 84544fe: feat(go): implement columns in GetObjects (#29)
  • 07ebe4d: test(go): skip/override some ingest cases (#28)
  • 8801084: test(go): re-enable minio/ingest in validation (#27)
  • fe2ae64: chore: add pytest.ini/fix NOTICE.txt (#26)
  • 3efc7a2: feat(go): implement vendor version via Thrift GetInfo (#25)
  • a273f34: test(go): fix minor validation config issues (#24)
  • 75394ea: fix(go): return proper error code from SetOption (#23)
  • 4b5a7b8: chore: update conftest.py to use platform file extension (#7)
  • 07177de: refactor(go): upgrade driverbase, arrow-go, other dependencies (#22)
  • f197221: test(go): update validation suite [still failing] (#21)
  • cbc578d: feat(go): Add Spark Connect client implementation (#20)
  • b810d05: chore(go): Docker compose setup for Spark Connect (#19)
  • f3c816f: chore(go): update CI, fix lints, license headers (#18)
  • 6c19e6d: fix(go): transport wrap order (#17)
  • 2d1a6bb: fix(go): Don't require AWS region (#16)
  • 378008e: chore(go): docker compose setup improvements (#15)
  • 7e4bf64: chore(go): Inline sasl-go as internal/sasl (#14)
  • a272520: ci: add Go workflows (#12)
  • 6b394df: chore: update repo to standards (#11)

ADBC Driver Foundry Driver for Apache Spark 0.1.0a1 (2026-06-01)

Choose a tag to compare

@github-actions github-actions released this 01 Jun 08:05
c78a4c0

New Features

  • support TLS configuration (#46)
  • include backend name in version (#42)
  • add support for Spark 3.5 + Livy (#41)
  • implement GetObjects for Spark Connect (#37)
  • support 'spark://' scheme (#35)
  • implement columns in GetObjects (#29)
  • implement vendor version via Thrift GetInfo (#25)
  • Add Spark Connect client implementation (#20)

Bug Fixes

  • also enable thrift+http path (#44)
  • properly release memory internally (#33)
  • return proper error code from SetOption (#23)
  • transport wrap order (#17)
  • Don't require AWS region (#16)

Documentation Updates

  • improve type table and docs (#43)

Detailed Changelog

  • c78a4c0: chore: check over repo standards (#47)
  • 0a4227d: feat(go): support TLS configuration (#46)
  • a88676b: test(go): at least exercise all auth methods (#45)
  • 53df5dc: fix(go): also enable thrift+http path (#44)
  • 2da58e5: docs: improve type table and docs (#43)
  • da4d215: feat(go): include backend name in version (#42)
  • f56b1ce: feat(go): add support for Spark 3.5 + Livy (#41)
  • e39eecf: test(go): override remaining cases for Spark Connect (#40)
  • 73cc2fc: test(go): override timestamp cases for Spark Connect (#39)
  • abdce27: feat(go): implement GetObjects for Spark Connect (#37)
  • 8a45aac: test(go): set up Spark Connect test config (#36)
  • ddd09f0: feat(go): support 'spark://' scheme (#35)
  • 5e77373: test(go): get Go validation to pass (#34)
  • 02c1e22: fix(go): properly release memory internally (#33)
  • 5828b2f: test(go): get validation tests passing (#31)
  • 447c18f: test(go): test against Spark 3.5 and Spark 4 (#30)
  • 84544fe: feat(go): implement columns in GetObjects (#29)
  • 07ebe4d: test(go): skip/override some ingest cases (#28)
  • 8801084: test(go): re-enable minio/ingest in validation (#27)
  • fe2ae64: chore: add pytest.ini/fix NOTICE.txt (#26)
  • 3efc7a2: feat(go): implement vendor version via Thrift GetInfo (#25)
  • a273f34: test(go): fix minor validation config issues (#24)
  • 75394ea: fix(go): return proper error code from SetOption (#23)
  • 4b5a7b8: chore: update conftest.py to use platform file extension (#7)
  • 07177de: refactor(go): upgrade driverbase, arrow-go, other dependencies (#22)
  • f197221: test(go): update validation suite [still failing] (#21)
  • cbc578d: feat(go): Add Spark Connect client implementation (#20)
  • b810d05: chore(go): Docker compose setup for Spark Connect (#19)
  • f3c816f: chore(go): update CI, fix lints, license headers (#18)
  • 6c19e6d: fix(go): transport wrap order (#17)
  • 2d1a6bb: fix(go): Don't require AWS region (#16)
  • 378008e: chore(go): docker compose setup improvements (#15)
  • 7e4bf64: chore(go): Inline sasl-go as internal/sasl (#14)
  • a272520: ci: add Go workflows (#12)
  • 6b394df: chore: update repo to standards (#11)