Skip to content

Releases: dforsber/glue-table-cache

v0.9.21

Choose a tag to compare

@dforsber dforsber released this 23 Jan 09:31
  • Remove debug dependency

v0.9.19

Choose a tag to compare

@dforsber dforsber released this 20 Jan 15:20

Try fixing cjs stuff.

v0.9.18

Choose a tag to compare

@dforsber dforsber released this 20 Jan 14:50

Icebergs, Mutexes, Retries, Baylies, ..

  • Adding support for reading Iceberg Glue Tables
  • Using async-mutex, async-retry to avoid banging the AWS APIs with concurrent requests for the same resource; bailing out on unrecoverable errors (40x)

v0.9.17

Choose a tag to compare

@dforsber dforsber released this 18 Jan 11:47

🚀 New optional proxyAddress parameter for enabling local S3 Object caching

Add new optional parameter proxyAddress (e.g. http://locahost:3203/). When present the S3 URLs will be replaced with URLs pointing to the proxy address.

With proxyAddress: "http://localhost:3203" set, DuckDB fetches the S3 Objects from e.g. http://localhost:3203/BUCKET/PREFIX address instead of s3://BUCKET/PREFIX.

Discussion about proxy Implementations

The proxy should be transparent proxy towards S3.

An example implementation could for example download S3 Objects to local /tmp folder whenever requested. This reduces S3 API calls, but more importantly makes the DuckDB's Glue Table access like reading local files instead of running lots of round trip requests, which increases performance tenfolds.

v0.9.16

Choose a tag to compare

@dforsber dforsber released this 17 Jan 14:07
  • streamline naming conventions

v0.9.15

Choose a tag to compare

@dforsber dforsber released this 17 Jan 07:20
  • when Glue Table is empty, return empty table
  • fixes and better test coverage

v0.9.14

Choose a tag to compare

@dforsber dforsber released this 16 Jan 21:02
  • cleanup after AI hallusinations, sigh

v0.9.13

Choose a tag to compare

@dforsber dforsber released this 16 Jan 19:17
  • fix var name bug in AST

v0.9.12

Choose a tag to compare

@dforsber dforsber released this 16 Jan 19:02
  • Update view name generation to not include dashes

v0.9.11

Choose a tag to compare

@dforsber dforsber released this 16 Jan 18:56
  • Generate SQL VARIABLES without dashes