Package pg_duckdb for review

[olirice]

This task is to package (but not ship) pg_duckdb to evaluate it locally and check interop with Supabase S3 compatible Storage

[samrose]

This is in process about 70%

Ran into some issues with the Makefile assumptions about deps and installation, and so will need to patch that on build

[docteurklein]

Hi! Are you writing a nix derivation for pg_duckdb? Because I tried here without success.

The compilation works fine, but the installPhase seems to fail with:

pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/mkdir -p '/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/share/postgresql/extension'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/mkdir -p '/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/share/postgresql/extension'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/install -c -m 755  pg_duckdb.so '/nix/store/r0kvgrg6j84jwva3vcisvc6ggwbvwmi4-postgresql-16.2-lib/lib/pg_duckdb.so'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/install: cannot create regular file '/nix/store/r0kvgrg6j84jwva3vcisvc6ggwbvwmi4-postgresql-16.2-lib/lib/pg_duckdb.so': Permission denied
pg_duckdb> make: *** [/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/lib/pgxs/src/makefiles/../../src/Makefile.shlib:422: install-lib-shared] Error 1

[riderx]

I'm waiting for this like Christmas 🎄

[samrose]

This is packaged. Closing. Thanks for feedback folks!

[riderx]

When can we expect that to be released @samrose ?

[samrose]

When can we expect that to be released @samrose ?

No ETA yet. We needed to package to evaluate. But we’ll be sure to announce if we end up using this!

[riderx]

Understand, could we have maybe issue to track progress on that ?
Generally any columnar db truely open source will solve my problem as user pf supabase cloud

[reveritas]

Commenting as it's been a few months, and I echo the sentiment that having a columnar storage extension for the managed Supabase offering would be amazing. It would really reduce storage costs and increase the performance for large analytical workloads. Is there any update about the extension being made available?

[riderx]

I got taught that will arrive soon

[reveritas]

Hopefully "soon" means very soon! I've been evaluating the process of self-hosting Supabase just to integrate pg_duckdb, but if this is in the works I'll stick with the cloud offering for now.