Could not automatically diff shadow schema

[vhpx]

Bug report

Describe the bug

After launching supabase via pnpm supabase start, the following script could not be executed properly.

pnpm supabase db diff -f test

The output is as follow:

When running in debug mode, there is some unknown error at the end of the debug log:

Expected behavior

The command should result in a success message, although there are no changes to the migration scripts and the local database.

System information

• OS: Windows 11, Build 22621.1344
• Version of supabase-js: 1.42.5
• Version of Node.js: 19.7.0

[logartis]

I faced the same issue. The error starts surfacing from supabase cli version 1.42.0. Downgrading to supabase cli 1.41.6 works as a temporary workaround.

[vhpx]

The issue still exists on supabase v1.42.8.

[sweatybridge]

I suspect this has something to do with docker's host network mode support on windows. Could you help post the error log again after upgrading to 1.43.1?

[logartis]

@sweatybridge This is my log with version 1.43.1. Unfortunately looks the same to me. Let me know if posting the whole (very long) log could help. Thanks!

2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TYPE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ParseComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"BindComplete"}
2023/03/21 14:36:54 PG Recv: {"Type":"NoData"}
2023/03/21 14:36:54 PG Recv: {"Type":"CommandComplete","CommandTag":"ALTER TABLE"}
2023/03/21 14:36:54 PG Recv: {"Type":"ReadyForQuery","TxStatus":"I"}
Diffing schemas: auth,extensions,public,storage
2023/03/21 14:36:54 PG Send: {"Type":"Terminate"}
2023/03/21 14:36:54 Sent Header: Host [docker]
2023/03/21 14:36:54 Sent Header: User-Agent [Go-http-client/1.1]
2023/03/21 14:36:54 Send Done
2023/03/21 14:36:54 Recv First Byte
2023/03/21 14:36:54 Sent Header: Host [docker]
2023/03/21 14:36:54 Sent Header: User-Agent [Go-http-client/1.1]
2023/03/21 14:36:54 Sent Header: Content-Length [273]
2023/03/21 14:36:54 Sent Header: Content-Type [application/json]
2023/03/21 14:36:54 Send Done
2023/03/21 14:36:54 Recv First Byte
Error: error diffing schema:

error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

[sweatybridge]

$ docker --version
Docker version 20.10.17, build 100c701

May I check what's the output of your docker --version?

[logartis]

Hey @sweatybridge, sure thing! I am on win 10 and also included node version in case it's relevant. Thank you!

docker --version
Docker version 20.10.23, build 7155243

node --version
v16.13.1

[vhpx]

It's still an issue on v1.44.0.

The last few lines of running the same command with debug tag:

2023/03/22 12:02:54 PG Send: {"Type":"Bind","DestinationPortal":"","PreparedStatement":"","ParameterFormatCodes":null,"Parameters":[],"ResultFormatCodes":[]}
2023/03/22 12:02:54 PG Send: {"Type":"Describe","ObjectType":"P","Name":""}
2023/03/22 12:02:54 PG Send: {"Type":"Execute","Portal":"","MaxRows":0}
2023/03/22 12:02:54 PG Send: {"Type":"Sync"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"DROP FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE FUNCTION"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Severity":"NOTICE","SeverityUnlocalized":"NOTICE","Code":"00000","Message":"trigger \"update_product_units_amount_trigger\" for relation \"batch_products\" does not exist, skipping","Detail":"","Hint":"","Position":0,"InternalPosition":0,"InternalQuery":"","Where":"","SchemaName":"","TableName":"","ColumnName":"","DataTypeName":"","ConstraintName":"","File":"dropcmds.c","Line":492,"Routine":"does_not_exist_skipping","UnknownFields":null}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"DROP TRIGGER"}
2023/03/22 12:02:54 PG Recv: {"Type":"ParseComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"BindComplete"}
2023/03/22 12:02:54 PG Recv: {"Type":"NoData"}
2023/03/22 12:02:54 PG Recv: {"Type":"CommandComplete","CommandTag":"CREATE TRIGGER"}
2023/03/22 12:02:54 PG Recv: {"Type":"ReadyForQuery","TxStatus":"I"}
Diffing schemas: auth,extensions,public,storage
2023/03/22 12:02:54 PG Send: {"Type":"Terminate"}
2023/03/22 12:02:54 Sent Header: Host [docker]
2023/03/22 12:02:54 Sent Header: User-Agent [Go-http-client/1.1]
2023/03/22 12:02:54 Send Done
2023/03/22 12:02:54 Recv First Byte
2023/03/22 12:02:54 Sent Header: Host [docker]
2023/03/22 12:02:54 Sent Header: User-Agent [Go-http-client/1.1]
2023/03/22 12:02:54 Sent Header: Content-Length [275]
2023/03/22 12:02:54 Sent Header: Content-Type [application/json]
2023/03/22 12:02:54 Send Done
2023/03/22 12:02:54 Recv First Byte
Error: error diffing schema: Error response from daemon: operation is not permitted on predefined host network:

Node: v19.8.1
Docker: v20.10.23, build 7155243
Supabase CLI: v1.44.0

[sweatybridge]

Thanks for logs. I managed to reproduce and come up with a fix. Will be released in 1.45.1