Import worker uses empty SQLite database instead of migrated database (SqliteError: no such table: importStagingBookmarks)

[BinderManfred]

Environment

• Karakeep 0.31.0
• Also tested with 0.32.0 (same behaviour)
• Docker Compose
• PostgreSQL 16
• Meilisearch 1.12
• Debian 12

Docker Compose

services:
  postgres:
    image: postgres:16

  meilisearch:
    image: getmeili/meilisearch:v1.12

  karakeep:
    image: ghcr.io/karakeep-app/karakeep:0.31.0

    environment:
      DATABASE_URL: postgresql://karakeep:karakeeppass@postgres:5432/karakeep
      NEXTAUTH_SECRET: ***
      NEXTAUTH_URL: http://192.168.xxx.xxx:3000
      MEILI_HOST: http://meilisearch:7700
      MEILI_MASTER_KEY: ***

Only /data is mounted as a volume.

Problem

The container starts successfully and database migrations are executed.

However, the import worker continuously logs:

SqliteError: no such table: importStagingBookmarks

The error repeats every few seconds.

Logs

Running db migration script

...

[import] Starting import polling worker

[import] Error in polling loop:
SqliteError: no such table: importStagingBookmarks

Investigation

I inspected all SQLite databases inside the container.

The migration database contains the expected table:

/db_migrations/db.db

Using better-sqlite3:

SELECT name
FROM sqlite_master
WHERE type='table'
AND name='importStagingBookmarks';

returns:

importStagingBookmarks

However:

/app/apps/web/db.db
/app/apps/workers/db.db

do not contain this table.

In fact, both files are automatically created as empty databases:

/app/apps/web/db.db
Size: 0 bytes

/app/apps/workers/db.db
Size: 0 bytes

/db_migrations/db.db
Size: ~577 KB
Contains importStagingBookmarks

Running the same SQL query shows:

/app/apps/web/db.db
[]

/app/apps/workers/db.db
[]

/db_migrations/db.db
[ { name: 'importStagingBookmarks' } ]

Additional information

• DATABASE_URL is correctly set.
• PostgreSQL is running normally.
• Database migrations complete successfully.
• There are no SQLITE_* environment variables.
• The problem occurs on both 0.31.0 and 0.32.0.

Expected behaviour

The import worker should use the migrated SQLite database (or create the required schema automatically) instead of opening a newly created empty database.

Actual behaviour

The import worker appears to open an empty SQLite database located at:

/app/apps/workers/db.db

which results in:

SqliteError: no such table: importStagingBookmarks

and the import worker never becomes functional.

Any ideas what could cause the worker to use a different SQLite database than the migration process?

produced with Chat GPD

[MohamedBassem]

There's a bunch of problems here.

1. Karakeep doesn't use postgres, so not sure where you got this from :)
2. The fact that the web and worker processes are creating different databases means that something is screwed up in your config. you're saying you're mounting a /data dir but your docker compose sample doesn't show it. Can you please share the full compose file so that we can help you?

[BinderManfred]

As requested:

manfred-binder@manfred-binder-iMac13-1:~/karakeep$ cat docker-compose.yml
services:
postgres:
image: postgres:16
container_name: karakeep-postgres
restart: unless-stopped

environment:
  POSTGRES_DB: karakeep
  POSTGRES_USER: karakeep
  POSTGRES_PASSWORD: karakeeppass

volumes:
  - ./postgres_data:/var/lib/postgresql/data

meilisearch:
image: getmeili/meilisearch:v1.12
container_name: karakeep-meili
restart: unless-stopped

environment:
  MEILI_MASTER_KEY: ***

volumes:
  - ./meili_data:/meili_data

karakeep:
image: ghcr.io/karakeep-app/karakeep:0.31.0
container_name: karakeep
restart: unless-stopped

depends_on:
  - postgres
  - meilisearch

ports:
  - "3000:3000"

environment:
  NEXTAUTH_SECRET: ***
  NEXTAUTH_URL: http://192.168.178.192:3000

  DATABASE_URL: postgresql://karakeep:karakeeppass@postgres:5432/karakeep

  MEILI_HOST: http://meilisearch:7700
  MEILI_MASTER_KEY: ***

volumes:
  - ./data:/data

manfred-binder@manfred-binder-iMac13-1:~/karakeep$