Agents displaying 0 running containers

[Cesc1986]

Drydock version

v1.5.0-rc.19

What happened?

Hi,

again, great piece of software. May be due to the steep learning curve and complex setup an error on my behalf, but I see constantly single or multiple agents reporting 0 running containers, even though there are runnig containers on that machine. I couldn't detect a pattern, its sometimes agent 1, sometimes agent 2, sometimes agent 3, sometimes all are working. All agents have exactly the same configuration, password, PATs, etc.

Take this case, only my host "apps" is reporting 0 containers running.

This is strange, as the actual drydock agent running on this machine is detecting 25 containers. When I restart the local host machine, I think I have observed that all 3 agents are reporting the correct amount of containers as running.

[08:00:49.187] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[08:00:49.222] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[08:00:49.228] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[08:00:49.230] WARN (drydock/7): local_immich_redis - No Registry Provider found

[08:00:49.617] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_postgres"}

[08:00:54.082] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[08:00:57.269] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[08:01:00.814] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[08:01:00.833] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[08:01:09.192] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_server"}

[08:01:18.326] INFO (drydock/7): Cron finished (25 containers watched, 3 errors, 13 available updates) {"component":"watcher.docker.local"}

[08:58:16.691] INFO (drydock/7): Controller drydock with ip ::ffff:192.168.11.42 disconnected. {"component":"agent-api-event"}

[08:58:19.033] INFO (drydock/7): Controller drydock with ip ::ffff:192.168.11.42 connected. {"component":"agent-api-event"}

[09:00:25.761] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[09:00:25.794] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[09:00:25.796] WARN (drydock/7): local_immich_redis - No Registry Provider found

[09:00:25.805] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[09:00:34.260] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_server"}

[09:00:41.380] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[09:00:57.441] INFO (drydock/7): Cron finished (25 containers watched, 2 errors, 14 available updates) {"component":"watcher.docker.local"}

[10:00:42.363] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[10:00:42.403] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[10:00:42.405] WARN (drydock/7): local_immich_redis - No Registry Provider found

[10:00:42.407] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[10:00:54.639] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[10:01:12.615] WARN (drydock/7): Error when processing (timeout of 30000ms exceeded) {"component":"watcher.docker.local","container":"local_n8n"}

[10:01:20.335] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_server"}

[10:01:35.610] WARN (drydock/7): Error when processing (timeout of 30000ms exceeded) {"component":"watcher.docker.local","container":"local_immich_postgres"}

[10:01:35.622] INFO (drydock/7): Cron finished (25 containers watched, 4 errors, 12 available updates) {"component":"watcher.docker.local"}

[11:00:51.790] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[11:00:51.823] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[11:00:51.825] WARN (drydock/7): local_immich_redis - No Registry Provider found

[11:00:51.834] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[11:00:56.064] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[11:01:00.882] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[11:01:01.489] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[11:01:12.865] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[11:01:31.608] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[11:01:31.618] INFO (drydock/7): Cron finished (25 containers watched, 1 errors, 14 available updates) {"component":"watcher.docker.local"}

[12:00:47.057] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[12:00:47.093] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[12:00:47.095] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[12:00:47.096] WARN (drydock/7): local_immich_redis - No Registry Provider found

[12:00:47.555] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[12:00:48.256] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_postgres"}

[12:00:53.313] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_server"}

[12:01:36.342] INFO (drydock/7): Cron finished (25 containers watched, 3 errors, 13 available updates) {"component":"watcher.docker.local"}

[13:00:50.734] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[13:00:50.770] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[13:00:50.771] WARN (drydock/7): local_immich_redis - No Registry Provider found

[13:00:50.780] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[13:00:57.355] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[13:01:21.614] INFO (drydock/7): Cron finished (25 containers watched, 1 errors, 14 available updates) {"component":"watcher.docker.local"}

[14:00:22.629] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[14:00:22.664] WARN (drydock/7): immich_postgres: Cannot get a reliable tag for this image [ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23] {"component":"watcher.docker.local"}

[14:00:22.666] WARN (drydock/7): immich_redis: Cannot get a reliable tag for this image [docker.io/valkey/valkey:9@sha256:3b55fbaa0cd93cf0d9d961f405e4dfcc70efe325e2d84da207a0a8e6d8fde4f9] {"component":"watcher.docker.local"}

[14:00:22.668] WARN (drydock/7): local_immich_redis - No Registry Provider found

[14:00:24.511] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:24.527] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:24.859] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:24.980] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:26.754] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:32.854] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_server"}

[14:00:33.549] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_postgres"}

[14:00:44.996] WARN (drydock/7): Error when processing (Request failed with status code 429) {"component":"watcher.docker.local","container":"local_immich_machine_learning"}

[14:00:47.749] WARN (drydock/7): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[14:00:52.887] WARN (drydock/7): Error when processing (timeout of 30000ms exceeded) {"component":"watcher.docker.local","container":"local_paperless-ngx-db"}

[14:00:56.465] WARN (drydock/7): Error when processing (timeout of 30000ms exceeded) {"component":"watcher.docker.local","container":"local_n8n-postgres"}

[14:00:56.476] INFO (drydock/7): Cron finished (25 containers watched, 5 errors, 11 available updates) {"component":"watcher.docker.local"}

Please note, I have valid PATs for github and dockerhub, so another topic is the constant timeouts that I find confusing still.

What did you expect?

This is a better view where all containers are shown as running. I achieved this by restarting the drydock host where I run the UI on. Please note: The amound of 48 running containers on local is not correct, that's actually the sum of all containers across all agents / local...

Steps to reproduce

1. Install drydock incl. agents
2. set them up via docker:
3. Use it and see inconsistent reporting of running containers

Host

   environment:
      - DD_WATCHER_LOCAL_HOST=socket-proxy
      - DD_WATCHER_LOCAL_PORT=2375
      # --- Remote agent connection ---
      - DD_AGENT_APPS_HOST=192.168.11.43
      - DD_AGENT_APPS_PORT=3030
      - DD_AGENT_APPS_SECRET=secret!
      - DD_AGENT_ML_HOST=192.168.11.44
      - DD_AGENT_ML_PORT=3000
      - DD_AGENT_ML_SECRET=secret!
      - DD_AGENT_TEST_HOST=192.168.11.49
      - DD_AGENT_TEST_PORT=3000
      - DD_AGENT_TEST_SECRET=secret!

Agents (one has a different port set up)

    environment:
      # Must match controller's DD_AGENT_REMOTE1_SECRET
      - DD_AGENT_SECRET=secret!
      # Watcher — discovers containers on this host
      - DD_WATCHER_LOCAL_HOST=drydock-socket-proxy
      - DD_WATCHER_LOCAL_PORT=2375

Installation method

Docker Compose

Docker version

28.0.1

OS / Architecture

No response

[s-b-e-n-s-o-n]

Thanks for the thorough write-up @Cesc1986. I went through every symptom in your report and they map to several distinct bugs, most of which are already fixed in v1.5.0-rc.20 (just released — ghcr.io/codeswhat/drydock:1.5.0-rc.20). Triage below.

1. Agents intermittently showing "0 running containers" — fixed in rc.20

This was a real bug. The Docker watcher on an agent calls await this.getContainers() to enumerate via the local socket / socket-proxy. If that call ever throws (transient socket-proxy hiccup, daemon restart, brief network blip), the warning was logged but the watch cycle still emitted a dd:watcher-snapshot SSE event to the controller with containers: []. The controller treats the snapshot as authoritative — pruneOldContainers([], watcherName) then wipes every container for that agent's watcher from the controller's store. Your agent's own store is untouched (which is why the agent's next cron still logs "25 containers watched"), but the controller UI shows 0 until either the next clean cron lands or you restart the controller (re-handshake re-fetches the agent's full container list).

Fixed in 4cd6b8be: when container enumeration fails, the watch cycle now skips the snapshot emit so the controller preserves its last-known state across transient enumeration errors. Per-container lifecycle events still fire normally; only the empty-list-prune-everything path is closed.

2. Cannot get a reliable tag for image:tag@sha256:digest (immich_postgres, immich_redis) — fixed in rc.20

Hybrid refs like ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf6… were being diverted to a digest-only path that discarded the explicit tag, then logged that warning on every cron. Fixed in the rc.20 #342 follow-ups (commit b40d3db8 for the parser + cell render, see app/watchers/providers/docker/Docker.ts:1409). The Containers table now shows the tag + the short digest delta below it for these images.

3. local_immich_redis - No Registry Provider found — fixed in rc.20

Direct fallout from #2: when the hybrid parser bailed to the digest-only path, the registry-domain context (docker.io, ghcr.io) was lost so the router couldn't find a provider. Fixed by the same hybrid parser change.

4. Docker Hub 429s despite a valid PAT — fixed in rc.20

This is the root cause of your "constant timeouts" frustration. There were two compounding bugs:

• Routing bug (069274fe): when you configured a PAT but the system also auto-seeded an anonymous <provider>.public default instance, non-deterministic Object.values().find() routing could pick the anonymous instance — sending all your traffic through the unauthenticated rate-limit tier despite your valid token. The router now gives explicit priority to credentialed instances and the silent fallback to anonymous on 401/403 is gone; auth rejection surfaces as the "Check failed" badge in the UI instead.
• No retry / no rate-limit awareness (ffd1b57b): every registry HTTP call now goes through a withRetry wrapper that honors the upstream Retry-After header (seconds + HTTP-date forms) with exponential backoff up to 3 retries, and acquires a slot from a per-host token bucket (Hub default 2 req/s burst-5, GHCR 5 req/s burst-10) so the watcher can't self-inflict 429s during a large cron cycle.

5. GitHub release notes lookup is rate-limited — partially fixed in rc.20

The same ffd1b57b wires the GHCR PAT fallback into the GitHub release-notes provider, so if you have a GHCR PAT (DD_REGISTRY_GHCR_*_TOKEN) you get release-notes auth for free without setting a separate token. If you only have a Docker Hub PAT — not a GitHub PAT — set DD_RELEASE_NOTES_GITHUB_TOKEN=<a github PAT> to authenticate the api.github.com calls; that lifts the 60 req/hr unauthenticated ceiling to 5000 req/hr.

6. 30s axios timeouts (local_n8n, local_paperless-ngx-db, …)

These are almost entirely downstream of #4 — once a Hub registry call hits a 429, the previous behavior tried to retry within the 30 s axios deadline and frequently ran the clock out. With the routing fix + token bucket the upstream calls don't get rate-limited in the first place, so these timeouts should drop dramatically on rc.20. If you still see them on rc.20 after a couple of cron cycles, please reopen with fresh logs and we'll go deeper.

7. "48 running containers on Local" looking like the sum across all agents

This one I want to confirm with you before declaring a bug. The dashboard widget keys server rows on container.agent || container.watcher || 'Local' (see deriveServer in ui/src/utils/container-mapper.ts:204). For containers coming from an agent, AgentClient.buildContainerReport mutates container.agent = this.name before any prune/emit, so agent containers shouldn't bucket into Local. If they were, your per-agent rows (apps/ml/test) would all show 0, but you're saying those rows are correct after the restart.

The most likely explanation is that the local controller host genuinely has ~48 of its own containers and the equality with the sum is coincidence. Could you check curl http://<controller>:3000/api/v1/containers | jq '.[] | {name, agent, watcher, server}' and report whether the containers showing up under "Local" in the widget have agent set (which would point to a render bug) or agent: null (which means they really are local-watcher containers)?

---

Action: please pull ghcr.io/codeswhat/drydock:1.5.0-rc.20 (or :latest, which now points at rc.20), and run for a day or so on your 3-agent topology. If you still see the 0-containers symptom — or the "Local: 48" miscount turns out to be a real bug — comment here with logs and I'll keep digging. Otherwise, since #1-#6 should all be fixed, we can close this and split off any remaining symptom into its own issue.

[Cesc1986]

Thank you again for the detailed response - I feel rc20 is a step back. I have multipe problems.

1. it seems now https is required. You cant bypass this (a flag would be good), luckily I have a reverse proxy running but I see this beeing an unnecessary burdle in a local network.
2. Other breaking change, now new env variable is needed: - DD_SESSION_SECRET - not documented in the release notes / docs and I dont understand what the purposes is for this
3. No connections are basically working now, this is the view on my host. No containers are displayed even though they are all detected on the agent machines.

Drydock host logs

[19:10:20.860] INFO (drydock/6): Register all components of kind registry for provider codeberg {"component":"registry"}

[19:10:20.862] INFO (drydock/6): Register all components of kind registry for provider dhi {"component":"registry"}

[19:10:20.863] INFO (drydock/6): Register all components of kind registry for provider docr {"component":"registry"}

[19:10:20.864] INFO (drydock/6): Register all components of kind registry for provider ecr {"component":"registry"}

[19:10:20.869] INFO (drydock/6): Register all components of kind registry for provider gar {"component":"registry"}

[19:10:20.870] INFO (drydock/6): Register all components of kind registry for provider gcr {"component":"registry"}

[19:10:20.871] INFO (drydock/6): Register all components of kind registry for provider ghcr {"component":"registry"}

[19:10:20.872] INFO (drydock/6): Register all components of kind registry for provider hub {"component":"registry"}

[19:10:20.873] INFO (drydock/6): Register all components of kind registry for provider ibmcr {"component":"registry"}

[19:10:20.874] INFO (drydock/6): Register all components of kind registry for provider lscr {"component":"registry"}

[19:10:20.874] INFO (drydock/6): Register all components of kind registry for provider mau {"component":"registry"}

[19:10:20.876] INFO (drydock/6): Register all components of kind registry for provider ocir {"component":"registry"}

[19:10:20.876] INFO (drydock/6): Register all components of kind registry for provider quay {"component":"registry"}

[19:10:20.877] INFO (drydock/6): Register all components of kind registry for provider trueforge {"component":"registry"}

[19:10:20.938] INFO (drydock/6): Register with configuration {} {"component":"registry.dhi.public"}

[19:10:20.938] INFO (drydock/6): Register with configuration {} {"component":"registry.ecr.public"}

[19:10:20.939] INFO (drydock/6): Register with configuration {} {"component":"registry.gar.public"}

[19:10:20.939] INFO (drydock/6): Register with configuration {"0":"g","1":"h","2":"p","3":"_","4":"z","5":"a","6":"9","7":"R","8":"6","9":"I","10":"9","11":"K","12":"6","13":"m","14":"O","15":"U","16":"B","17":"u","18":"G","19":"E","20":"D","21":"M","22":"y","23":"m","24":"L","25":"1","26":"I","27":"h","28":"5","29":"X","30":"m","31":"a","32":"B","33":"7","34":"0","35":"d","36":"B","37":"i","38":"B","39":"k"} {"component":"registry.ghcr.token"}

[19:10:20.940] INFO (drydock/6): Register with configuration {"0":"F","1":"r","2":"a","3":"n","4":"c","5":"i","6":"s","7":"H","8":"G","9":"R"} {"component":"registry.ghcr.username"}

[19:10:20.940] INFO (drydock/6): Register with configuration {} {"component":"registry.ghcr.public"}

[19:10:20.941] INFO (drydock/6): Register with configuration {"password":"[REDACTED]","login":"francishgr"} {"component":"registry.hub.public"}

[19:10:20.942] INFO (drydock/6): Register with configuration {} {"component":"registry.mau.public"}

[19:10:20.943] INFO (drydock/6): Register with configuration {} {"component":"registry.alicr.public"}

[19:10:20.944] INFO (drydock/6): Register with configuration {} {"component":"registry.gcr.public"}

[19:10:20.945] INFO (drydock/6): Register with configuration {} {"component":"registry.ibmcr.public"}

[19:10:20.945] INFO (drydock/6): Register with configuration {} {"component":"registry.lscr.public"}

[19:10:20.946] INFO (drydock/6): Register with configuration {} {"component":"registry.ocir.public"}

[19:10:20.946] INFO (drydock/6): Register with configuration {} {"component":"registry.quay.public"}

[19:10:20.947] INFO (drydock/6): Register with configuration {} {"component":"registry.docr.public"}

[19:10:20.947] INFO (drydock/6): Register with configuration {} {"component":"registry.trueforge.public"}

[19:10:20.948] INFO (drydock/6): Register with configuration {} {"component":"registry.codeberg.public"}

[19:10:20.993] INFO (drydock/6): Register with configuration {"host":"socket-proxy","port":2375,"socket":"/var/run/docker.sock","cron":"0 * * * *","jitter":60000,"watchbydefault":true,"watchall":false,"watchevents":true,"watchatstart":true,"maintenancewindowtz":"UTC","imgset":{},"maintenancewindowqueued":false,"authblocked":false} {"component":"watcher.docker.local"}

(node:6) [DEP0169] DeprecationWarning: `url.parse()` behavior is not standardized and prone to errors that have security implications. Use the WHATWG URL API instead. CVEs are not issued for `url.parse()` vulnerabilities.

(Use `node --trace-deprecation ...` to show where the warning was created)

[19:10:21.027] INFO (drydock/6): Cron scheduled (0 * * * *) {"component":"watcher.docker.local"}

[19:10:21.052] INFO (drydock/6): Register with configuration {"user":"admin","hash":"[REDACTED]"} {"component":"authentication.basic.admin"}

[19:10:21.054] INFO (drydock/6): Register with configuration {"port":"443","host":"agent-ml.frncs.de","secret":"[REDACTED]"} {"component":"agent.dd.ml"}

[19:10:21.054] INFO (drydock/6): Register with configuration {"secret":"[REDACTED]","port":"443","host":"agent-test.frncs.de"} {"component":"agent.dd.test"}

[19:10:21.054] INFO (drydock/6): Register with configuration {"port":"443","host":"agent-apps.frncs.de","secret":"[REDACTED]"} {"component":"agent.dd.apps"}

[19:10:21.055] INFO (drydock/6): Connecting to agent ml at https://agent-ml.frncs.de {"component":"agent-client.ml"}

[19:10:21.064] INFO (drydock/6): Connecting to agent test at https://agent-test.frncs.de {"component":"agent-client.test"}

[19:10:21.065] INFO (drydock/6): Connecting to agent apps at https://agent-apps.frncs.de {"component":"agent-client.apps"}

[19:10:21.073] INFO (drydock/6): Using session secret from DD_SESSION_SECRET environment variable

[19:10:21.089] WARN (drydock/6): Unversioned /api/* path is deprecated and will be removed in v1.6.0. Use /api/v1/* instead. {"component":"api"}

[19:10:21.104] INFO (drydock/6): Scheduled security scanning not configured (DD_SECURITY_SCAN_CRON not set) {"component":"security.scheduler"}

[19:10:21.105] INFO (drydock/6): Server listening on port 3000 (HTTP) {"component":"api"}

[19:10:21.135] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:21.143] INFO (drydock/6): Agent ml connected (version: 1.5.0-rc.20) {"component":"agent-client.ml"}

[19:10:21.153] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:21.163] INFO (drydock/6): Handshake successful. Received 5 containers. {"component":"agent-client.ml"}

[19:10:21.182] INFO (drydock/6): Register with configuration {"host":"drydock-socket-proxy","port":2375,"socket":"/var/run/docker.sock","cron":"0 * * * *","jitter":60000,"watchbydefault":true,"watchall":false,"watchevents":true,"watchatstart":true,"maintenancewindowtz":"UTC","imgset":{},"maintenancewindowqueued":false,"authblocked":false} {"component":"watcher.docker.local"}

[19:10:22.046] INFO (drydock/6): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[19:10:22.083] INFO (drydock/6): Listening to docker events {"component":"watcher.docker.local"}

[19:10:22.143] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:22.154] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:22.539] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:22.556] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:22.662] WARN (drydock/6): Error when processing (Request failed with status code 401) {"component":"watcher.docker.local","container":"local_caddy"}

[19:10:22.948] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:22.966] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:23.021] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:23.144] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:23.156] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:23.292] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:23.309] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:24.146] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:24.157] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:24.291] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:24.310] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:24.327] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:24.791] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:25.147] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:25.158] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:25.279] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:25.296] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:25.847] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:25.866] WARN (drydock/6): GitHub release notes lookup is rate-limited {"component":"release-notes.provider.github"}

[19:10:25.872] INFO (drydock/6): Cron finished (13 containers watched, 1 errors, 9 available updates) {"component":"watcher.docker.local"}

[19:10:26.149] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:26.160] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:27.151] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:27.161] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:28.152] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:28.163] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:29.154] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:29.165] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:30.156] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:30.167] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:31.157] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:31.168] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:32.158] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:32.170] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:33.159] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:33.172] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:34.160] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:34.175] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:35.163] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:35.176] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

[19:10:36.164] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.test"}

[19:10:36.178] WARN (drydock/6): SSE stream ended. Reconnecting... {"component":"agent-client.apps"}

Agent Logs:

[19:01:45.609] INFO (drydock/7): drydock is starting

[19:01:45.614] INFO (drydock/7): Init store in memory mode {"component":"store"}

[19:01:45.615] INFO (drydock/7): Create Collection app {"component":"store"}

[19:01:45.616] INFO (drydock/7): Create Collection audit {"component":"store"}

[19:01:45.617] INFO (drydock/7): Create Collection backups {"component":"store"}

[19:01:45.617] INFO (drydock/7): Create Collection containers {"component":"store"}

[19:01:45.618] INFO (drydock/7): Create Collection notifications {"component":"store"}

[19:01:45.620] INFO (drydock/7): Create Collection notifications_history {"component":"store"}

[19:01:45.620] INFO (drydock/7): Create Collection notificationOutbox {"component":"store"}

[19:01:45.621] INFO (drydock/7): Create Collection settings {"component":"store"}

[19:01:45.621] INFO (drydock/7): Create Collection updateOperations {"component":"store"}

[19:01:45.622] INFO (drydock/7): Migrate data between schema versions {"component":"store"}

[19:01:45.626] INFO (drydock/7): Skipping anonymous 'hub.public' default because credentialed instance(s) are configured {"component":"registry"}

[19:01:45.626] INFO (drydock/7): Register all components of kind registry for provider alicr {"component":"registry"}

[19:01:45.631] INFO (drydock/7): Register all components of kind registry for provider codeberg {"component":"registry"}

[19:01:45.633] INFO (drydock/7): Register all components of kind registry for provider dhi {"component":"registry"}

[19:01:45.634] INFO (drydock/7): Register all components of kind registry for provider docr {"component":"registry"}

[19:01:45.635] INFO (drydock/7): Register all components of kind registry for provider ecr {"component":"registry"}

[19:01:45.639] INFO (drydock/7): Register all components of kind registry for provider gar {"component":"registry"}

[19:01:45.640] INFO (drydock/7): Register all components of kind registry for provider gcr {"component":"registry"}

[19:01:45.641] INFO (drydock/7): Register all components of kind registry for provider ghcr {"component":"registry"}

[19:01:45.642] INFO (drydock/7): Register all components of kind registry for provider hub {"component":"registry"}

[19:01:45.643] INFO (drydock/7): Register all components of kind registry for provider ibmcr {"component":"registry"}

[19:01:45.643] INFO (drydock/7): Register all components of kind registry for provider lscr {"component":"registry"}

[19:01:45.644] INFO (drydock/7): Register all components of kind registry for provider mau {"component":"registry"}

[19:01:45.645] INFO (drydock/7): Register all components of kind registry for provider ocir {"component":"registry"}

[19:01:45.646] INFO (drydock/7): Register all components of kind registry for provider quay {"component":"registry"}

[19:01:45.647] INFO (drydock/7): Register all components of kind registry for provider trueforge {"component":"registry"}

[19:01:45.713] INFO (drydock/7): Register with configuration {} {"component":"registry.dhi.public"}

[19:01:45.714] INFO (drydock/7): Register with configuration {} {"component":"registry.ecr.public"}

[19:01:45.715] INFO (drydock/7): Register with configuration {} {"component":"registry.gar.public"}

[19:01:45.715] INFO (drydock/7): Register with configuration {"0":"g","1":"h","2":"p","3":"_","4":"z","5":"a","6":"9","7":"R","8":"6","9":"I","10":"9","11":"K","12":"6","13":"m","14":"O","15":"U","16":"B","17":"u","18":"G","19":"E","20":"D","21":"M","22":"y","23":"m","24":"L","25":"1","26":"I","27":"h","28":"5","29":"X","30":"m","31":"a","32":"B","33":"7","34":"0","35":"d","36":"B","37":"i","38":"B","39":"k"} {"component":"registry.ghcr.token"}

[19:01:45.716] INFO (drydock/7): Register with configuration {"0":"F","1":"r","2":"a","3":"n","4":"c","5":"i","6":"s","7":"H","8":"G","9":"R"} {"component":"registry.ghcr.username"}

[19:01:45.716] INFO (drydock/7): Register with configuration {} {"component":"registry.ghcr.public"}

[19:01:45.718] INFO (drydock/7): Register with configuration {"password":"[REDACTED]","login":"francishgr"} {"component":"registry.hub.public"}

[19:01:45.718] INFO (drydock/7): Register with configuration {} {"component":"registry.mau.public"}

[19:01:45.719] INFO (drydock/7): Register with configuration {} {"component":"registry.alicr.public"}

[19:01:45.720] INFO (drydock/7): Register with configuration {} {"component":"registry.gcr.public"}

[19:01:45.721] INFO (drydock/7): Register with configuration {} {"component":"registry.ibmcr.public"}

[19:01:45.722] INFO (drydock/7): Register with configuration {} {"component":"registry.lscr.public"}

[19:01:45.722] INFO (drydock/7): Register with configuration {} {"component":"registry.ocir.public"}

[19:01:45.723] INFO (drydock/7): Register with configuration {} {"component":"registry.quay.public"}

[19:01:45.724] INFO (drydock/7): Register with configuration {} {"component":"registry.docr.public"}

[19:01:45.724] INFO (drydock/7): Register with configuration {} {"component":"registry.trueforge.public"}

[19:01:45.725] INFO (drydock/7): Register with configuration {} {"component":"registry.codeberg.public"}

[19:01:45.775] INFO (drydock/7): Register with configuration {"host":"drydock-socket-proxy","port":2375,"socket":"/var/run/docker.sock","cron":"0 * * * *","jitter":60000,"watchbydefault":true,"watchall":false,"watchevents":true,"watchatstart":true,"maintenancewindowtz":"UTC","imgset":{},"maintenancewindowqueued":false,"authblocked":false} {"component":"watcher.docker.local"}

(node:7) [DEP0169] DeprecationWarning: `url.parse()` behavior is not standardized and prone to errors that have security implications. Use the WHATWG URL API instead. CVEs are not issued for `url.parse()` vulnerabilities.

(Use `node --trace-deprecation ...` to show where the warning was created)

[19:01:45.817] INFO (drydock/7): Cron scheduled (0 * * * *) {"component":"watcher.docker.local"}

[19:01:45.857] INFO (drydock/7): Agent Server listening on port 3000 (HTTP) {"component":"agent-server"}

[19:01:46.848] INFO (drydock/7): Cron started (0 * * * *) {"component":"watcher.docker.local"}

[19:01:46.874] INFO (drydock/7): Listening to docker events {"component":"watcher.docker.local"}

[19:01:47.424] WARN (drydock/7): Error when processing (Request failed with status code 401) {"component":"watcher.docker.local","container":"local_actual_pr7345"}

[19:01:51.718] INFO (drydock/7): Cron finished (5 containers watched, 1 errors, 1 available updates) {"component":"watcher.docker.local"}