Docker Desktop failed to start, Docker CLI unable to connect correct API version.

[ssghost]

Description

Mac OS Monterey 12.7.2
Docker Desktop for Mac Intel 4.26.1
Docker Desktop GUI failed to start, always staying at "starting".
Docker CLI unable to run most of the common commands, throwing error message like this:

Reproduce

Run any docker command then it will throw the same error.
request returned Internal Server Error for API route and version http://%2FUsers%2Fsongshuang%2F.docker%2Frun%2Fdocker.sock/v1.43/containers/json, check if the server supports the requested API version

Expected behavior

No response

docker version

Client:
 Cloud integration: v1.0.35+desktop.5
 Version:           24.0.7
 API version:       1.43
 Go version:        go1.20.10
 Git commit:        afdd53b
 Built:             Thu Oct 26 09:04:20 2023
 OS/Arch:           darwin/amd64
 Context:           desktop-linux

docker info

Client:
 Version:    24.0.7
 Context:    desktop-linux
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.12.0-desktop.2
    Path:     /Users/songshuang/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.23.3-desktop.2
    Path:     /Users/songshuang/.docker/cli-plugins/docker-compose
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.0
    Path:     /Users/songshuang/.docker/cli-plugins/docker-dev
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.21
    Path:     /Users/songshuang/.docker/cli-plugins/docker-extension
  feedback: Provide feedback, right in your terminal! (Docker Inc.)
    Version:  0.1
    Path:     /Users/songshuang/.docker/cli-plugins/docker-feedback
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v0.1.0-beta.10
    Path:     /Users/songshuang/.docker/cli-plugins/docker-init
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     /Users/songshuang/.docker/cli-plugins/docker-sbom
  scan: Docker Scan (Docker Inc.)
    Version:  v0.26.0
    Path:     /Users/songshuang/.docker/cli-plugins/docker-scan
  scout: Docker Scout (Docker Inc.)
    Version:  v1.2.0
    Path:     /Users/songshuang/.docker/cli-plugins/docker-scout

Diagnostics ID

Docker GUI can't start, so I can't generate diagnostic ID

Additional Info

No response

[slatlasdev]

Getting the same problem on M1 MacBook Pro, opening the Docker application leads to it spinning endlessly on "Starting the docker engine"

macOS Sonoma 14.2.1
Docker Desktop 4.26.1

Same error when running docker commands:

request returned Internal Server Error for API route and version http://%2FUsers%2Funame%2F.docker%2Frun%2Fdocker.sock/v1.24/version, check if the server supports the requested API version

Looking in the system console, I see this message printed repeatedly:

(2a9bee1a) d8d8f87b-lifecycle-server C<-S 8647476d-lifecycle-server GET /docker (5.654459ms):

{
  "current_action": "docker API is ready",
  "current_action_start": "2024-01-05T05:54:41.723799422Z",
  "engine": "failed to start",
  "error": {
    "type": "*errordef.dockerDesktopError",
    "component": "vm:lifecycleserver:dockerd",
    "originalError": {
      "type": "*fmt.wrapError",
      "error": {
        "type": "*fmt.wrapError",
        "error": {
          "type": "*exec.ExitError",
          "description": "exit status 1"
        },
        "message": "dockerd exited before the API started up"
      },
      "message": "dockerd died before the API started up"
    },
    "creationTime": 1704434081723809964,
    "creationFile": "linuxkit/pkg/desktop-host-tools/pkg/dockerd/state.go",
    "creationLine": 50
  }
}

[slatlasdev]

Update - I completely uninstalled docker, including deleting all local configuration and containers as described here, and now 4.26.1 is working on my machine.