'Dynamic registration failed' with 'Simplescraper' MCP server

[joshspicer]

Testing #250319

Version: 1.101.0-insider
Commit: 1ca21f8a13ad30d022e80888716156f4264297d0
Date: 2025-06-03T05:04:14.310Z
Electron: 35.4.0
ElectronBuildId: 11602177
Chromium: 134.0.6998.205
Node.js: 22.15.0
V8: 13.4.114.21-electron.0
OS: Linux arm64 6.8.0-60-generic

I add the MCP server but am never prompted to go through any auth flow. I'm not sure if this is a VS Code or simple scraper problem. Here are the logs:

2025-06-03 11:30:50.722 [info] Connection state: Starting
2025-06-03 11:30:50.724 [info] Starting server from LocalProcess extension host
2025-06-03 11:30:50.726 [info] Connection state: Running
2025-06-03 11:30:52.746 [warning] Error getting token from server metadata: Error: Dynamic registration failed: Invalid authorization dynamic client registration response: {"client_id":"5d6a6cd5-xxxxxx","client_secret":"xxxxx","token_endpoint_auth_method":"none","redirect_uris":["https://insiders.vscode.dev/redirect","https://vscode.dev/redirect","http://localhost/","http://127.0.0.1/","http://localhost:33418/","http://127.0.0.1:33418/"]}
2025-06-03 11:30:52.746 [info] Connection state: Error ; will retry with new session ID
2025-06-03 11:30:52.747 [error] Server exited before responding to `initialize` request.
2025-06-03 11:31:15.505 [info] Stopping server simple-scraper
2025-06-03 11:31:15.507 [info] Starting server simple-scraper
2025-06-03 11:31:15.508 [info] Connection state: Starting
2025-06-03 11:31:15.510 [info] Starting server from LocalProcess extension host
2025-06-03 11:31:15.515 [info] Connection state: Running
2025-06-03 11:31:16.666 [warning] Error getting token from server metadata: Error: Dynamic registration failed: Invalid authorization dynamic client registration response: {"client_id":"54f0495b-xxxxx","client_secret":"xxxxxx","token_endpoint_auth_method":"none","redirect_uris":["https://insiders.vscode.dev/redirect","https://vscode.dev/redirect","http://localhost/","http://127.0.0.1/","http://localhost:33418/","http://127.0.0.1:33418/"]}
2025-06-03 11:31:16.666 [info] Connection state: Error ; will retry with new session ID
2025-06-03 11:31:16.666 [error] Server exited before responding to `initialize` request.

Docs: https://simplescraper.io/docs/mcp-server#simplescraper-s-mcp-server-ai-managed-web-scraping

[TylerLeonhardt]

Additionally, the authorization server MUST return all registered
metadata about this client, including any fields provisioned by the
authorization server itself.

https://datatracker.ietf.org/doc/html/rfc7591#section-3.2

Now, I think this server isn't implementing the spec properly... but we can be more robust here. I'll make this change to not require a client_name in the response.

[joshspicer]

Hm, still not able to get SimpleScraper working. Again not sure which side is at fault. Probably not your realm Tyler as the Oauth sign-in appears successful now