HTTP 400 Bad Request from https://api.anthropic.com/v1/messages

[Kiril-Stoilov919]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS: macOS Sonoma 14.6.1
- Continue: 0.0.56
- IDE: IntelliJ Ultimate 2024.2.0.1
- Model: Claude 3.5 Sonnet
- config.json:
  {
  "models": [
    {
      "title": "Llama 3",
      "provider": "ollama",
      "model": "llama3"
    },
    {
      "title": "Mistral",
      "provider": "ollama",
      "model": "mistral:latest",
      "apiBase": "http://localhost:11434/"
    },
    {
      "title": "Ollama",
      "provider": "ollama",
      "model": "AUTODETECT"
    },
    {
      "title": "Claude 3.5 Sonnet",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX",
      "completionOptions": {}
    }
  ],
  "customCommands": [
    {
      "name": "test",
      "prompt": "{{{ input }}}\n\nWrite a comprehensive set of unit tests for the selected code. It should setup, run tests that check for correctness including important edge cases, and teardown. Ensure that the tests are complete and sophisticated. Give the tests just as chat output, don't edit any file.",
      "description": "Write unit tests for highlighted code"
    }
  ],
  "tabAutocompleteModel": {
    "title": "Claude 3.5 Sonnet",
    "provider": "anthropic",
    "model": "claude-3-5-sonnet-20240620",
    "apiKey": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
  },
  "allowAnonymousTelemetry": true,
  "embeddingsProvider": {
    "provider": "free-trial"
  },
  "reranker": {
    "name": "free-trial"
  }
}

### Description

After the latest updates I receive:

HTTP 400 Bad Request from https://api.anthropic.com/v1/messages
{"type":"error":{"type":"invalid_request_error","message":"messages: text content blocks must be non-empty"}}

I've got enough credit in my Anthropic account, apparently Continue is not creating proper requests (see above)

### To reproduce

Try prompting Claude 3.5 Sonnet with latest updates in IntelliJ

### Log output

```Shell
{"type":"error":{"type":"invalid_request_error","message":"messages: text content blocks must be non-empty"}}

[fry69]

Sonnet-3.5 does not work as an autocomplete model, see here for model recommendations that work -> https://docs.continue.dev/setup/select-model#autocomplete

[Kiril-Stoilov919]

Sonnet-3.5 does not work as an autocomplete model, see here for model recommendations that work -> https://docs.continue.dev/setup/select-model#autocomplete

It is not (just) the autocomplete that it is not working, the general chat does not work, the error is from there. I've changed the tabAutocompleteModel but the issue persists.

[fry69]

Last thing I see is remove the embeddingsProvider and reranker blocks from your config. You'll use defaults that work well and the free trial will stop working soon anyway (could also be source for the empty fields error when those fail).

[Kiril-Stoilov919]

Last thing I see is remove the embeddingsProvider and reranker blocks from your config. You'll use defaults that work well and the free trial will stop working soon anyway (could also be source for the empty fields error when those fail).

I removed them, but this seems to break something else, see attached screenshot. I also provide an attachment with the original error.

[fry69]

Sorry, I forgot that you are on JetBrains, where the the default transformers.js based embeddings model does not work (VSCode only). Try disabling indexing completely for now, add

	"disableIndexing": true,

to your config.json file.

You can enable indexing later by either running a local embeddings model (does not use much compute) or by using an online API for that, see here -> https://docs.continue.dev/features/codebase-embeddings#ollama

[fry69]

Also I just notice that the

	"completionOptions": {}

inside your model block for "Claude 3.5 Sonnet" seems odd and unnecessary, can you remove that too please?

[Kiril-Stoilov919]

Hi, I've removed the completionOptions, and added the disableIndexing, still no luck. I also tried putting back (and then removing again the allowAnonymousTelemetry and reranker parameters. My goal is to use Claude Sonnet as the main model with tab auto completion and indexing, but can sacrifice the tab autocompletion for a local model (I got mistral, llama3 and codestral locally). This worked fine until the end of last week, this week a bunch of updates for both Continue and a major update for IntelliJ were installed, which apparently broke all. About the indexing, it still had issues before, but I could remedy them by closing some of the projects (IntelliJ instances) I don't currently use and restarting the IDE/Plugin. Here is the current config.json I use:

{ "models": [ { "title": "Llama 3", "provider": "ollama", "model": "llama3" }, { "title": "Mistral", "provider": "ollama", "model": "mistral:latest", "apiBase": "http://localhost:11434/" }, { "title": "Codestral", "provider": "ollama", "model": "codestral:latest", "apiBase": "http://localhost:11434/" }, { "title": "Ollama", "provider": "ollama", "model": "AUTODETECT" }, { "title": "Claude 3.5 Sonnet", "provider": "anthropic", "model": "claude-3-5-sonnet-20240620", "apiKey": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } ], "customCommands": [ { "name": "test", "prompt": "{{{ input }}}\n\nWrite a comprehensive set of unit tests for the selected code. It should setup, run tests that check for correctness including important edge cases, and teardown. Ensure that the tests are complete and sophisticated. Give the tests just as chat output, don't edit any file.", "description": "Write unit tests for highlighted code" } ], "tabAutocompleteModel": { "title": "Mistral", "provider": "ollama", "model": "mistral:latest", "apiBase": "http://localhost:11434/" }, "disableIndexing": true }

And last but not least thanks for your efforts!

[Kiril-Stoilov919]

Dang it, the code formatting didn't work.

[fry69]

Dang it, the code formatting didn't work.

In doubt, if such a thing happens copy the unreadable blob and put it in this command line ->

jq . - <<EOF
[paste your unformatted JSON here, without the square brackets of course]
EOF

This should produce ->

{
  "models": [
    {
      "title": "Llama 3",
      "provider": "ollama",
      "model": "llama3"
    },
    {
      "title": "Mistral",
      "provider": "ollama",
      "model": "mistral:latest",
      "apiBase": "http://localhost:11434/"
    },
    {
      "title": "Codestral",
      "provider": "ollama",
      "model": "codestral:latest",
      "apiBase": "http://localhost:11434/"
    },
    {
      "title": "Ollama",
      "provider": "ollama",
      "model": "AUTODETECT"
    },
    {
      "title": "Claude 3.5 Sonnet",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
    }
  ],
  "customCommands": [
    {
      "name": "test",
      "prompt": "{{{ input }}}\n\nWrite a comprehensive set of unit tests for the selected code. It should setup, run tests that check for correctness including important edge cases, and teardown. Ensure that the tests are complete and sophisticated. Give the tests just as chat output, don't edit any file.",
      "description": "Write unit tests for highlighted code"
    }
  ],
  "tabAutocompleteModel": {
    "title": "Mistral",
    "provider": "ollama",
    "model": "mistral:latest",
    "apiBase": "http://localhost:11434/"
  },
  "disableIndexing": true
}

(the here document gymnastic is necessary because otherwise you'll run into quote/escaping problems)

[Kiril-Stoilov919]

Any ideas however about the 400 from the Anthropic api?

[fry69]

Any ideas however about the 400 from the Anthropic api?

No real clue. Another thing you could try is to reset Continue's state by moving your ~/.continue folder out of the way, the create it new with

mkdir ~/.continue

and copy only the config.json file from your copied Continue folder back into this newly created one. Of course stop the IDE for this and start it afterwards.

[Kiril-Stoilov919]

Any ideas however about the 400 from the Anthropic api?

No real clue. Another thing you could try is to reset Continue's state by moving your ~/.continue folder out of the way, the create it new with

mkdir ~/.continue

and copy only the config.json file from your copied Continue folder back into this newly created one. Of course stop the IDE for this and start it afterwards.

tried, still the 400 when contacting the anthropic api, re-enabled indexing, this time doesn't hang