epic: API and CLI to enable/disable CORS

[gabrielle-ong]

Problem

• Users are facing a CORS configuration issue when using a different frontend (eg ChatGPT)
• Also encountered on test requests sent from the docs /api-reference site
• We should offer the option to enable/disable CORS (similar to Jan API server)

Access to XMLHttpRequest at 'http://127.0.0.1:39281/v1/chat/completions' from origin 'https://cortex.so' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource

Success Criteria

• Ensure it works on browsers (Safari may have stricter CORs)

Tasklist

• [ ]

Reference bug reports

• bug: cors rest api #1450
• discord cortex-help:

[dan-menlo]

@namchuai For this, let's quickly spec out an API and CLI for activating/deactivating CORS.

• This API will be used to power Jan's API Server CORS toggle

[namchuai]

@dan-homebrew @gabrielle-ong
For enabling / disabling CORS, I propose:

My assumption. Correct me if I'm wrong or you have different idea

1. Enable/Disable CORS will only be applied after server restart. Server restart not required
2. Default CORS will be On (Enabled) for user to easily playing around and run it from https://cortex.so or their local host.
3. Flag stored at .cortexrc

API interface

CLI

Help command

Subcommands for managing configurations
Usage:
cortex config status for listing all API server configuration.
cortex config --cors [on/off] to toggle CORS.
cortex config --allowed_origins [comma separated origin] to set a list of allowed origin

Options:
  -h,--help                   Print this help message and exit
  --cors TEXT [*]             [on/off] Toggling CORS.
  --allowed_origins TEXT [*]  Allowed origins for CORS. Comma separated. E.g. http://localhost,https://cortex.so

Configurations:
  status                      Print all configurations

List Server Configurations

cortex config status

Update CORS configuration

cortex config --cors on|off

Response

1. Successfully update

CORS updated to ON|OFF

2. Failed update

CORS update failed. Reason: ...

HTTP API

Update CORS configuration

PATCH http://127.0.0.1:39281/config

Body

{
    "cors": true | false
}

Response:

{
    "message": "Configuration updated successfully"
}

Get configurations

GET http://127.0.0.1:39281/config

Response

{
    "cors": true | false
}