Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autocomplete: add cody.autocomplete.experimental.fireworksOptions #3415

Merged
merged 4 commits into from Mar 18, 2024

Conversation

valerybugakov
Copy link
Member

Context

  • Adds an experimental setting for internal use, cody.autocomplete.experimental.fireworksOptions for quick local experimentation with new models via direct access to the Fireworks API. This PR makes it easy for anyone to experiment with new models without hacking on autocomplete internals locally.
  • This does not use cody.autocomplete.advanced.model because it lists supported models with validation. The fireworksOptions.model is supposed to be used on new models for internal testing.

Test plan

  1. Add the following settings:
  "cody.autocomplete.experimental.fireworksOptions": {
    "url": "https://api.fireworks.ai/inference/v1/completions",
    "token": "YOUR_ACCESS_TOKEN",
    "model": "accounts/sourcegraph/models/starcoder2-7b",
    "parameters": {
      "stop": [
          "<fim_prefix>",
          "<fim_suffix>",
          "<fim_middle>",
          "<|endoftext|>",
          "<file_sep>",
      ]
    }
  },
  1. Autocomplete should work as usual.

@valerybugakov valerybugakov merged commit 5abac6a into main Mar 18, 2024
15 of 16 checks passed
@valerybugakov valerybugakov deleted the vb/fireworks-provider branch March 18, 2024 02:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants