Autocomplet: missing context from other functions causing faulty suggestions on function calling

[rogeroberg]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS: Windows
- Continue version: 1.0.13
- IDE version: intellij ultimate 2025.1
- Model: Qwen2.5-Coder-1.5B
- config:
  : Local Assistant
version: 1.0.0
schema: v1
  
models:
  - name: nomic-embed-text
    provider: ollama
    model: nomic-embed-text
    roles:
      - embed
    apiBase: https://ollama.xx.xx/
    apiKey: ''

  - name: Qwen2.5-Coder-1.5B
    provider: vllm
    model: Qwen/Qwen2.5-Coder-1.5B
    roles:
        - autocomplete
    apiBase: https://vllm.xx.xx/v1
    apiKey: ''
    defaultCompletionOptions:
        contextLength: 32768
        
  - name: Qwen2.5-Coder-14B-Instruct-fp16
    provider: ollama
    model: qwen2.5-coder:14b-instruct-fp16
    roles:
     - chat
     - edit
     - apply
    apiBase: https://ollama.xx.xx/
    apiKey: ''
   
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

Description

I have just create a simple application in java which references a calculator class to do addition with 3 variables. However the autocompete suggestion only gives you 2 variables which then will of course fail to compile.
Looking at the prompt logs it seems like no code from the calculator class is included in the prompt which it should?

prompt.log

Main.java.txt

Calculator.java.txt

config.yaml.txt

To reproduce

Log output

[sestinj]

Thanks for sharing this example. Right now we're including a mix of diffs, type definitions, and recent code snippets, but we still have improvements to make as is obvious here. We'll keep working on it!

[adarshramiyer]

Hi @rogeroberg — we added autocomplete context from open tabs in your editor, which also takes into account when you view a file. You can find it here: #6012 . I copied over your Main and Calculator files, and with this update, I reliably get the intended autocomplete behavior. I'm closing this issue, feel free to reopen if you have further comments.

[rogeroberg]

Hi @adarshramiyer
Great work and it definitely solves the use case when you have the files opened.
However I was thinking about a more general solution since we have a lot of helper classes/functions we use when coding which nescesserly isn't opened up in the tabs when coding. In those cases this would still give a wrong autocomplete suggestion if I understood the solution you have implemented correctly.

[rogeroberg]

Ideally I think continue should add context similar to how it have been done here: https://www.tabbyml.com/blog/repository-context-for-code-completion

[adarshramiyer]

Hi @rogeroberg — this is a great idea! I think some of this behavior is handled by Root Path Context, although I can see how in your case something more would be necessary. Thank you for sending along the link. To the best of my knowledge we don't currently do retrieval when creating autocomplete context, but this is a direction we could look at in the future!