Installation

Continue is a powerful AI assistant for coding, which you can use with your LiteLLM API key. Follow the steps below to set it up.

1. Download and install VSCode: https://code.visualstudio.com/download
2. Install the extension: Continue

1. Click on the continue icon in the sidebar and then the second button which says “Or, configure your own models”, as we will be doing exactly that

1. Click on “click here to view more providers”

1. Open the continue config file

Note that you do not need to sign in, but use the “Local Assistant”

<aside> 💡

To add other models click on “Add Chat model” (shown below) and then on “config file” (shown above)

</aside>

1. Add models to the config file

Example (Using only LiteLLM models, easy setup):

name: Local Assistant
version: 1.0.0
schema: v1
models: 
  - name: Claude 3.7 Sonnet
    provider: anthropic
    model: claude-3-7-sonnet
    apiBase: <https://litellm.sph-prod.ethz.ch/v1>
    apiKey: your-api-key
    roles:
      - chat
      - edit
  - name: Claude 3.5 Sonnet
    provider: anthropic
    model: claude-3-5-sonnet
    apiBase: <https://litellm.sph-prod.ethz.ch/v1>
    apiKey: your-api-key
    roles:
      - apply
      - autocomplete

context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

Configuration for other Models/ Providers

OpenAI: