<aside> 💡 GPT4all is an open source tool that let's you have a chat interface on your own computer. You can have ChatGPT-like chats, but with a much higher limit, thanks to your LiteLLM API key. One usecase would be to add your local documents as a base of the chat.

</aside>

Here are a few simple steps on how to get started:

1. Download and install GPT4All: https://docs.gpt4all.io/index.html

2. Open the GPT4All app (e.g. through the search bar)

3. Go to Models

4. Press + Add Model

5. Go to Remote Providers

6. Scroll down to Custom

   • enter your API KEY
   • enter Base URL:

   <https://litellm.sph-prod.ethz.ch/v1>
   

   • enter a model name. These models are probably available: gpt-4o, gpt-4o-mini, claude-3-5-sonnet and more

     • If you want to know all available models, check out this List: Available Models

       Or this Colab: https://colab.research.google.com/drive/1AGoFN5Q11jjmuW26HnF6cZ-mWmZriEjj?usp=sharing

<aside> 📌 Alternatively you can download any free model from GPT4All tab that will run locally on your machine (enhanced privacy and unlimited usage, but these models are much smaller)

</aside>

1. Go to Chats
   • Select the model you just installed
   • Have fun!

<aside> ☝

Quick sidenote: To add your local documents to the chat, click on LocalDocs in the top right corner and follow the instructions

</aside>