See: https://colab.research.google.com/drive/1_UuNv1XER8EAmpVeHfR3e5HS7of3z5DO?usp=sharing

Listing model prices

To get current prices of the models, use /model/info endpoint.

Tracking usage

Like mentioned on the main page, the usage of the API is limited to 30$ per month for projects.

• You can compute the remaining budget from response headers
  • x-key-max-budget, and
  • x-litellm-key-spend

Both functionalities are demonstrated in the following Colab: https://colab.research.google.com/drive/1_UuNv1XER8EAmpVeHfR3e5HS7of3z5DO?usp=sharing

<aside> ⬅️

Documentation LLM API Keys

</aside>