Basic config file Install and create postgres database Install postgres, create litellm user and database: Problems while setting up postgres See bug report: In case you get some error on litellm startup mentioning “prisma generate” (path to schema.prisma may vary on your installation): Creating API keys Once a database is configured and working, creating API […]
Tag: litellm
While ollama does handle multiple different LLMs quite nicely (loading/unloading on demand) there are situations where you may want to run multiple instances of the same model at the same time (e.g. to increase throughput). Here’s how you can do so with minimal changes to your zero effort ollama installation. Let’s assume you just did […]