LiteLLM

Sissejuhatus

TODO

https://www.litellm.ai/ ...

Tööpõhimõte

TODO

Paigaldamine ja seadistamine

Paigaldamiseks sobib nt selline docker compose

TODO

Tulemusena käivitatakse selline komplekt konteinereid

root@dh-ubuntu-2604-litellm-01:/srv/litellm/dc# docker compose up -d
[+] up 85/85
 ✔ Image redis:7-alpine                      Pulled    31.8s
 ✔ Image ghcr.io/berriai/litellm:main-latest Pulled    49.6s
 ✔ Image nginx:alpine                        Pulled    33.3s
 ✔ Image postgres:16-alpine                  Pulled    36.6s
 ✔ Image ghcr.io/open-webui/open-webui:main  Pulled    69.0s
 ✔ Network genai-internal-network            Created    0.2s
 ✔ Volume p_litellm_redis_data               Created    0.1s
 ✔ Volume p_litellm_litellm_data             Created    0.1s
 ✔ Volume p_litellm_openwebui_data           Created    0.1s
 ✔ Volume p_litellm_postgres_data            Created    0.1s
 ✔ Container genai-postgres                  Healthy   13.1s
 ✔ Container genai-redis                     Healthy   12.6s
 ✔ Container genai-litellm-proxy             Started   11.8s
 ✔ Container genai-openwebui                 Started   11.7s
 ✔ Container genai-nginx-ingress             Started   11.1s
root@dh-ubuntu-2604-litellm-01:/srv/litellm/dc#

kus

• TODO

LiteLLM

LiteLLM seadistamiseks veebipõhiselt

kus

• TODO

Open WebUI

TODO

Kasulikud lisamaterjalid

• TODO