Ollama - Docker

Sissejuhatus

TODO

Tööpõhimõte

TODO

Paigaldamine ja käivitamine

root@dh-minio-01:~# cat /srv/ollama/dc/docker-compose.yml
name: p_ollama
services:
  svc_ollama:
    image: ollama/ollama
    container_name: cn_ollama
    volumes:
      - /srv/ollama/volume/root:/root/.ollama
    ports:
      - "11434:11434"
    restart: unless-stopped
  svc_openwebui:
    image: ghcr.io/open-webui/open-webui:main
    container_name: cn_openwebui
    ports:
      - "3080:8080"
    environment:
      - OLLAMA_BASE_URL=http://svc_ollama:11434
    volumes:
      - /srv/ollama/volume/openwebui:/app/backend/data
    restart: unless-stopped
    depends_on:
      - svc_ollama
networks: {}

ning

root@dh-minio-01:~# docker exec -it cn_ollama ollama pull qwen3:8b

ning

root@dh-minio-01:~# docker exec -it cn_ollama ollama list
NAME                ID              SIZE      MODIFIED
qwen3:8b            500a1f067a9f    5.2 GB    43 hours ago
qwen2.5-coder:7b    dae161e27b0e    4.7 GB    44 hours ago
llama3.2:1b         baf6a787fdff    1.3 GB    2 days ago

root@dh-minio-01:~# docker exec -it cn_ollama ollama ps
NAME                ID              SIZE      PROCESSOR    CONTEXT    UNTIL
qwen2.5-coder:7b    dae161e27b0e    5.1 GB    100% CPU     4096       3 minutes from now

ning

root@dh-minio-01:~# docker exec -it cn_ollama ollama run qwen2.5-coder:7b
>>> how much is 4 times 7
To find out how much 4 times 7 is, you simply multiply the two numbers:

\[ 4 \times 7 = 28 \]

So, 4 times 7 is 28.

>>> Send a message (/? for help)

ning

root@dh-minio-01:~# du -sh /srv/ollama/volume/root/models
11G	/srv/ollama/volume/root/models

Kasulikud lisamaterjalid

• TODO