skobkin/docker-stacks
skobkin/docker-stacks
2
2
Fork 0
Code Issues 47 Pull requests 1 Releases Activity

Adding OLLAMA_KEEP_ALIVE to the .env.dist (#116)

Browse source 
This MR adds a variable that allows to control how long the model is being kept in memory by default.

Reviewed-on: #116
Co-authored-by: skobkin <skobkin@proton.me>
Co-committed-by: skobkin <skobkin@proton.me>
This commit is contained in:
Alexey Skobkin 2024-08-05 15:47:08 +00:00 committed by Alexey Skobkin
parent 55ecc704fd
commit 4f9bdb6b9f
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
ollama/.env.dist
View file

@ -11,6 +11,9 @@ HTTP_OLLAMA_BIND_PORT=11434
DEV_KFD=/dev/kfd
DEV_DRI=/dev/dri
# The duration that models stay loaded in memory (default is "5m"
#OLLAMA_KEEP_ALIVE=5m
# Open WebUI
HOST_UI_DATA_DIR=./data/open-webui
HTTP_UI_BIND_ADDR=127.0.0.1