Adding OLLAMA_KEEP_ALIVE to the .env.dist (#116)

This MR adds a variable that allows to control how long the model is being kept in memory by default.

Reviewed-on: #116
Co-authored-by: skobkin <skobkin@proton.me>
Co-committed-by: skobkin <skobkin@proton.me>
This commit is contained in:
Alexey Skobkin 2024-08-05 15:47:08 +00:00 committed by Alexey Skobkin
parent 55ecc704fd
commit 4f9bdb6b9f

View file

@ -11,6 +11,9 @@ HTTP_OLLAMA_BIND_PORT=11434
DEV_KFD=/dev/kfd DEV_KFD=/dev/kfd
DEV_DRI=/dev/dri DEV_DRI=/dev/dri
# The duration that models stay loaded in memory (default is "5m"
#OLLAMA_KEEP_ALIVE=5m
# Open WebUI # Open WebUI
HOST_UI_DATA_DIR=./data/open-webui HOST_UI_DATA_DIR=./data/open-webui
HTTP_UI_BIND_ADDR=127.0.0.1 HTTP_UI_BIND_ADDR=127.0.0.1