From 4f9bdb6b9f37518aa2fc7885d0c652c5ea8884e5 Mon Sep 17 00:00:00 2001 From: skobkin Date: Mon, 5 Aug 2024 15:47:08 +0000 Subject: [PATCH] Adding OLLAMA_KEEP_ALIVE to the .env.dist (#116) This MR adds a variable that allows to control how long the model is being kept in memory by default. Reviewed-on: https://git.skobk.in/skobkin/docker-stacks/pulls/116 Co-authored-by: skobkin Co-committed-by: skobkin --- ollama/.env.dist | 3 +++ 1 file changed, 3 insertions(+) diff --git a/ollama/.env.dist b/ollama/.env.dist index 7bfe0cf..556ff12 100644 --- a/ollama/.env.dist +++ b/ollama/.env.dist @@ -11,6 +11,9 @@ HTTP_OLLAMA_BIND_PORT=11434 DEV_KFD=/dev/kfd DEV_DRI=/dev/dri +# The duration that models stay loaded in memory (default is "5m" +#OLLAMA_KEEP_ALIVE=5m + # Open WebUI HOST_UI_DATA_DIR=./data/open-webui HTTP_UI_BIND_ADDR=127.0.0.1