continuous-integration/drone/push Build is passing

Details

continuous-integration/drone/tag Build is passing

Details

Model configuration and small prompt improvements (#24 )

- Model can be configured using ENV
- Summarization prompt improved
- Single text request prompt improved
- Chat context prompt improved

Co-authored-by: Alexey Skobkin <skobkin-ru@ya.ru>
Reviewed-on: #24

2024-08-16 00:47:07 +00:00

481 B

Raw Blame History

telegram-ollama-reply-bot

Usage

Docker

docker run \
  -e OPENAI_API_TOKEN=123 \
  -e OPENAI_API_BASE_URL=http://ollama.localhost:11434/v1 \
  -e TELEGRAM_TOKEN=12345 \
  -e MODEL_TEXT_REQUEST=llama3.1:8b-instruct-q6_K
  -e MODEL_TEXT_REQUEST=mistral-nemo:12b-instruct-2407-q4_K_M
  skobkin/telegram-llm-bot

481 B Raw Blame History

telegram-ollama-reply-bot

Usage

Docker

481 B

Raw Blame History