Simple bot to interact with Open Source LLM's running in Ollama using Telegram

Find a file

Alexey Skobkin 6d5563c6d4 All checks were successful continuous-integration/drone/push Build is passing Details Making banner smaller. (#47 ) Co-authored-by: Alexey Skobkin <skobkin-ru@ya.ru> Reviewed-on: #47		2024-11-22 13:11:50 +00:00
bot	Fixing user request representation in the LLM request context (#40 ).	2024-11-04 02:24:00 +03:00
extractor	fix #15 slog usage. Also adding more logging.	2024-03-12 22:07:22 +03:00
img	Making banner smaller. (#47 )	2024-11-22 13:11:50 +00:00
llm	Using local search to check model existence (fixes #42 ).	2024-11-06 19:39:21 +03:00
stats	#26 Adding in-memory chat history support. Removing inline queries. Refactoring stats and message processing a bit. Also changing LLM request context building a bit. Also adding alias for summarization and some other small changes.	2024-10-28 00:35:35 +03:00
.drone.yml	Also changing image tag for build step.	2024-03-10 05:57:59 +03:00
.gitignore	initial. Draft of SIMPLE LLM bot for Telegram chat.	2024-03-08 05:18:45 +03:00
Dockerfile	Model configuration and small prompt improvements (#24 )	2024-08-16 00:47:07 +00:00
go.mod	Updating github.com/sashabaranov/go-openai dependency.	2024-11-06 17:57:56 +03:00
go.sum	Updating github.com/sashabaranov/go-openai dependency.	2024-11-06 17:57:56 +03:00
LICENSE	LICENSE file.	2024-03-08 05:19:26 +03:00
main.go	Using local search to check model existence (fixes #42 ).	2024-11-06 19:39:21 +03:00
README.md	Adding banner and logo. (#46 )	2024-11-22 13:07:37 +00:00

README.md

Telegram Ollama Bot

Functionality

Context-dependent dialogue in chats
Summarization of articles by provided link

Usage

Docker

docker run \
  -e OPENAI_API_TOKEN=123 \
  -e OPENAI_API_BASE_URL=http://ollama.localhost:11434/v1 \
  -e TELEGRAM_TOKEN=12345 \
  -e MODEL_TEXT_REQUEST=llama3.1:8b-instruct-q6_K
  -e MODEL_SUMMARIZE_REQUEST=mistral-nemo:12b-instruct-2407-q4_K_M
  skobkin/telegram-llm-bot