skobkin/telegram-ollama-reply-bot
skobkin/telegram-ollama-reply-bot
1
0
Fork 0
Code Issues 4 Pull requests 1 Releases Activity
Simple bot to interact with Open Source LLM's running in Ollama using Telegram
60 commits 2 branches 18 tags 243 KiB
Go 98.5%
Dockerfile 1.5%
Find a file
Alexey Skobkin c33eb3fe35
Updating github.com/mymmrac/telego dependency.
2024-11-06 17:56:33 +03:00
bot Fixing user request representation in the LLM request context (#40). 2024-11-04 02:24:00 +03:00
extractor fix #15 slog usage. Also adding more logging. 2024-03-12 22:07:22 +03:00
llm Context prompt format fix. 2024-11-04 02:10:57 +03:00
stats #26 Adding in-memory chat history support. Removing inline queries. Refactoring stats and message processing a bit. Also changing LLM request context building a bit. Also adding alias for summarization and some other small changes. 2024-10-28 00:35:35 +03:00
.drone.yml Also changing image tag for build step. 2024-03-10 05:57:59 +03:00
.gitignore initial. Draft of SIMPLE LLM bot for Telegram chat. 2024-03-08 05:18:45 +03:00
Dockerfile Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
go.mod Updating github.com/mymmrac/telego dependency. 2024-11-06 17:56:33 +03:00
go.sum Updating github.com/mymmrac/telego dependency. 2024-11-06 17:56:33 +03:00
LICENSE LICENSE file. 2024-03-08 05:19:26 +03:00
main.go Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
README.md REAMDE.md fix (#25) 2024-08-16 00:59:04 +00:00

README.md

telegram-ollama-reply-bot

Build Status

Usage

Docker

docker run \
  -e OPENAI_API_TOKEN=123 \
  -e OPENAI_API_BASE_URL=http://ollama.localhost:11434/v1 \
  -e TELEGRAM_TOKEN=12345 \
  -e MODEL_TEXT_REQUEST=llama3.1:8b-instruct-q6_K
  -e MODEL_SUMMARIZE_REQUEST=mistral-nemo:12b-instruct-2407-q4_K_M
  skobkin/telegram-llm-bot