skobkin/telegram-ollama-reply-bot
skobkin/telegram-ollama-reply-bot
1
0
Fork 0
Code Issues 4 Pull requests 1 Releases Activity
Simple bot to interact with Open Source LLM's running in Ollama using Telegram
51 commits 2 branches 18 tags 243 KiB
Go 98.5%
Dockerfile 1.5%
Find a file
Alexey Skobkin 093372dd91
Adding usernames to the message context (#34). Adding text of reply-quoted message to the context (#33). Refactoring context creation and presentation.
2024-11-04 01:18:42 +03:00
bot Adding usernames to the message context (#34). Adding text of reply-quoted message to the context (#33). Refactoring context creation and presentation. 2024-11-04 01:18:42 +03:00
extractor fix #15 slog usage. Also adding more logging. 2024-03-12 22:07:22 +03:00
llm Adding usernames to the message context (#34). Adding text of reply-quoted message to the context (#33). Refactoring context creation and presentation. 2024-11-04 01:18:42 +03:00
stats #26 Adding in-memory chat history support. Removing inline queries. Refactoring stats and message processing a bit. Also changing LLM request context building a bit. Also adding alias for summarization and some other small changes. 2024-10-28 00:35:35 +03:00
.drone.yml Also changing image tag for build step. 2024-03-10 05:57:59 +03:00
.gitignore initial. Draft of SIMPLE LLM bot for Telegram chat. 2024-03-08 05:18:45 +03:00
Dockerfile Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
go.mod Refactoring structure from single file to several separated services. Adding new feature: "summarize" to generate bullet points for provided link. 2024-03-10 04:51:01 +03:00
go.sum Refactoring structure from single file to several separated services. Adding new feature: "summarize" to generate bullet points for provided link. 2024-03-10 04:51:01 +03:00
LICENSE LICENSE file. 2024-03-08 05:19:26 +03:00
main.go Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
README.md REAMDE.md fix (#25) 2024-08-16 00:59:04 +00:00

README.md

telegram-ollama-reply-bot

Build Status

Usage

Docker

docker run \
  -e OPENAI_API_TOKEN=123 \
  -e OPENAI_API_BASE_URL=http://ollama.localhost:11434/v1 \
  -e TELEGRAM_TOKEN=12345 \
  -e MODEL_TEXT_REQUEST=llama3.1:8b-instruct-q6_K
  -e MODEL_SUMMARIZE_REQUEST=mistral-nemo:12b-instruct-2407-q4_K_M
  skobkin/telegram-llm-bot