skobkin/telegram-ollama-reply-bot
skobkin/telegram-ollama-reply-bot
1
0
Fork 0
Code Issues 4 Pull requests 1 Releases Activity
Simple bot to interact with Open Source LLM's running in Ollama using Telegram
42 commits 2 branches 18 tags 243 KiB
Go 98.5%
Dockerfile 1.5%
Find a file
Alexey Skobkin f28670834d
All checks were successful
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
Model configuration and small prompt improvements (#24) 
- Model can be configured using ENV
- Summarization prompt improved
- Single text request prompt improved
- Chat context prompt improved

Co-authored-by: Alexey Skobkin <skobkin-ru@ya.ru>
Reviewed-on: #24
2024-08-16 00:47:07 +00:00
bot Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
extractor fix #15 slog usage. Also adding more logging. 2024-03-12 22:07:22 +03:00
llm Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
stats Closes #14. Adding inline queries. Also small refactoring of context prompt based on RequestContext. 2024-03-13 01:18:01 +03:00
.drone.yml Also changing image tag for build step. 2024-03-10 05:57:59 +03:00
.gitignore initial. Draft of SIMPLE LLM bot for Telegram chat. 2024-03-08 05:18:45 +03:00
Dockerfile Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
go.mod Refactoring structure from single file to several separated services. Adding new feature: "summarize" to generate bullet points for provided link. 2024-03-10 04:51:01 +03:00
go.sum Refactoring structure from single file to several separated services. Adding new feature: "summarize" to generate bullet points for provided link. 2024-03-10 04:51:01 +03:00
LICENSE LICENSE file. 2024-03-08 05:19:26 +03:00
main.go Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00
README.md Model configuration and small prompt improvements (#24) 2024-08-16 00:47:07 +00:00

README.md

telegram-ollama-reply-bot

Build Status

Usage

Docker

docker run \
  -e OPENAI_API_TOKEN=123 \
  -e OPENAI_API_BASE_URL=http://ollama.localhost:11434/v1 \
  -e TELEGRAM_TOKEN=12345 \
  -e MODEL_TEXT_REQUEST=llama3.1:8b-instruct-q6_K
  -e MODEL_TEXT_REQUEST=mistral-nemo:12b-instruct-2407-q4_K_M
  skobkin/telegram-llm-bot