Commit graph

12 commits

Author SHA1 Message Date
Alexey Skobkin a49ce5ab28
Using local search to check model existence (fixes ). 2024-11-06 19:39:21 +03:00
Alexey Skobkin b4b0f7baba
Context prompt format fix. 2024-11-04 02:10:57 +03:00
Alexey Skobkin 093372dd91
Adding usernames to the message context (). Adding text of reply-quoted message to the context (). Refactoring context creation and presentation. 2024-11-04 01:18:42 +03:00
Alexey Skobkin de5165f5ec
Presenting chat history as 'system' messages. Presenting bot replies as 'assistant' messages. Tweaking system prompt. 2024-10-28 02:04:35 +03:00
Alexey Skobkin 1f9583cb29
Adding in-memory chat history support. Removing inline queries. Refactoring stats and message processing a bit. Also changing LLM request context building a bit. Also adding alias for summarization and some other small changes. 2024-10-28 00:35:35 +03:00
Alexey Skobkin f28670834d Model configuration and small prompt improvements ()
- Model can be configured using ENV
- Summarization prompt improved
- Single text request prompt improved
- Chat context prompt improved

Co-authored-by: Alexey Skobkin <skobkin-ru@ya.ru>
Reviewed-on: 
2024-08-16 00:47:07 +00:00
Alexey Skobkin c4665338db Changing default model to LLaMa3 ()
Changing default model to LLaMa3

Reviewed-on: 
2024-05-06 00:15:36 +00:00
Alexey Skobkin 7bb5c65d59
Closes . Adding inline queries. Also small refactoring of context prompt based on RequestContext. 2024-03-13 01:18:01 +03:00
Alexey Skobkin bfacbb9f98
Tweaking summarizer prompt a bit. 2024-03-12 22:12:58 +03:00
Alexey Skobkin 5f55cec0e2
fix slog usage. Also adding more logging. 2024-03-12 22:07:22 +03:00
Alexey Skobkin dc5ad2c580
Implementing request context and adding it to /hey command processing. 2024-03-12 06:12:25 +03:00
Alexey Skobkin 8939b2fb62
Refactoring structure from single file to several separated services. Adding new feature: "summarize" to generate bullet points for provided link. 2024-03-10 04:51:01 +03:00