Time-limit requests to LLM with cancelation #88
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
It seems (not proven, but possible) that sometimes this bot can cause an indefinite GPU usage by Ollama.
It should probably be a separate issue, but for now it's worth considering adding LLM request timeout, or even better - Telegram events handler processing timeout.