Time-limit requests to LLM with cancelation #88

Closed
opened 2025-10-16 21:11:35 +03:00 by skobkin · 0 comments
Owner

It seems (not proven, but possible) that sometimes this bot can cause an indefinite GPU usage by Ollama.

It should probably be a separate issue, but for now it's worth considering adding LLM request timeout, or even better - Telegram events handler processing timeout.

It seems (not proven, but possible) that sometimes this bot can cause an indefinite GPU usage by Ollama. It should probably be a separate issue, but for now it's worth considering adding LLM request timeout, or even better - Telegram events handler processing timeout.
skobkin self-assigned this 2025-10-16 21:11:35 +03:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
skobkin/telegram-ollama-reply-bot#88
No description provided.