ollama: ROCM usage #77
Labels
No Label
WIP
bug
enhancement
new stack
security
to be researched
won't fix
No Milestone
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Depends on
#76 ollama
skobkin/docker-stacks
Reference: skobkin/docker-stacks#77
Loading…
Reference in New Issue
No description provided.
Delete Branch "%!s(<nil>)"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Following #76. It's needed to find a way to run LLM's using ROCM.
See:
Detected iGPU, but didn't work due to missing ROCm module for such target. Need to test on full-size GPU.