skobkin/docker-stacks
1
1
Fork 0
Code Issues 45 Pull requests 1 Releases Activity

ollama: ROCM usage #77

New issue
Closed
opened 2024-02-23 22:34:21 +00:00 by skobkin · 2 comments
skobkin commented 2024-02-23 22:34:21 +00:00
Owner
Copy link

Following #76. It's needed to find a way to run LLM's using ROCM.

See:

Following #76. It's needed to find a way to run LLM's using ROCM. See: - https://github.com/ollama/ollama/issues/738 - https://github.com/ollama/ollama/blob/main/docs/development.md#linux-rocm-amd - ✅ https://hub.docker.com/r/bergutman/ollama-rocm
skobkin added the
to be researched
bug
enhancement
 labels 2024-02-23 22:34:21 +00:00
skobkin self-assigned this 2024-02-23 22:34:21 +00:00
skobkin added a new dependency 2024-02-23 22:34:35 +00:00
#76 ollama
skobkin referenced this issue from a commit 2024-03-07 02:04:30 +00:00
Ollama GPU pass (#84)
skobkin commented 2024-03-07 02:54:19 +00:00
Author
Owner
Copy link

Detected iGPU, but didn't work due to missing ROCm module for such target. Need to test on full-size GPU.

Detected iGPU, but didn't work due to missing ROCm module for such target. Need to test on full-size GPU.
skobkin commented 2024-07-26 15:52:36 +00:00
Author
Owner
Copy link

Already fixed in recent version. Current ollama stack works fine on discrete GPU.

Already fixed in recent version. Current `ollama` stack works fine on discrete GPU.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
feature_94_mqtt
feature_remark42
No results found.
Labels
Clear labels   
WIP

Work in progress

  
bug

Something is not working

  
enhancement

New feature

  
new stack

Request for a new stack

  
security

Security-related changes

  
to be researched

Proposals for checking.

  
won't fix

Will not be fixed or implemented for some reason.

No labels
WIP
bug
enhancement
new stack
security
to be researched
won't fix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
skobkin
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Depends on
#76 ollama
skobkin/docker-stacks
Reference: skobkin/docker-stacks#77
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?