skobkin/docker-stacks
skobkin/docker-stacks
2
2
Fork 0
Code Issues 67 Pull requests 3 Releases Wiki Activity

VLLM #163

New issue
Open
opened 2025-06-04 04:49:56 +03:00 by skobkin · 1 comment
skobkin commented 2025-06-04 04:49:56 +03:00
Owner
Copy link

Efficient LLM stack.

Efficient LLM stack. - https://hub.docker.com/r/rocm/vllm - https://docs.vllm.ai/en/v0.7.0/deployment/docker.html
skobkin self-assigned this 2025-06-04 04:49:56 +03:00
skobkin commented 2025-06-28 02:51:35 +03:00
Author
Owner
Copy link
- https://github.com/containers/ramalama instead of raw vllm?
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
immich_stack_update
mox
element-call
No results found.
Labels
Clear labels   
WIP
Work in progress

  
bug
Something is not working

  
duplicate

   
enhancement
New feature

  
new stack
Request for a new stack

  
security
Security-related changes

  
to be researched
Proposals for checking.

  
won't fix
Will not be fixed or implemented for some reason.

No labels
WIP
bug
duplicate
enhancement
new stack
security
to be researched
won't fix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
skobkin
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
skobkin/docker-stacks#163
No description provided.