You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
11 lines
251 B
11 lines
251 B
services:
|
|
ollama:
|
|
# GPU support
|
|
deploy:
|
|
resources:
|
|
reservations:
|
|
devices:
|
|
- driver: ${OLLAMA_GPU_DRIVER-nvidia}
|
|
count: ${OLLAMA_GPU_COUNT-1}
|
|
capabilities:
|
|
- gpu
|
|
|