跳转到正文
Backend

docker使用GPU

崔哥1 分钟4,596
文章目录

只能使用支持 cuda 的 nvidia 显卡,其他不行😭

docker run

https://docs.docker.com/config/containers/resource_constraints/#gpu

--gpus all

docker run -it --rm --gpus all nvidia/cuda:12.3.1-base-ubuntu20.04 nvidia-smi

docker compose

https://docs.docker.com/compose/gpu-support/

services:
  test:
    image: nvidia/cuda:12.3.1-base-ubuntu20.04
    command: nvidia-smi
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]