#ollama on docker with AMD GPU not working

1 messages · Page 1 of 1 (latest)

rotund girder
#

Hello, I'm sorry to bother you. I admit I wasn't sure where to ask this, but here goes. I'm a Windows user with an AMD graphics card, and I have a relatively simple project, though it's not quite that simple. Basically, I want to create a Docker image, and I'd like it to use my graphics card and not my CPU. But for some unknown reason, even though I'm using https://hub.docker.com/r/ollama/ollama (the latest version released recently), when I check the performance, I see that it's using my CPU and never my GPU. I admit I'm a bit lost because I thought this version was maintained by AMD? For those curious, I'm using this Docker compose.

    build:
      context: .
      dockerfile: Dockerfile.ollama
    container_name: ollama
    ports:
      - 11434:11434
    volumes:
      - ollama_data:/root/.ollama
    devices:
      - "/dev/dxg:/dev/kfd"
    security_opt:
      - seccomp:unconfined
    environment:
      - OLLAMA_DEBUG=1```