#Best way to be totally sure the model is running on GPU?

2 messages · Page 1 of 1 (latest)

pastel drum
#

Iris Xe + Nvidia RTX A2000 ada:

During installation I set it up to use the nvidia gpu, but it seems like inference was running on the iris...

wraith sinew
#

Try nvtop. It shows what your Nvidia GPU is doing.