Dear Colleagues,
is it possible that you could share information about the GPU that the docker container uses for inference? What type of GPU is it and how large is the memory?
Best
Mischa
Created by Scheibenmischa Hi,
Your code will probably run on an NVidia RTX 2080TI with 11 GB GPU RAM. You can test if that will work for you using the toy-queue.
Cheers,
David