Not sure how you’re trying to run it in a container, but the answer would depend on a bunch of different factors. Nvidia has a utility you can install that assists in exposing the GPU to the container, documentation found here.
If you’re using docker compose to run it as a service, there’s a doc page for that too. Note that it uses the previous page I mentioned as prerequisite.
There’s another way to get it working from within kubernetes that comes up every now and then on stackoverflow.
If it’s Intel or AMD, no idea if this still applies.
Not sure how you’re trying to run it in a container, but the answer would depend on a bunch of different factors. Nvidia has a utility you can install that assists in exposing the GPU to the container, documentation found here.
If you’re using docker compose to run it as a service, there’s a doc page for that too. Note that it uses the previous page I mentioned as prerequisite.
There’s another way to get it working from within kubernetes that comes up every now and then on stackoverflow.
If it’s Intel or AMD, no idea if this still applies.