Can't work with GPU Interface in HF Interface Endpoints?
#1
by
hmmhmmhm
- opened
Hello I have tried to run that model with Nvidia T4 GPU 16GB instances. However, I get an error like the log below. Is there a minimum GPU specification that would be recommended?
[Deploy Log]
https://gist.github.com/hmmhmmhm/f5190514c99ae1edc35edc009b39f435
I just successfully ran that model with CPUs, the specs used in the deployment are Intel Sapphire Rapids - 16x vCPUs - 32 GB.
hmmhmmhm
changed discussion title from
Can't work with Hugging Interface Endpoints?
to Can't work with GPU Interface in HF Interface Endpoints?
thanks for your interest in cases of hardware constraints you may also try out the model here