Need of faster backend.

#1
by Venkatesh4342 - opened

could anyone please provide the resources to inference on faster backend, currently it is taking 15 to 20 seconds for text with approx 10-15 words.

same problem

NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.
Getting this error, after cloning, running requirements.txt, on my virtual env of Python 3.10.17 (venv) for my ubuntu machine, please help me with this

Sign up or log in to comment