Where is the GGUF?

#7
by KeilahElla - opened

Ovis2 16b is an amazing model. Please release a GGUF so that we can use it with llama.cpp. I tried gguf my repo, but it did not work. It probably needs some custom work.

Yes, installation is shit as always in python. Will issued GGUF?

Sign up or log in to comment