coreML model?

#3
by adw1029 - opened

How to get .mlmodelc for this?

Two ways:

  • Run this CLI but like this: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML. It will download the model into ~/Documents/huggingface and also run it.
  • Clone this repo directly from the three dot menu:

image.png

Hi first I followed the following way to download the model (Run this CLI but like this: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML. It will download the model into ~/Documents/huggingface and also run it.).

Then, I tried to run the model with: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML

And this is the output:

Building for debugging...
[1/1] Write swift-version--58304C5D6DBC3306.txt
Build of product 'LLMCLI' complete! (0.22s)
ModelPipeline Llama-3.2-1B-Instruct (6 chunks)
Error: The data couldn’t be read because it isn’t in the correct format.

Do you happen to know why I get this error ? Thanks!

Can you delete the downloaded files and try again? That has helped other people with similar errors.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment