paramedik's picture
Upload README.md with huggingface_hub
b5d9732 verified
metadata
language:
  - ru
datasets:
  - IlyaGusev/saiga_scored
license: other
license_name: llama3
license_link: https://llama.meta.com/llama3/license/
base_model: IlyaGusev/saiga_llama3_8b
tags:
  - openvino
  - openvino-export
pipeline_tag: text-generation

This model was converted to OpenVINO from IlyaGusev/saiga_llama3_8b using optimum-intel via the export space.

First make sure you have optimum-intel installed:

pip install optimum[openvino]

To load your model you can do as follows:

from optimum.intel import OVModelForCausalLM

model_id = "paramedik/saiga_llama3_8b-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)