metadata
language:
- ru
datasets:
- IlyaGusev/saiga_scored
license: other
license_name: llama3
license_link: https://llama.meta.com/llama3/license/
base_model: IlyaGusev/saiga_llama3_8b
tags:
- openvino
- openvino-export
pipeline_tag: text-generation
This model was converted to OpenVINO from IlyaGusev/saiga_llama3_8b
using optimum-intel
via the export space.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "paramedik/saiga_llama3_8b-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)