ipihq/Phi-3-medium-128k-instruct

The Model ipihq/Phi-3-medium-128k-instruct was converted to MLX format from microsoft/Phi-3-medium-128k-instruct using mlx-lm version 0.14.2.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("ipihq/Phi-3-medium-128k-instruct")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Downloads last month
9
Safetensors
Model size
14B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for mlx library.