aws-neuron/optimum-neuron-cache at main

optimum-neuron-cache / inference-cache-config

Ctrl+K

4 contributors

History: 85 commits

dacorvo HF Staff

Rename inference-cache-config/qwen3-moe.json to inference-cache-config/qwen-moe.json

24ae643 verified 4 days ago

gpt2.json

398 Bytes

Add more gpt2 configurations over 1 year ago
granite.json

1.3 kB

Add configuration for granite models 9 months ago
llama-variants.json

1.45 kB

Add DeepSeek distilled versions of LLama 8B 7 months ago
llama.json

2.08 kB

Update inference-cache-config/llama.json about 1 month ago
llama2-70b.json

287 Bytes

Create llama2-70b.json about 1 year ago
llama3-70b.json

584 Bytes

Add DeepSeek distilled model 7 months ago
llama3.1-70b.json

289 Bytes

Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json 11 months ago
mistral-variants.json

1.04 kB

Remove obsolete mistral variants 11 months ago
mistral.json

1.87 kB

Update inference-cache-config/mistral.json 8 months ago
mixtral.json

583 Bytes

Update inference-cache-config/mixtral.json 11 months ago
phi4.json

556 Bytes

Add phi4 cached configurations 6 months ago
pixart-alpha-xl-512x512.json

206 Bytes

Rename inference-cache-config/pixart-xl-2-512x512.json to inference-cache-config/pixart-alpha-xl-512x512.json 3 months ago
pixart-sigma-xl-512x512.json

210 Bytes

Rename inference-cache-config/pixart_sigma_xl_512x512.json to inference-cache-config/pixart-sigma-xl-512x512.json 3 months ago
qwen-moe.json

407 Bytes

Rename inference-cache-config/qwen3-moe.json to inference-cache-config/qwen-moe.json 4 days ago
qwen.json

1.96 kB

Update inference-cache-config/qwen.json 2 months ago
qwen2.5-large.json

849 Bytes

Update inference-cache-config/qwen2.5-large.json 7 months ago
qwen2.5.json

2.69 kB

Add DeepSeek distilled models 7 months ago
sdxl-turbo.json

370 Bytes

Create sdxl-turbo.json 3 months ago
smollm3.json

396 Bytes

Update inference-cache-config/smollm3.json 29 days ago
stable-diffusion-2-1.json

378 Bytes

Create stable-diffusion-2-1.json 3 months ago
stable-diffusion-v1-5.json

377 Bytes

Rename inference-cache-config/diffusion.json to inference-cache-config/stable-diffusion-v1-5.json 3 months ago
stable-diffusion-xl-base-1.0.json

388 Bytes

Create stable-diffusion-xl-base-1.0.json 3 months ago
stable-diffusion-xl-refiner-1.0.json

391 Bytes

Create stable-diffusion-xl-refiner-1.0.json 3 months ago