nougat-small-onnx-quant_avx2

This was quantized from pszemraj/nougat-small-onnx using the --avx2 flag so should work properly on most machines.

per_channel is set to True for better accuracy
Usage is the same as: https://huggingface.co/pszemraj/nougat-small-onnx

Downloads last month: 7

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and the HF Inference API does not support transformers models with pipeline type image-text-to-text

Collection including pszemraj/nougat-small-onnx-quant_avx2

Nougat ONNX

Collection

Faster Nougat in ONNX format (optimum onnxruntime) • 6 items • Updated Feb 24, 2024 • 1