TheClusterDev
/

GLM-Steam-106B-A12B-v1-FP8

compressed-tensors

Model card Files Files and versions

FP8 Version of TheDrummer/GLM-Steam-106B-A12B-v1

Very fast on vLLM.

Downloads last month: 86

Safetensors

Model size

107B params

Tensor type

F32

·

BF16

·

F8_E4M3

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for TheClusterDev/GLM-Steam-106B-A12B-v1-FP8

Base model

zai-org/GLM-4.5-Air

Finetuned

TheDrummer/GLM-Steam-106B-A12B-v1

Quantized

(8)

this model