LeroyDyer
/

Mixtral_Base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

LeroyDyer commited on Mar 15, 2024

Commit

e044ce1

·

verified ·

1 Parent(s): 6fde52b

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -47,3 +47,4 @@ merge_method: linear
 dtype: float16
 ```

 dtype: float16
 ```
+Needs quantizing to 4bit etc. the Q8_0 Works well!(Untuned!)