xxx777xxxASD
/

PrimaSumika-10.7B-128k-bpw-6.0

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

PrimaSumika-10.7B-128k-bpw-6.0 / README.md

xxx777xxxASD's picture

Update README.md

7f201ed verified 11 months ago

|

history blame contribute delete

292 Bytes

	---
	license: apache-2.0
	language:
	- en
	tags:
	- merge
	- moe
	---
	![image/png](https://i.ibb.co/71BdpSQ/00005-1478892296.png)

	ExLlamaV2 BPW 6.0 quant of [xxx777xxxASD/PrimaSumika-10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaSumika-10.7B-128k)
	(Fits in 12GB VRAM/42k context/4-bit cache)