nm-testing
/

granite-3.1-8b-instruct2of4-sparse

compressed-tensors

Model card Files Files and versions Community

granite-3.1-8b-instruct2of4-sparse / recipe.yaml

horheynm's picture

Upload folder using huggingface_hub

fd1465f verified 2 months ago

177 Bytes

	DEFAULT_stage:
	DEFAULT_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	mask_structure: '2:4'
	sequential_update: true
	targets: ['re:model.layers.\d*$']