BechirTrabelsi1
/

Falcon_OPT

Text Generation

Model card Files Files and versions Metrics Training metrics Community

Falcon_OPT / AutoAWQ_kernels /awq_ext /exllamav2 /config.h

BechirTrabelsi1's picture

BechirTrabelsi1

Training in progress, step 500

25b4ce2 verified 7 months ago

199 Bytes

	#ifndef _config_h
	#define _config_h

	#define MAX_Q_GEMM_ROWS 50

	#define QMODE_2BIT 1
	#define QMODE_3BIT 1
	#define QMODE_4BIT 1
	#define QMODE_5BIT 1
	#define QMODE_6BIT 0
	#define QMODE_8BIT 0

	#endif