dmmagdal
/

falcon_7b_GPTQ_4-bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

falcon_7b_GPTQ_4-bit

2 contributors

History: 3 commits

dmmagdal's picture

Upload pytorch_model.bin

3874b81 over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

39 Bytes

initial commit over 1 year ago
config.json

1.74 kB

First commit. Uploading model and tokenizer for files for falcon-7b model quantized to 4-bit with GPTQ from auto-gptq over 1 year ago
generation_config.json

113 Bytes

First commit. Uploading model and tokenizer for files for falcon-7b model quantized to 4-bit with GPTQ from auto-gptq over 1 year ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.04 GB
LFS

Upload pytorch_model.bin over 1 year ago
special_tokens_map.json

281 Bytes

First commit. Uploading model and tokenizer for files for falcon-7b model quantized to 4-bit with GPTQ from auto-gptq over 1 year ago
tokenizer.json

2.73 MB

First commit. Uploading model and tokenizer for files for falcon-7b model quantized to 4-bit with GPTQ from auto-gptq over 1 year ago
tokenizer_config.json

2.61 kB

First commit. Uploading model and tokenizer for files for falcon-7b model quantized to 4-bit with GPTQ from auto-gptq over 1 year ago