File size: 927 Bytes
47c0f5b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
language:
- code
license: other
model_name: llm-compiler-7b
base_model: facebook/llm-compiler-7b
inference: false
model_creator: facebook
quantized_by: Second State Inc.
---

![](https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee)

# llm-compiler-7b-GGUF

## Original Model

[facebook/llm-compiler-7b](https://huggingface.co/facebook/llm-compiler-7b)

**License** A custom commercial license is available at: [https://ai.meta.com/resources/models-and-libraries/llama-downloads/](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)

## Run with Gaianet

(coming soon)

<!-- **Prompt template:**

prompt template: `gemma-instruct`

**Context size:**

chat_ctx_size: `8192` -->

**Run with GaiaNet:**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b3259*