Hugging Face's logo

Spaces:
GIZ
/
audit_assistant
Runtime error

App Files Community
1
ppsingh commited on
Commit
61c33da
Β·
verified Β·
1 Parent(s): 79fe9e9

Update model_params.cfg

Browse files
Files changed (1) hide show
  1. model_params.cfg +2 -1
model_params.cfg CHANGED
@@ -6,7 +6,8 @@ TOP_K = 20
6
  MODEL = BAAI/bge-reranker-v2-m3
7
  TOP_K = 5
8
  [reader]
9
- TYPE = DEDICATED
 
10
  DEDICATED_MODEL = meta-llama/Llama-3.1-8B-Instruct
11
  DEDICATED_ENDPOINT = https://qu2d8m6dmsollhly.us-east-1.aws.endpoints.huggingface.cloud
12
  NVIDIA_MODEL = meta-llama/Llama-3.1-8B-Instruct
 
6
  MODEL = BAAI/bge-reranker-v2-m3
7
  TOP_K = 5
8
  [reader]
9
+ TYPE = INF_PROVIDERS
10
+ INF_PROVIDER_MODEL = meta-llama/Llama-3.1-8B-Instruct
11
  DEDICATED_MODEL = meta-llama/Llama-3.1-8B-Instruct
12
  DEDICATED_ENDPOINT = https://qu2d8m6dmsollhly.us-east-1.aws.endpoints.huggingface.cloud
13
  NVIDIA_MODEL = meta-llama/Llama-3.1-8B-Instruct