xLAM-8x22b-r-GGUF / README.md
alabulei's picture
Update README.md
e5dfc6a verified
metadata
license: cc-by-nc-4.0
model_name: xLAM-8x22b-r
base_model: Salesforce/xLAM-8x22b-r
inference: false
model_creator: MediaTek-Research
pipeline_tag: text-generation
quantized_by: Second State Inc.
language:
  - en
tags:
  - function-calling
  - LLM Agent
  - tool-use
  - mistral

xLAM-8x22b-r-GGUF

Original Model

Salesforce/xLAM-8x22b-r

Run with Gaianet

Prompt template

prompt template: llama-3-chat

Context size

chat_ctx_size: 64000

Run with GaiaNet

Quantized with llama.cpp b3613