BioCancer-6E7B-Deepseek-random / mergekit_moe_config.yml
Treza12's picture
Upload folder using huggingface_hub
9e7c226 verified
base_model: deepseek-ai/deepseek-llm-7b-base
gate_mode: approach # one of "hidden", "cheap_embed", or "random"
dtype: bfloat16 # output dtype (float32, float16, or bfloat16)
experts:
- source_model: Treza12/DeepSeek-invasive-FULL
positive_prompts:
- "This is a prompt that is demonstrative excels at invasive Breast Cancer"
- source_model: Treza12/non_invasive_benign-FULL
positive_prompts:
- "This is a prompt that is demonstrative excels at non invasive benign Breast Cancer"
- source_model: Treza12/DeepSeek-advanced_stage
positive_prompts:
- "This is a prompt that is demonstrative excels at advanced Stage Breast Cancer"