Merge Details
Merge Method
This model was merged using the task arithmetic merge method using HuggingFaceH4/zephyr-7b-alpha as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
dtype: bfloat16
merge_method: task_arithmetic
base_model:
model: HuggingFaceH4/zephyr-7b-alpha
slices:
- sources:
- layer_range: [0, 32]
model: HuggingFaceH4/zephyr-7b-beta
parameters:
weight: 0.5
- layer_range: [0, 32]
model: HuggingFaceH4/zephyr-7b-alpha
parameters:
weight: 0.5
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for theBodhiTree/Zephyr_7B_AlphaBeta_TaskArithmetic
Base model
mistralai/Mistral-7B-v0.1
Finetuned
HuggingFaceH4/zephyr-7b-alpha