---
base_model:
- microsoft/phi-2
- Artples/L-MChat-Small
- minghaowu/phi-2-OpenHermes-2.5
- kingabzpro/phi-2-role-play
- parsak/phi-2-code-instruct
- l3utterfly/phi-2-layla-v1-chatml
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) as a base.

### Models Merged

The following models were included in the merge:
* [Artples/L-MChat-Small](https://huggingface.co/Artples/L-MChat-Small)
* [minghaowu/phi-2-OpenHermes-2.5](https://huggingface.co/minghaowu/phi-2-OpenHermes-2.5) + [kingabzpro/phi-2-role-play](https://huggingface.co/kingabzpro/phi-2-role-play)
* [parsak/phi-2-code-instruct](https://huggingface.co/parsak/phi-2-code-instruct)
* [l3utterfly/phi-2-layla-v1-chatml](https://huggingface.co/l3utterfly/phi-2-layla-v1-chatml)

### Configuration

The following YAML configuration was used to produce this model:

```yaml

models:
  - model: minghaowu/phi-2-OpenHermes-2.5+kingabzpro/phi-2-role-play
    parameters:
      weight: 1.0
  - model: Artples/L-MChat-Small
    parameters:
      weight: 1.0
  - model: l3utterfly/phi-2-layla-v1-chatml
    parameters:
      weight: 1.0
  - model: parsak/phi-2-code-instruct
    parameters:
      weight: 1.0
merge_method: task_arithmetic
base_model: microsoft/phi-2
parameters:
    normalize: false
dtype: float16

```