---
base_model:
- MrRobotoAI/98
- MrRobotoAI/107
- MrRobotoAI/104
- MrRobotoAI/103
- MrRobotoAI/105
- MrRobotoAI/97
- MrRobotoAI/102
- MrRobotoAI/101
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/105](https://huggingface.co/MrRobotoAI/105) as a base.

### Models Merged

The following models were included in the merge:
* [MrRobotoAI/98](https://huggingface.co/MrRobotoAI/98)
* [MrRobotoAI/107](https://huggingface.co/MrRobotoAI/107)
* [MrRobotoAI/104](https://huggingface.co/MrRobotoAI/104)
* [MrRobotoAI/103](https://huggingface.co/MrRobotoAI/103)
* [MrRobotoAI/97](https://huggingface.co/MrRobotoAI/97)
* [MrRobotoAI/102](https://huggingface.co/MrRobotoAI/102)
* [MrRobotoAI/101](https://huggingface.co/MrRobotoAI/101)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: MrRobotoAI/97
  - model: MrRobotoAI/98
  - model: MrRobotoAI/101
  - model: MrRobotoAI/102
  - model: MrRobotoAI/103
  - model: MrRobotoAI/104
  - model: MrRobotoAI/105
  - model: MrRobotoAI/107
merge_method: model_stock
base_model: MrRobotoAI/105
normalize: true
dtype: float16
```