--- base_model: - MrRobotoAI/A1-L-R - MrRobotoAI/C7 - MrRobotoAI/115 - MrRobotoAI/A2-R - MrRobotoAI/L2 - MrRobotoAI/C6 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method. ### Models Merged The following models were included in the merge: * [MrRobotoAI/A1-L-R](https://huggingface.co/MrRobotoAI/A1-L-R) * [MrRobotoAI/C7](https://huggingface.co/MrRobotoAI/C7) * [MrRobotoAI/115](https://huggingface.co/MrRobotoAI/115) * [MrRobotoAI/A2-R](https://huggingface.co/MrRobotoAI/A2-R) * [MrRobotoAI/L2](https://huggingface.co/MrRobotoAI/L2) * [MrRobotoAI/C6](https://huggingface.co/MrRobotoAI/C6) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: MrRobotoAI/C6 - model: MrRobotoAI/C7 - model: MrRobotoAI/A1-L-R - model: MrRobotoAI/A2-R - model: MrRobotoAI/115 - model: MrRobotoAI/L2 parameters: weight: 1.0 merge_method: linear dtype: float16 ```