--- base_model: - MrRobotoAI/137 - MrRobotoAI/135 - MrRobotoAI/134 - MrRobotoAI/133 - MrRobotoAI/138 - MrRobotoAI/136 - MrRobotoAI/L2 library_name: transformers tags: - mergekit - merge --- # merge 13,027 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method. ### Models Merged The following models were included in the merge: * [MrRobotoAI/137](https://huggingface.co/MrRobotoAI/137) * [MrRobotoAI/135](https://huggingface.co/MrRobotoAI/135) * [MrRobotoAI/134](https://huggingface.co/MrRobotoAI/134) * [MrRobotoAI/133](https://huggingface.co/MrRobotoAI/133) * [MrRobotoAI/138](https://huggingface.co/MrRobotoAI/138) * [MrRobotoAI/136](https://huggingface.co/MrRobotoAI/136) * [MrRobotoAI/L2](https://huggingface.co/MrRobotoAI/L2) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: MrRobotoAI/133 - model: MrRobotoAI/134 - model: MrRobotoAI/135 - model: MrRobotoAI/136 - model: MrRobotoAI/137 - model: MrRobotoAI/138 - model: MrRobotoAI/L2 parameters: weight: 1.0 merge_method: linear dtype: float16 ```