--- base_model: - unsloth/Llama-3.3-70B-Instruct - unsloth/Meta-Llama-3.1-70B - nvidia/Llama-3.1-Nemotron-70B-Instruct-HF library_name: transformers tags: - mergekit - merge --- # nemotron3.3 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [unsloth/Meta-Llama-3.1-70B](https://huggingface.co/unsloth/Meta-Llama-3.1-70B) as a base. ### Models Merged The following models were included in the merge: * [unsloth/Llama-3.3-70B-Instruct](https://huggingface.co/unsloth/Llama-3.3-70B-Instruct) * [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: task_arithmetic dtype: bfloat16 base_model: unsloth/Meta-Llama-3.1-70B models: - model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF parameters: weight: 1.0 - model: unsloth/Llama-3.3-70B-Instruct parameters: weight: 1.0 ```