README.md

metadata

base_model: []
library_name: transformers
tags:
  - mergekit
  - merge

Llama3.1-SuperDeepFuse

An 8B parameter language model that merges three high-performance distilled models to boost reasoning, instruction-following, and performance in mathematics and coding.

Model Highlights

• Size: 8 billion parameters
• Base: meta-llama/Llama-3.1-8B-Instruct
• Merged Sources:
  • arcee-ai/Llama-3.1-SuperNova-Lite
  • deepseek-ai/DeepSeek-R1-Distill-Llama-8B
  • FuseAI/FuseChat-Llama-3.1-8B-Instruct
• Merge Method: model_stock

Key Capabilities

• Enhanced multi-task reasoning
• Improved mathematical and coding performance
• Multilingual support

Performance Notes

• Maintains Llama 3.1 safety standards
• Suitable for consumer GPU deployment
• Balanced performance across diverse tasks

Considerations

• Still being benchmarked
• Capabilities limited compared to larger model variants
• Can give misleading output like all other language models
• Outputs should be independently verified

Licensing

Follows standard Llama 3.1 usage terms.