📊 OLMNER-7B Benchmark Results

OLMNER-7B has been evaluated and ranked TOP 27 in the 7B models category!

🔥 Performance Scores

Metric	Score
Average Score	35.56%
IFEval	72.54%
BBH	35.75%
MATH	46.30%
GPQA	7.72%
MUSR	14.31%
MMLU-PRO	36.77%

🌍 Carbon Emission Estimate: 0.65 kg CO₂

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview
  - model: jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.0
    parameters:
      density: 0.5
      weight: 0.5
  - model: jeffmeloy/Qwen2.5-7B-olm-v1.1
    parameters:
      density: 0.5
      weight: 0.5
merge_method: ties
base_model: Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview
parameters:
  normalize: false
  int8_mask: true
dtype: bfloat16