Uploaded model

Evaluation

For a detailed comparison of model performance, check out the Leaderboard for Italian Language Models.

Here's a breakdown of the performance metrics:

Metric hellaswag_it acc_norm arc_it acc_norm m_mmlu_it 5-shot acc m_mmlu_pro_it Average
Accuracy Normalized 69.35 49.1 69.53 0.3913 62.66
Downloads last month
5,093
Safetensors
Model size
7.36B params
Tensor type
F32
·
FP16
·
U8
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train SeacomSrl/SeaPhi3-medium

Collection including SeacomSrl/SeaPhi3-medium