---
license: llama2
---
Student model using the CLASS framework.

If you use this work, please cite:
CLASS Meet SPOCK: An Education Tutoring Chatbot based on Learning Science Principles
https://arxiv.org/abs/2305.13272
```
@misc{sonkar2023class,
      title={CLASS Meet SPOCK: An Education Tutoring Chatbot based on Learning Science Principles}, 
      author={Shashank Sonkar and Lucy Liu and Debshila Basu Mallick and Richard G. Baraniuk},
      year={2023},
      eprint={2305.13272},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_luffycodes__llama-shishya-7b-ep3-v2)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 43.17   |
| ARC (25-shot)         | 47.35          |
| HellaSwag (10-shot)   | 75.88    |
| MMLU (5-shot)         | 43.84         |
| TruthfulQA (0-shot)   | 30.16   |
| Winogrande (5-shot)   | 68.75   |
| GSM8K (5-shot)        | 0.0        |
| DROP (3-shot)         | 36.21         |