File size: 1,317 Bytes
45f371f
 
 
 
17ab4c3
45f371f
 
 
 
 
 
 
17ab4c3
 
 
 
 
 
 
 
45f371f
 
17ab4c3
45f371f
 
 
 
 
9cd74dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
---
base_model: unsloth/gemma-2-2b-bnb-4bit
language:
- en
- bg
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- gemma2
- trl
datasets:
- petkopetkov/math_qa-bg
- petkopetkov/gsm8k-bg
- petkopetkov/winogrande_xl-bg
- petkopetkov/hellaswag-bg
- petkopetkov/mmlu-bg
- petkopetkov/arc-easy-bg
- petkopetkov/arc-challenge-bg
---

# Gemma-2-2B-Bulgarian

- **Developed by:** petkopetkov
- **License:** apache-2.0
- **Finetuned from model :** unsloth/gemma-2-2b-bnb-4bit

Gemma-2-2B finetuned on datasets translated to Bulgarian language:

- **MMLU**: multiple-choice questions from various branches of knowledge
- **Winogrande challenge**: testing world knowledge and understanding
- **Hellaswag**: testing sentence completion
- **ARC Easy/Challenge**: testing logical reasoning
- **GSM-8k**: solving multiple-choice questions in high-school mathematics
- **MathQA**: math word problems

### Usage

First, install the Transformers library with:
```sh
pip install -U transformers
```

#### Run with the `pipeline` API

```python
import torch
from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="petkopetkov/gemma-2-2b-bg",
    torch_dtype=torch.bfloat16, 
    device_map="auto"
)

prompt = "Колко е 2 + 2?"

print(pipe(prompt)[0]['generated_text'])
```