Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -10,10 +10,10 @@ pinned: false
|
|
10 |
**BrestStormTeam**
|
11 |
|
12 |
**Mission:**
|
13 |
-
|
14 |
|
15 |
**Model:**
|
16 |
-
**Tempest-LLM** β
|
17 |
|
18 |
**Training Approach:**
|
19 |
Our model benefits from a balanced multilingual training strategy, ensuring equal proficiency in:
|
@@ -21,14 +21,12 @@ Our model benefits from a balanced multilingual training strategy, ensuring equa
|
|
21 |
- π¬π§ **English**
|
22 |
- πͺπΈ **Spanish**
|
23 |
|
24 |
-
This
|
25 |
|
26 |
**Impact:**
|
27 |
-
- **Economic:** Reduced computational infrastructure leads to
|
28 |
-
- **Ecological:** Lower power consumption and infrastructure
|
29 |
-
- **Performance:** Maintains
|
30 |
|
31 |
**Vision:**
|
32 |
-
BrestStormTeam
|
33 |
-
|
34 |
-
|
|
|
10 |
**BrestStormTeam**
|
11 |
|
12 |
**Mission:**
|
13 |
+
We aim to efficiently train large-scale State Space Models (SSM) while significantly reducing infrastructure usage. Our goal is to minimize economic and environmental impacts without substantially compromising linguistic performance.
|
14 |
|
15 |
**Model:**
|
16 |
+
**Tempest-LLM** β an efficient language model based on **Mamba2**, leveraging advanced compression methods to achieve an encoding efficiency of **1.58 bits per parameter**.
|
17 |
|
18 |
**Training Approach:**
|
19 |
Our model benefits from a balanced multilingual training strategy, ensuring equal proficiency in:
|
|
|
21 |
- π¬π§ **English**
|
22 |
- πͺπΈ **Spanish**
|
23 |
|
24 |
+
This multilingual training enhances linguistic versatility and cultural adaptability across different languages and contexts.
|
25 |
|
26 |
**Impact:**
|
27 |
+
- **Economic:** Reduced computational infrastructure leads to lower operational costs.
|
28 |
+
- **Ecological:** Lower power consumption and minimal infrastructure requirements decrease environmental footprint.
|
29 |
+
- **Performance:** Maintains robust linguistic accuracy and fluency despite compression and optimization.
|
30 |
|
31 |
**Vision:**
|
32 |
+
BrestStormTeam is committed to showing that linguistic AI technologies can be both powerful and sustainable, contributing responsibly to AI innovation.
|
|
|
|