Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,7 @@ license: apache-2.0
|
|
| 19 |
- **PEFT Mode**: Hybrid Training combining frozen embeddings and Bone (Block Affine Transformation) + full parameter training
|
| 20 |
- **SFT Method**: SmoothingLoss SFT
|
| 21 |
- **Context Window**: 5120 (trained with 1024 token overlap)
|
|
|
|
| 22 |
|
| 23 |
### Dataset Specifications
|
| 24 |
- **Size**: 800k pairs
|
|
|
|
| 19 |
- **PEFT Mode**: Hybrid Training combining frozen embeddings and Bone (Block Affine Transformation) + full parameter training
|
| 20 |
- **SFT Method**: SmoothingLoss SFT
|
| 21 |
- **Context Window**: 5120 (trained with 1024 token overlap)
|
| 22 |
+
- **Compute Power**: AMD Instinct MI100 x 2 60hrs (100％ solar energy)
|
| 23 |
|
| 24 |
### Dataset Specifications
|
| 25 |
- **Size**: 800k pairs
|