Update README.md
Browse files
README.md
CHANGED
|
@@ -7,4 +7,19 @@ language:
|
|
| 7 |
- en
|
| 8 |
library_name: adapter-transformers
|
| 9 |
pipeline_tag: text-generation
|
| 10 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
- en
|
| 8 |
library_name: adapter-transformers
|
| 9 |
pipeline_tag: text-generation
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
LLM: [Salesforce/CodeGen-6B-Mono](https://huggingface.co/Salesforce/codegen-6B-mono)
|
| 13 |
+
|
| 14 |
+
Tuning:
|
| 15 |
+
|
| 16 |
+
I'm using [Peft](https://github.com/huggingface/peft) for tuning
|
| 17 |
+
- [x] LoRA
|
| 18 |
+
- [ ] Prefix-tuning (P-tuning v2)
|
| 19 |
+
|
| 20 |
+
Dataset:
|
| 21 |
+
- [x] [Leetcode](https://huggingface.co/datasets/mhhmm/leetcode-solutions-python)
|
| 22 |
+
- [x] [Google Deepind Code contests](https://huggingface.co/datasets/deepmind/code_contests)
|
| 23 |
+
|
| 24 |
+
Training:
|
| 25 |
+
- [x] Google Colab Pro+ in 2 hours
|