Alirezamp commited on
Commit
f424a21
·
verified ·
1 Parent(s): bca4ab8

Upload 8 files

Browse files
README.md CHANGED
@@ -1,7 +1,6 @@
1
  ---
2
- library_name: transformers
3
- tags:
4
- - unsloth
5
  ---
6
 
7
  # Model Card for Model ID
@@ -16,7 +15,7 @@ tags:
16
 
17
  <!-- Provide a longer summary of what this model is. -->
18
 
19
- This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
20
 
21
  - **Developed by:** [More Information Needed]
22
  - **Funded by [optional]:** [More Information Needed]
@@ -197,4 +196,7 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
197
 
198
  ## Model Card Contact
199
 
200
- [More Information Needed]
 
 
 
 
1
  ---
2
+ base_model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
3
+ library_name: peft
 
4
  ---
5
 
6
  # Model Card for Model ID
 
15
 
16
  <!-- Provide a longer summary of what this model is. -->
17
 
18
+
19
 
20
  - **Developed by:** [More Information Needed]
21
  - **Funded by [optional]:** [More Information Needed]
 
196
 
197
  ## Model Card Contact
198
 
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.11.1
adapter_config.json CHANGED
@@ -20,9 +20,9 @@
20
  "rank_pattern": {},
21
  "revision": "unsloth",
22
  "target_modules": [
23
- "v_proj",
24
  "q_proj",
25
  "k_proj",
 
26
  "o_proj"
27
  ],
28
  "task_type": "CAUSAL_LM",
 
20
  "rank_pattern": {},
21
  "revision": "unsloth",
22
  "target_modules": [
 
23
  "q_proj",
24
  "k_proj",
25
+ "v_proj",
26
  "o_proj"
27
  ],
28
  "task_type": "CAUSAL_LM",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7c9e5b17ca386d21da91c95fa0724e9900a0c2e25183ab488f966bbb510ab6d
3
  size 9034304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fab6760f5fd3616e84fbd252f6f0cc4c3c6ead5ab53a47f7840b27c8f159efc
3
  size 9034304
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff