Hugging Face's logo

Spaces:
Varu96
/
healthcare_project
Runtime error

App Files Community
Varu96 commited on
Commit
cd5e78d
·
1 Parent(s): 1a43077

Initial commit for new Hugging Face Space with all project files

Browse files
Files changed (25) hide show
  1. .gitattributes +1 -0
  2. My_new_LLaVA/.DS_Store +0 -0
  3. My_new_LLaVA/Copy of llava-1.5-fine-tune-gpu-a100.ipynb +0 -0
  4. My_new_LLaVA/LLaVA +1 -0
  5. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/README.md +202 -0
  6. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/adapter_config.json +34 -0
  7. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/adapter_model.safetensors +3 -0
  8. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/config.json +49 -0
  9. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/non_lora_trainables.bin +3 -0
  10. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/runs/Aug18_06-09-01_decfd3532853/events.out.tfevents.1723961423.decfd3532853.7960.0 +3 -0
  11. My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/trainer_state.json +222 -0
  12. My_new_LLaVA/llava-ftmodel/config.json +49 -0
  13. My_new_LLaVA/llava-ftmodel/generation_config.json +7 -0
  14. My_new_LLaVA/llava-ftmodel/model.safetensors.index.json +693 -0
  15. My_new_LLaVA/llava-ftmodel/special_tokens_map.json +30 -0
  16. My_new_LLaVA/llava-ftmodel/tokenizer.model +3 -0
  17. My_new_LLaVA/llava-ftmodel/tokenizer_config.json +42 -0
  18. My_new_LLaVA/wandb/debug-internal.log +1 -0
  19. My_new_LLaVA/wandb/debug.log +1 -0
  20. My_new_LLaVA/wandb/latest-run +1 -0
  21. My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/files/wandb-metadata.json +176 -0
  22. My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/files/wandb-summary.json +1 -0
  23. My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug-internal.log +227 -0
  24. My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug.log +28 -0
  25. My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/run-xy8wzk0g.wandb +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gif filter=lfs diff=lfs merge=lfs -text
My_new_LLaVA/.DS_Store ADDED
Binary file (6.15 kB). View file
 
My_new_LLaVA/Copy of llava-1.5-fine-tune-gpu-a100.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
My_new_LLaVA/LLaVA ADDED
@@ -0,0 +1 @@
 
 
1
+ Subproject commit c121f0432da27facab705978f83c4ada465e46fd
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: liuhaotian/llava-v1.5-7b
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.12.0
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "liuhaotian/llava-v1.5-7b",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 256,
14
+ "lora_dropout": 0.05,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 128,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "v_proj",
24
+ "o_proj",
25
+ "gate_proj",
26
+ "down_proj",
27
+ "up_proj",
28
+ "q_proj",
29
+ "k_proj"
30
+ ],
31
+ "task_type": "CAUSAL_LM",
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c4f890dfb4fdcb632fe5f44f9729ef3fbf9d305216bd78ef340690366954483
3
+ size 639692768
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/config.json ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "liuhaotian/llava-v1.5-7b",
3
+ "architectures": [
4
+ "LlavaLlamaForCausalLM"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "freeze_mm_mlp_adapter": false,
11
+ "freeze_mm_vision_resampler": false,
12
+ "hidden_act": "silu",
13
+ "hidden_size": 4096,
14
+ "image_aspect_ratio": "pad",
15
+ "initializer_range": 0.02,
16
+ "intermediate_size": 11008,
17
+ "max_length": 4096,
18
+ "max_position_embeddings": 4096,
19
+ "mm_hidden_size": 1024,
20
+ "mm_patch_merge_type": "flat",
21
+ "mm_projector_lr": 2e-05,
22
+ "mm_projector_type": "mlp2x_gelu",
23
+ "mm_resampler_type": null,
24
+ "mm_use_im_patch_token": false,
25
+ "mm_use_im_start_end": false,
26
+ "mm_vision_select_feature": "patch",
27
+ "mm_vision_select_layer": -2,
28
+ "mm_vision_tower": "openai/clip-vit-large-patch14-336",
29
+ "model_type": "llava_llama",
30
+ "num_attention_heads": 32,
31
+ "num_hidden_layers": 32,
32
+ "num_key_value_heads": 32,
33
+ "pad_token_id": 0,
34
+ "pretraining_tp": 1,
35
+ "rms_norm_eps": 1e-05,
36
+ "rope_scaling": null,
37
+ "rope_theta": 10000.0,
38
+ "tie_word_embeddings": false,
39
+ "tokenizer_model_max_length": 2048,
40
+ "tokenizer_padding_side": "right",
41
+ "torch_dtype": "float16",
42
+ "transformers_version": "4.37.2",
43
+ "tune_mm_mlp_adapter": false,
44
+ "tune_mm_vision_resampler": false,
45
+ "unfreeze_mm_vision_tower": false,
46
+ "use_cache": true,
47
+ "use_mm_proj": true,
48
+ "vocab_size": 32000
49
+ }
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/non_lora_trainables.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58a2ef9d3e0ba48288eeae82b7691687ac6015fedd7f72b93baa4be153b8ed25
3
+ size 41961648
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/runs/Aug18_06-09-01_decfd3532853/events.out.tfevents.1723961423.decfd3532853.7960.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:347179e308236728ffab4645e0f811a69612bace1809d74ffc3fb9ee8788820b
3
+ size 10847
My_new_LLaVA/checkpoints/llava-v1.5-7b-task-lora/trainer_state.json ADDED
@@ -0,0 +1,222 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 8.0,
5
+ "eval_steps": 500,
6
+ "global_step": 32,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.25,
13
+ "learning_rate": 0.0002,
14
+ "loss": 1.1044,
15
+ "step": 1
16
+ },
17
+ {
18
+ "epoch": 0.5,
19
+ "learning_rate": 0.00019948693233918952,
20
+ "loss": 1.0409,
21
+ "step": 2
22
+ },
23
+ {
24
+ "epoch": 0.75,
25
+ "learning_rate": 0.00019795299412524945,
26
+ "loss": 0.9112,
27
+ "step": 3
28
+ },
29
+ {
30
+ "epoch": 1.0,
31
+ "learning_rate": 0.00019541392564000488,
32
+ "loss": 0.7554,
33
+ "step": 4
34
+ },
35
+ {
36
+ "epoch": 1.25,
37
+ "learning_rate": 0.00019189578116202307,
38
+ "loss": 0.6185,
39
+ "step": 5
40
+ },
41
+ {
42
+ "epoch": 1.5,
43
+ "learning_rate": 0.00018743466161445823,
44
+ "loss": 0.5743,
45
+ "step": 6
46
+ },
47
+ {
48
+ "epoch": 1.75,
49
+ "learning_rate": 0.00018207634412072764,
50
+ "loss": 0.5785,
51
+ "step": 7
52
+ },
53
+ {
54
+ "epoch": 2.0,
55
+ "learning_rate": 0.0001758758122692791,
56
+ "loss": 0.436,
57
+ "step": 8
58
+ },
59
+ {
60
+ "epoch": 2.25,
61
+ "learning_rate": 0.00016889669190756868,
62
+ "loss": 0.3596,
63
+ "step": 9
64
+ },
65
+ {
66
+ "epoch": 2.5,
67
+ "learning_rate": 0.0001612105982547663,
68
+ "loss": 0.3703,
69
+ "step": 10
70
+ },
71
+ {
72
+ "epoch": 2.75,
73
+ "learning_rate": 0.00015289640103269625,
74
+ "loss": 0.2485,
75
+ "step": 11
76
+ },
77
+ {
78
+ "epoch": 3.0,
79
+ "learning_rate": 0.00014403941515576344,
80
+ "loss": 0.2869,
81
+ "step": 12
82
+ },
83
+ {
84
+ "epoch": 3.25,
85
+ "learning_rate": 0.00013473052528448201,
86
+ "loss": 0.1574,
87
+ "step": 13
88
+ },
89
+ {
90
+ "epoch": 3.5,
91
+ "learning_rate": 0.00012506525322587207,
92
+ "loss": 0.2161,
93
+ "step": 14
94
+ },
95
+ {
96
+ "epoch": 3.75,
97
+ "learning_rate": 0.00011514277775045768,
98
+ "loss": 0.1179,
99
+ "step": 15
100
+ },
101
+ {
102
+ "epoch": 4.0,
103
+ "learning_rate": 0.00010506491688387127,
104
+ "loss": 0.1789,
105
+ "step": 16
106
+ },
107
+ {
108
+ "epoch": 4.25,
109
+ "learning_rate": 9.493508311612874e-05,
110
+ "loss": 0.0866,
111
+ "step": 17
112
+ },
113
+ {
114
+ "epoch": 4.5,
115
+ "learning_rate": 8.485722224954237e-05,
116
+ "loss": 0.0816,
117
+ "step": 18
118
+ },
119
+ {
120
+ "epoch": 4.75,
121
+ "learning_rate": 7.493474677412794e-05,
122
+ "loss": 0.0849,
123
+ "step": 19
124
+ },
125
+ {
126
+ "epoch": 5.0,
127
+ "learning_rate": 6.526947471551798e-05,
128
+ "loss": 0.0903,
129
+ "step": 20
130
+ },
131
+ {
132
+ "epoch": 5.25,
133
+ "learning_rate": 5.596058484423656e-05,
134
+ "loss": 0.0444,
135
+ "step": 21
136
+ },
137
+ {
138
+ "epoch": 5.5,
139
+ "learning_rate": 4.710359896730379e-05,
140
+ "loss": 0.0389,
141
+ "step": 22
142
+ },
143
+ {
144
+ "epoch": 5.75,
145
+ "learning_rate": 3.878940174523371e-05,
146
+ "loss": 0.0437,
147
+ "step": 23
148
+ },
149
+ {
150
+ "epoch": 6.0,
151
+ "learning_rate": 3.110330809243134e-05,
152
+ "loss": 0.055,
153
+ "step": 24
154
+ },
155
+ {
156
+ "epoch": 6.25,
157
+ "learning_rate": 2.4124187730720917e-05,
158
+ "loss": 0.0347,
159
+ "step": 25
160
+ },
161
+ {
162
+ "epoch": 6.5,
163
+ "learning_rate": 1.7923655879272393e-05,
164
+ "loss": 0.0194,
165
+ "step": 26
166
+ },
167
+ {
168
+ "epoch": 6.75,
169
+ "learning_rate": 1.2565338385541792e-05,
170
+ "loss": 0.0299,
171
+ "step": 27
172
+ },
173
+ {
174
+ "epoch": 7.0,
175
+ "learning_rate": 8.10421883797694e-06,
176
+ "loss": 0.0329,
177
+ "step": 28
178
+ },
179
+ {
180
+ "epoch": 7.25,
181
+ "learning_rate": 4.586074359995119e-06,
182
+ "loss": 0.0189,
183
+ "step": 29
184
+ },
185
+ {
186
+ "epoch": 7.5,
187
+ "learning_rate": 2.0470058747505516e-06,
188
+ "loss": 0.0244,
189
+ "step": 30
190
+ },
191
+ {
192
+ "epoch": 7.75,
193
+ "learning_rate": 5.130676608104845e-07,
194
+ "loss": 0.0259,
195
+ "step": 31
196
+ },
197
+ {
198
+ "epoch": 8.0,
199
+ "learning_rate": 0.0,
200
+ "loss": 0.0235,
201
+ "step": 32
202
+ },
203
+ {
204
+ "epoch": 8.0,
205
+ "step": 32,
206
+ "total_flos": 1564227624960.0,
207
+ "train_loss": 0.27154927648371086,
208
+ "train_runtime": 170.0181,
209
+ "train_samples_per_second": 2.823,
210
+ "train_steps_per_second": 0.188
211
+ }
212
+ ],
213
+ "logging_steps": 1.0,
214
+ "max_steps": 32,
215
+ "num_input_tokens_seen": 0,
216
+ "num_train_epochs": 8,
217
+ "save_steps": 50000,
218
+ "total_flos": 1564227624960.0,
219
+ "train_batch_size": 16,
220
+ "trial_name": null,
221
+ "trial_params": null
222
+ }
My_new_LLaVA/llava-ftmodel/config.json ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "liuhaotian/llava-v1.5-7b",
3
+ "architectures": [
4
+ "LlavaLlamaForCausalLM"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "freeze_mm_mlp_adapter": false,
11
+ "freeze_mm_vision_resampler": false,
12
+ "hidden_act": "silu",
13
+ "hidden_size": 4096,
14
+ "image_aspect_ratio": "pad",
15
+ "initializer_range": 0.02,
16
+ "intermediate_size": 11008,
17
+ "max_length": 4096,
18
+ "max_position_embeddings": 4096,
19
+ "mm_hidden_size": 1024,
20
+ "mm_patch_merge_type": "flat",
21
+ "mm_projector_lr": 2e-05,
22
+ "mm_projector_type": "mlp2x_gelu",
23
+ "mm_resampler_type": null,
24
+ "mm_use_im_patch_token": false,
25
+ "mm_use_im_start_end": false,
26
+ "mm_vision_select_feature": "patch",
27
+ "mm_vision_select_layer": -2,
28
+ "mm_vision_tower": "openai/clip-vit-large-patch14-336",
29
+ "model_type": "llava_llama",
30
+ "num_attention_heads": 32,
31
+ "num_hidden_layers": 32,
32
+ "num_key_value_heads": 32,
33
+ "pad_token_id": 0,
34
+ "pretraining_tp": 1,
35
+ "rms_norm_eps": 1e-05,
36
+ "rope_scaling": null,
37
+ "rope_theta": 10000.0,
38
+ "tie_word_embeddings": false,
39
+ "tokenizer_model_max_length": 2048,
40
+ "tokenizer_padding_side": "right",
41
+ "torch_dtype": "float16",
42
+ "transformers_version": "4.37.2",
43
+ "tune_mm_mlp_adapter": false,
44
+ "tune_mm_vision_resampler": false,
45
+ "unfreeze_mm_vision_tower": false,
46
+ "use_cache": true,
47
+ "use_mm_proj": true,
48
+ "vocab_size": 32000
49
+ }
My_new_LLaVA/llava-ftmodel/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 1,
3
+ "eos_token_id": 2,
4
+ "max_length": 4096,
5
+ "pad_token_id": 0,
6
+ "transformers_version": "4.37.2"
7
+ }
My_new_LLaVA/llava-ftmodel/model.safetensors.index.json ADDED
@@ -0,0 +1,693 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 14125805568
4
+ },
5
+ "weight_map": {
6
+ "lm_head.weight": "model-00003-of-00003.safetensors",
7
+ "model.embed_tokens.weight": "model-00001-of-00003.safetensors",
8
+ "model.layers.0.input_layernorm.weight": "model-00001-of-00003.safetensors",
9
+ "model.layers.0.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
10
+ "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
11
+ "model.layers.0.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
12
+ "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
13
+ "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
14
+ "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
15
+ "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
16
+ "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
17
+ "model.layers.1.input_layernorm.weight": "model-00001-of-00003.safetensors",
18
+ "model.layers.1.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
19
+ "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
20
+ "model.layers.1.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
21
+ "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
22
+ "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
23
+ "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
24
+ "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
25
+ "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
26
+ "model.layers.10.input_layernorm.weight": "model-00001-of-00003.safetensors",
27
+ "model.layers.10.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
28
+ "model.layers.10.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
29
+ "model.layers.10.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
30
+ "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
31
+ "model.layers.10.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
32
+ "model.layers.10.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
33
+ "model.layers.10.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
34
+ "model.layers.10.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
35
+ "model.layers.11.input_layernorm.weight": "model-00002-of-00003.safetensors",
36
+ "model.layers.11.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
37
+ "model.layers.11.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
38
+ "model.layers.11.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
39
+ "model.layers.11.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
40
+ "model.layers.11.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
41
+ "model.layers.11.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
42
+ "model.layers.11.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
43
+ "model.layers.11.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
44
+ "model.layers.12.input_layernorm.weight": "model-00002-of-00003.safetensors",
45
+ "model.layers.12.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
46
+ "model.layers.12.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
47
+ "model.layers.12.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
48
+ "model.layers.12.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
49
+ "model.layers.12.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
50
+ "model.layers.12.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
51
+ "model.layers.12.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
52
+ "model.layers.12.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
53
+ "model.layers.13.input_layernorm.weight": "model-00002-of-00003.safetensors",
54
+ "model.layers.13.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
55
+ "model.layers.13.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
56
+ "model.layers.13.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
57
+ "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
58
+ "model.layers.13.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
59
+ "model.layers.13.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
60
+ "model.layers.13.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
61
+ "model.layers.13.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
62
+ "model.layers.14.input_layernorm.weight": "model-00002-of-00003.safetensors",
63
+ "model.layers.14.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
64
+ "model.layers.14.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
65
+ "model.layers.14.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
66
+ "model.layers.14.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
67
+ "model.layers.14.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
68
+ "model.layers.14.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
69
+ "model.layers.14.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
70
+ "model.layers.14.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
71
+ "model.layers.15.input_layernorm.weight": "model-00002-of-00003.safetensors",
72
+ "model.layers.15.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
73
+ "model.layers.15.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
74
+ "model.layers.15.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
75
+ "model.layers.15.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
76
+ "model.layers.15.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
77
+ "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
78
+ "model.layers.15.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
79
+ "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
80
+ "model.layers.16.input_layernorm.weight": "model-00002-of-00003.safetensors",
81
+ "model.layers.16.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
82
+ "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
83
+ "model.layers.16.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
84
+ "model.layers.16.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
85
+ "model.layers.16.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
86
+ "model.layers.16.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
87
+ "model.layers.16.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
88
+ "model.layers.16.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
89
+ "model.layers.17.input_layernorm.weight": "model-00002-of-00003.safetensors",
90
+ "model.layers.17.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
91
+ "model.layers.17.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
92
+ "model.layers.17.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
93
+ "model.layers.17.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
94
+ "model.layers.17.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
95
+ "model.layers.17.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
96
+ "model.layers.17.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
97
+ "model.layers.17.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
98
+ "model.layers.18.input_layernorm.weight": "model-00002-of-00003.safetensors",
99
+ "model.layers.18.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
100
+ "model.layers.18.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
101
+ "model.layers.18.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
102
+ "model.layers.18.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
103
+ "model.layers.18.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
104
+ "model.layers.18.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
105
+ "model.layers.18.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
106
+ "model.layers.18.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
107
+ "model.layers.19.input_layernorm.weight": "model-00002-of-00003.safetensors",
108
+ "model.layers.19.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
109
+ "model.layers.19.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
110
+ "model.layers.19.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
111
+ "model.layers.19.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
112
+ "model.layers.19.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
113
+ "model.layers.19.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
114
+ "model.layers.19.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
115
+ "model.layers.19.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
116
+ "model.layers.2.input_layernorm.weight": "model-00001-of-00003.safetensors",
117
+ "model.layers.2.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
118
+ "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
119
+ "model.layers.2.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
120
+ "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
121
+ "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
122
+ "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
123
+ "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
124
+ "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
125
+ "model.layers.20.input_layernorm.weight": "model-00002-of-00003.safetensors",
126
+ "model.layers.20.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
127
+ "model.layers.20.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
128
+ "model.layers.20.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
129
+ "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
130
+ "model.layers.20.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
131
+ "model.layers.20.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
132
+ "model.layers.20.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
133
+ "model.layers.20.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
134
+ "model.layers.21.input_layernorm.weight": "model-00002-of-00003.safetensors",
135
+ "model.layers.21.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
136
+ "model.layers.21.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
137
+ "model.layers.21.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
138
+ "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
139
+ "model.layers.21.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
140
+ "model.layers.21.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
141
+ "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
142
+ "model.layers.21.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
143
+ "model.layers.22.input_layernorm.weight": "model-00002-of-00003.safetensors",
144
+ "model.layers.22.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
145
+ "model.layers.22.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
146
+ "model.layers.22.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
147
+ "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
148
+ "model.layers.22.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
149
+ "model.layers.22.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
150
+ "model.layers.22.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
151
+ "model.layers.22.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
152
+ "model.layers.23.input_layernorm.weight": "model-00003-of-00003.safetensors",
153
+ "model.layers.23.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
154
+ "model.layers.23.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
155
+ "model.layers.23.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
156
+ "model.layers.23.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
157
+ "model.layers.23.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
158
+ "model.layers.23.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
159
+ "model.layers.23.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
160
+ "model.layers.23.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
161
+ "model.layers.24.input_layernorm.weight": "model-00003-of-00003.safetensors",
162
+ "model.layers.24.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
163
+ "model.layers.24.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
164
+ "model.layers.24.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
165
+ "model.layers.24.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
166
+ "model.layers.24.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
167
+ "model.layers.24.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
168
+ "model.layers.24.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
169
+ "model.layers.24.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
170
+ "model.layers.25.input_layernorm.weight": "model-00003-of-00003.safetensors",
171
+ "model.layers.25.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
172
+ "model.layers.25.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
173
+ "model.layers.25.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
174
+ "model.layers.25.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
175
+ "model.layers.25.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
176
+ "model.layers.25.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
177
+ "model.layers.25.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
178
+ "model.layers.25.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
179
+ "model.layers.26.input_layernorm.weight": "model-00003-of-00003.safetensors",
180
+ "model.layers.26.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
181
+ "model.layers.26.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
182
+ "model.layers.26.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
183
+ "model.layers.26.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
184
+ "model.layers.26.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
185
+ "model.layers.26.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
186
+ "model.layers.26.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
187
+ "model.layers.26.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
188
+ "model.layers.27.input_layernorm.weight": "model-00003-of-00003.safetensors",
189
+ "model.layers.27.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
190
+ "model.layers.27.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
191
+ "model.layers.27.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
192
+ "model.layers.27.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
193
+ "model.layers.27.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
194
+ "model.layers.27.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
195
+ "model.layers.27.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
196
+ "model.layers.27.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
197
+ "model.layers.28.input_layernorm.weight": "model-00003-of-00003.safetensors",
198
+ "model.layers.28.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
199
+ "model.layers.28.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
200
+ "model.layers.28.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
201
+ "model.layers.28.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
202
+ "model.layers.28.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
203
+ "model.layers.28.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
204
+ "model.layers.28.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
205
+ "model.layers.28.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
206
+ "model.layers.29.input_layernorm.weight": "model-00003-of-00003.safetensors",
207
+ "model.layers.29.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
208
+ "model.layers.29.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
209
+ "model.layers.29.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
210
+ "model.layers.29.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
211
+ "model.layers.29.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
212
+ "model.layers.29.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
213
+ "model.layers.29.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
214
+ "model.layers.29.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
215
+ "model.layers.3.input_layernorm.weight": "model-00001-of-00003.safetensors",
216
+ "model.layers.3.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
217
+ "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
218
+ "model.layers.3.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
219
+ "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
220
+ "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
221
+ "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
222
+ "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
223
+ "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
224
+ "model.layers.30.input_layernorm.weight": "model-00003-of-00003.safetensors",
225
+ "model.layers.30.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
226
+ "model.layers.30.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
227
+ "model.layers.30.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
228
+ "model.layers.30.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
229
+ "model.layers.30.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
230
+ "model.layers.30.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
231
+ "model.layers.30.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
232
+ "model.layers.30.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
233
+ "model.layers.31.input_layernorm.weight": "model-00003-of-00003.safetensors",
234
+ "model.layers.31.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
235
+ "model.layers.31.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
236
+ "model.layers.31.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
237
+ "model.layers.31.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
238
+ "model.layers.31.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
239
+ "model.layers.31.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
240
+ "model.layers.31.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
241
+ "model.layers.31.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
242
+ "model.layers.4.input_layernorm.weight": "model-00001-of-00003.safetensors",
243
+ "model.layers.4.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
244
+ "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
245
+ "model.layers.4.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
246
+ "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
247
+ "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
248
+ "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
249
+ "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
250
+ "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
251
+ "model.layers.5.input_layernorm.weight": "model-00001-of-00003.safetensors",
252
+ "model.layers.5.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
253
+ "model.layers.5.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
254
+ "model.layers.5.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
255
+ "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
256
+ "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
257
+ "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
258
+ "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
259
+ "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
260
+ "model.layers.6.input_layernorm.weight": "model-00001-of-00003.safetensors",
261
+ "model.layers.6.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
262
+ "model.layers.6.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
263
+ "model.layers.6.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
264
+ "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
265
+ "model.layers.6.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
266
+ "model.layers.6.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
267
+ "model.layers.6.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
268
+ "model.layers.6.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
269
+ "model.layers.7.input_layernorm.weight": "model-00001-of-00003.safetensors",
270
+ "model.layers.7.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
271
+ "model.layers.7.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
272
+ "model.layers.7.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
273
+ "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
274
+ "model.layers.7.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
275
+ "model.layers.7.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
276
+ "model.layers.7.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
277
+ "model.layers.7.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
278
+ "model.layers.8.input_layernorm.weight": "model-00001-of-00003.safetensors",
279
+ "model.layers.8.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
280
+ "model.layers.8.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
281
+ "model.layers.8.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
282
+ "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
283
+ "model.layers.8.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
284
+ "model.layers.8.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
285
+ "model.layers.8.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
286
+ "model.layers.8.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
287
+ "model.layers.9.input_layernorm.weight": "model-00001-of-00003.safetensors",
288
+ "model.layers.9.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
289
+ "model.layers.9.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
290
+ "model.layers.9.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
291
+ "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
292
+ "model.layers.9.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
293
+ "model.layers.9.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
294
+ "model.layers.9.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
295
+ "model.layers.9.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
296
+ "model.mm_projector.0.bias": "model-00003-of-00003.safetensors",
297
+ "model.mm_projector.0.weight": "model-00003-of-00003.safetensors",
298
+ "model.mm_projector.2.bias": "model-00003-of-00003.safetensors",
299
+ "model.mm_projector.2.weight": "model-00003-of-00003.safetensors",
300
+ "model.norm.weight": "model-00003-of-00003.safetensors",
301
+ "model.vision_tower.vision_tower.vision_model.embeddings.class_embedding": "model-00003-of-00003.safetensors",
302
+ "model.vision_tower.vision_tower.vision_model.embeddings.patch_embedding.weight": "model-00003-of-00003.safetensors",
303
+ "model.vision_tower.vision_tower.vision_model.embeddings.position_embedding.weight": "model-00003-of-00003.safetensors",
304
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.layer_norm1.bias": "model-00003-of-00003.safetensors",
305
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.layer_norm1.weight": "model-00003-of-00003.safetensors",
306
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.layer_norm2.bias": "model-00003-of-00003.safetensors",
307
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.layer_norm2.weight": "model-00003-of-00003.safetensors",
308
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.mlp.fc1.bias": "model-00003-of-00003.safetensors",
309
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.mlp.fc1.weight": "model-00003-of-00003.safetensors",
310
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.mlp.fc2.bias": "model-00003-of-00003.safetensors",
311
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.mlp.fc2.weight": "model-00003-of-00003.safetensors",
312
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
313
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
314
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
315
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
316
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
317
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
318
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
319
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.0.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
320
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.layer_norm1.bias": "model-00003-of-00003.safetensors",
321
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.layer_norm1.weight": "model-00003-of-00003.safetensors",
322
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.layer_norm2.bias": "model-00003-of-00003.safetensors",
323
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.layer_norm2.weight": "model-00003-of-00003.safetensors",
324
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.mlp.fc1.bias": "model-00003-of-00003.safetensors",
325
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.mlp.fc1.weight": "model-00003-of-00003.safetensors",
326
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.mlp.fc2.bias": "model-00003-of-00003.safetensors",
327
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.mlp.fc2.weight": "model-00003-of-00003.safetensors",
328
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
329
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
330
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
331
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
332
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
333
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
334
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
335
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.1.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
336
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.layer_norm1.bias": "model-00003-of-00003.safetensors",
337
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.layer_norm1.weight": "model-00003-of-00003.safetensors",
338
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.layer_norm2.bias": "model-00003-of-00003.safetensors",
339
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.layer_norm2.weight": "model-00003-of-00003.safetensors",
340
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.mlp.fc1.bias": "model-00003-of-00003.safetensors",
341
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.mlp.fc1.weight": "model-00003-of-00003.safetensors",
342
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.mlp.fc2.bias": "model-00003-of-00003.safetensors",
343
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.mlp.fc2.weight": "model-00003-of-00003.safetensors",
344
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
345
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
346
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
347
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
348
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
349
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
350
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
351
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.10.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
352
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.layer_norm1.bias": "model-00003-of-00003.safetensors",
353
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.layer_norm1.weight": "model-00003-of-00003.safetensors",
354
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.layer_norm2.bias": "model-00003-of-00003.safetensors",
355
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.layer_norm2.weight": "model-00003-of-00003.safetensors",
356
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.mlp.fc1.bias": "model-00003-of-00003.safetensors",
357
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.mlp.fc1.weight": "model-00003-of-00003.safetensors",
358
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.mlp.fc2.bias": "model-00003-of-00003.safetensors",
359
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.mlp.fc2.weight": "model-00003-of-00003.safetensors",
360
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
361
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
362
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
363
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
364
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
365
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
366
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
367
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.11.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
368
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.layer_norm1.bias": "model-00003-of-00003.safetensors",
369
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.layer_norm1.weight": "model-00003-of-00003.safetensors",
370
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.layer_norm2.bias": "model-00003-of-00003.safetensors",
371
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.layer_norm2.weight": "model-00003-of-00003.safetensors",
372
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.mlp.fc1.bias": "model-00003-of-00003.safetensors",
373
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.mlp.fc1.weight": "model-00003-of-00003.safetensors",
374
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.mlp.fc2.bias": "model-00003-of-00003.safetensors",
375
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.mlp.fc2.weight": "model-00003-of-00003.safetensors",
376
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
377
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
378
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
379
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
380
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
381
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
382
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
383
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.12.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
384
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.layer_norm1.bias": "model-00003-of-00003.safetensors",
385
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.layer_norm1.weight": "model-00003-of-00003.safetensors",
386
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.layer_norm2.bias": "model-00003-of-00003.safetensors",
387
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.layer_norm2.weight": "model-00003-of-00003.safetensors",
388
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.mlp.fc1.bias": "model-00003-of-00003.safetensors",
389
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.mlp.fc1.weight": "model-00003-of-00003.safetensors",
390
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.mlp.fc2.bias": "model-00003-of-00003.safetensors",
391
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.mlp.fc2.weight": "model-00003-of-00003.safetensors",
392
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
393
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
394
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
395
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
396
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
397
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
398
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
399
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.13.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
400
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.layer_norm1.bias": "model-00003-of-00003.safetensors",
401
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.layer_norm1.weight": "model-00003-of-00003.safetensors",
402
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.layer_norm2.bias": "model-00003-of-00003.safetensors",
403
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.layer_norm2.weight": "model-00003-of-00003.safetensors",
404
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.mlp.fc1.bias": "model-00003-of-00003.safetensors",
405
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.mlp.fc1.weight": "model-00003-of-00003.safetensors",
406
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.mlp.fc2.bias": "model-00003-of-00003.safetensors",
407
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.mlp.fc2.weight": "model-00003-of-00003.safetensors",
408
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
409
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
410
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
411
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
412
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
413
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
414
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
415
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.14.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
416
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.layer_norm1.bias": "model-00003-of-00003.safetensors",
417
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.layer_norm1.weight": "model-00003-of-00003.safetensors",
418
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.layer_norm2.bias": "model-00003-of-00003.safetensors",
419
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.layer_norm2.weight": "model-00003-of-00003.safetensors",
420
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.mlp.fc1.bias": "model-00003-of-00003.safetensors",
421
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.mlp.fc1.weight": "model-00003-of-00003.safetensors",
422
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.mlp.fc2.bias": "model-00003-of-00003.safetensors",
423
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.mlp.fc2.weight": "model-00003-of-00003.safetensors",
424
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
425
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
426
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
427
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
428
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
429
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
430
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
431
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.15.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
432
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.layer_norm1.bias": "model-00003-of-00003.safetensors",
433
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.layer_norm1.weight": "model-00003-of-00003.safetensors",
434
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.layer_norm2.bias": "model-00003-of-00003.safetensors",
435
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.layer_norm2.weight": "model-00003-of-00003.safetensors",
436
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.mlp.fc1.bias": "model-00003-of-00003.safetensors",
437
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.mlp.fc1.weight": "model-00003-of-00003.safetensors",
438
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.mlp.fc2.bias": "model-00003-of-00003.safetensors",
439
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.mlp.fc2.weight": "model-00003-of-00003.safetensors",
440
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
441
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
442
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
443
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
444
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
445
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
446
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
447
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.16.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
448
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.layer_norm1.bias": "model-00003-of-00003.safetensors",
449
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.layer_norm1.weight": "model-00003-of-00003.safetensors",
450
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.layer_norm2.bias": "model-00003-of-00003.safetensors",
451
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.layer_norm2.weight": "model-00003-of-00003.safetensors",
452
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.mlp.fc1.bias": "model-00003-of-00003.safetensors",
453
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.mlp.fc1.weight": "model-00003-of-00003.safetensors",
454
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.mlp.fc2.bias": "model-00003-of-00003.safetensors",
455
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.mlp.fc2.weight": "model-00003-of-00003.safetensors",
456
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
457
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
458
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
459
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
460
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
461
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
462
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
463
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.17.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
464
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.layer_norm1.bias": "model-00003-of-00003.safetensors",
465
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.layer_norm1.weight": "model-00003-of-00003.safetensors",
466
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.layer_norm2.bias": "model-00003-of-00003.safetensors",
467
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.layer_norm2.weight": "model-00003-of-00003.safetensors",
468
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.mlp.fc1.bias": "model-00003-of-00003.safetensors",
469
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.mlp.fc1.weight": "model-00003-of-00003.safetensors",
470
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.mlp.fc2.bias": "model-00003-of-00003.safetensors",
471
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.mlp.fc2.weight": "model-00003-of-00003.safetensors",
472
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
473
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
474
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
475
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
476
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
477
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
478
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
479
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.18.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
480
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.layer_norm1.bias": "model-00003-of-00003.safetensors",
481
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.layer_norm1.weight": "model-00003-of-00003.safetensors",
482
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.layer_norm2.bias": "model-00003-of-00003.safetensors",
483
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.layer_norm2.weight": "model-00003-of-00003.safetensors",
484
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.mlp.fc1.bias": "model-00003-of-00003.safetensors",
485
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.mlp.fc1.weight": "model-00003-of-00003.safetensors",
486
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.mlp.fc2.bias": "model-00003-of-00003.safetensors",
487
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.mlp.fc2.weight": "model-00003-of-00003.safetensors",
488
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
489
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
490
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
491
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
492
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
493
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
494
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
495
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.19.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
496
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.layer_norm1.bias": "model-00003-of-00003.safetensors",
497
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.layer_norm1.weight": "model-00003-of-00003.safetensors",
498
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.layer_norm2.bias": "model-00003-of-00003.safetensors",
499
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.layer_norm2.weight": "model-00003-of-00003.safetensors",
500
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.mlp.fc1.bias": "model-00003-of-00003.safetensors",
501
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.mlp.fc1.weight": "model-00003-of-00003.safetensors",
502
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.mlp.fc2.bias": "model-00003-of-00003.safetensors",
503
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.mlp.fc2.weight": "model-00003-of-00003.safetensors",
504
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
505
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
506
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
507
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
508
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
509
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
510
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
511
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.2.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
512
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.layer_norm1.bias": "model-00003-of-00003.safetensors",
513
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.layer_norm1.weight": "model-00003-of-00003.safetensors",
514
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.layer_norm2.bias": "model-00003-of-00003.safetensors",
515
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.layer_norm2.weight": "model-00003-of-00003.safetensors",
516
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.mlp.fc1.bias": "model-00003-of-00003.safetensors",
517
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.mlp.fc1.weight": "model-00003-of-00003.safetensors",
518
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.mlp.fc2.bias": "model-00003-of-00003.safetensors",
519
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.mlp.fc2.weight": "model-00003-of-00003.safetensors",
520
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
521
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
522
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
523
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
524
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
525
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
526
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
527
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.20.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
528
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.layer_norm1.bias": "model-00003-of-00003.safetensors",
529
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.layer_norm1.weight": "model-00003-of-00003.safetensors",
530
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.layer_norm2.bias": "model-00003-of-00003.safetensors",
531
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.layer_norm2.weight": "model-00003-of-00003.safetensors",
532
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.mlp.fc1.bias": "model-00003-of-00003.safetensors",
533
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.mlp.fc1.weight": "model-00003-of-00003.safetensors",
534
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.mlp.fc2.bias": "model-00003-of-00003.safetensors",
535
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.mlp.fc2.weight": "model-00003-of-00003.safetensors",
536
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
537
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
538
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
539
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
540
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
541
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
542
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
543
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.21.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
544
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.layer_norm1.bias": "model-00003-of-00003.safetensors",
545
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.layer_norm1.weight": "model-00003-of-00003.safetensors",
546
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.layer_norm2.bias": "model-00003-of-00003.safetensors",
547
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.layer_norm2.weight": "model-00003-of-00003.safetensors",
548
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.mlp.fc1.bias": "model-00003-of-00003.safetensors",
549
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.mlp.fc1.weight": "model-00003-of-00003.safetensors",
550
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.mlp.fc2.bias": "model-00003-of-00003.safetensors",
551
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.mlp.fc2.weight": "model-00003-of-00003.safetensors",
552
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
553
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
554
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
555
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
556
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
557
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
558
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
559
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.22.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
560
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.layer_norm1.bias": "model-00003-of-00003.safetensors",
561
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.layer_norm1.weight": "model-00003-of-00003.safetensors",
562
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.layer_norm2.bias": "model-00003-of-00003.safetensors",
563
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.layer_norm2.weight": "model-00003-of-00003.safetensors",
564
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.mlp.fc1.bias": "model-00003-of-00003.safetensors",
565
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.mlp.fc1.weight": "model-00003-of-00003.safetensors",
566
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.mlp.fc2.bias": "model-00003-of-00003.safetensors",
567
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.mlp.fc2.weight": "model-00003-of-00003.safetensors",
568
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
569
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
570
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
571
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
572
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
573
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
574
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
575
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.23.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
576
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.layer_norm1.bias": "model-00003-of-00003.safetensors",
577
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.layer_norm1.weight": "model-00003-of-00003.safetensors",
578
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.layer_norm2.bias": "model-00003-of-00003.safetensors",
579
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.layer_norm2.weight": "model-00003-of-00003.safetensors",
580
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.mlp.fc1.bias": "model-00003-of-00003.safetensors",
581
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.mlp.fc1.weight": "model-00003-of-00003.safetensors",
582
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.mlp.fc2.bias": "model-00003-of-00003.safetensors",
583
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.mlp.fc2.weight": "model-00003-of-00003.safetensors",
584
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
585
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
586
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
587
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
588
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
589
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
590
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
591
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.3.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
592
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.layer_norm1.bias": "model-00003-of-00003.safetensors",
593
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.layer_norm1.weight": "model-00003-of-00003.safetensors",
594
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.layer_norm2.bias": "model-00003-of-00003.safetensors",
595
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.layer_norm2.weight": "model-00003-of-00003.safetensors",
596
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.mlp.fc1.bias": "model-00003-of-00003.safetensors",
597
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.mlp.fc1.weight": "model-00003-of-00003.safetensors",
598
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.mlp.fc2.bias": "model-00003-of-00003.safetensors",
599
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.mlp.fc2.weight": "model-00003-of-00003.safetensors",
600
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
601
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
602
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
603
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
604
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
605
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
606
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
607
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.4.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
608
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.layer_norm1.bias": "model-00003-of-00003.safetensors",
609
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.layer_norm1.weight": "model-00003-of-00003.safetensors",
610
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.layer_norm2.bias": "model-00003-of-00003.safetensors",
611
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.layer_norm2.weight": "model-00003-of-00003.safetensors",
612
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.mlp.fc1.bias": "model-00003-of-00003.safetensors",
613
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.mlp.fc1.weight": "model-00003-of-00003.safetensors",
614
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.mlp.fc2.bias": "model-00003-of-00003.safetensors",
615
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.mlp.fc2.weight": "model-00003-of-00003.safetensors",
616
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
617
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
618
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
619
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
620
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
621
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
622
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
623
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.5.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
624
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.layer_norm1.bias": "model-00003-of-00003.safetensors",
625
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.layer_norm1.weight": "model-00003-of-00003.safetensors",
626
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.layer_norm2.bias": "model-00003-of-00003.safetensors",
627
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.layer_norm2.weight": "model-00003-of-00003.safetensors",
628
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.mlp.fc1.bias": "model-00003-of-00003.safetensors",
629
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.mlp.fc1.weight": "model-00003-of-00003.safetensors",
630
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.mlp.fc2.bias": "model-00003-of-00003.safetensors",
631
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.mlp.fc2.weight": "model-00003-of-00003.safetensors",
632
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
633
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
634
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
635
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
636
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
637
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
638
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
639
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.6.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
640
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.layer_norm1.bias": "model-00003-of-00003.safetensors",
641
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.layer_norm1.weight": "model-00003-of-00003.safetensors",
642
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.layer_norm2.bias": "model-00003-of-00003.safetensors",
643
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.layer_norm2.weight": "model-00003-of-00003.safetensors",
644
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.mlp.fc1.bias": "model-00003-of-00003.safetensors",
645
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.mlp.fc1.weight": "model-00003-of-00003.safetensors",
646
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.mlp.fc2.bias": "model-00003-of-00003.safetensors",
647
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.mlp.fc2.weight": "model-00003-of-00003.safetensors",
648
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
649
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
650
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
651
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
652
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
653
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
654
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
655
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.7.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
656
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.layer_norm1.bias": "model-00003-of-00003.safetensors",
657
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.layer_norm1.weight": "model-00003-of-00003.safetensors",
658
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.layer_norm2.bias": "model-00003-of-00003.safetensors",
659
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.layer_norm2.weight": "model-00003-of-00003.safetensors",
660
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.mlp.fc1.bias": "model-00003-of-00003.safetensors",
661
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.mlp.fc1.weight": "model-00003-of-00003.safetensors",
662
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.mlp.fc2.bias": "model-00003-of-00003.safetensors",
663
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.mlp.fc2.weight": "model-00003-of-00003.safetensors",
664
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
665
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
666
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
667
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
668
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
669
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
670
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
671
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.8.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
672
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.layer_norm1.bias": "model-00003-of-00003.safetensors",
673
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.layer_norm1.weight": "model-00003-of-00003.safetensors",
674
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.layer_norm2.bias": "model-00003-of-00003.safetensors",
675
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.layer_norm2.weight": "model-00003-of-00003.safetensors",
676
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.mlp.fc1.bias": "model-00003-of-00003.safetensors",
677
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.mlp.fc1.weight": "model-00003-of-00003.safetensors",
678
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.mlp.fc2.bias": "model-00003-of-00003.safetensors",
679
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.mlp.fc2.weight": "model-00003-of-00003.safetensors",
680
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.k_proj.bias": "model-00003-of-00003.safetensors",
681
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
682
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.out_proj.bias": "model-00003-of-00003.safetensors",
683
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.out_proj.weight": "model-00003-of-00003.safetensors",
684
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.q_proj.bias": "model-00003-of-00003.safetensors",
685
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
686
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.v_proj.bias": "model-00003-of-00003.safetensors",
687
+ "model.vision_tower.vision_tower.vision_model.encoder.layers.9.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
688
+ "model.vision_tower.vision_tower.vision_model.post_layernorm.bias": "model-00003-of-00003.safetensors",
689
+ "model.vision_tower.vision_tower.vision_model.post_layernorm.weight": "model-00003-of-00003.safetensors",
690
+ "model.vision_tower.vision_tower.vision_model.pre_layrnorm.bias": "model-00003-of-00003.safetensors",
691
+ "model.vision_tower.vision_tower.vision_model.pre_layrnorm.weight": "model-00003-of-00003.safetensors"
692
+ }
693
+ }
My_new_LLaVA/llava-ftmodel/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "<unk>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<unk>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
My_new_LLaVA/llava-ftmodel/tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723
My_new_LLaVA/llava-ftmodel/tokenizer_config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "added_tokens_decoder": {
5
+ "0": {
6
+ "content": "<unk>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "1": {
14
+ "content": "<s>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "2": {
22
+ "content": "</s>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ }
29
+ },
30
+ "bos_token": "<s>",
31
+ "clean_up_tokenization_spaces": false,
32
+ "eos_token": "</s>",
33
+ "legacy": false,
34
+ "model_max_length": 2048,
35
+ "pad_token": "<unk>",
36
+ "padding_side": "right",
37
+ "sp_model_kwargs": {},
38
+ "spaces_between_special_tokens": false,
39
+ "tokenizer_class": "LlamaTokenizer",
40
+ "unk_token": "<unk>",
41
+ "use_default_system_prompt": false
42
+ }
My_new_LLaVA/wandb/debug-internal.log ADDED
@@ -0,0 +1 @@
 
 
1
+ offline-run-20240818_061029-xy8wzk0g/logs/debug-internal.log
My_new_LLaVA/wandb/debug.log ADDED
@@ -0,0 +1 @@
 
 
1
+ offline-run-20240818_061029-xy8wzk0g/logs/debug.log
My_new_LLaVA/wandb/latest-run ADDED
@@ -0,0 +1 @@
 
 
1
+ offline-run-20240818_061029-xy8wzk0g
My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/files/wandb-metadata.json ADDED
@@ -0,0 +1,176 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
3
+ "python": "3.10.12",
4
+ "heartbeatAt": "2024-08-18T06:10:29.149052",
5
+ "startedAt": "2024-08-18T06:10:29.000772",
6
+ "docker": null,
7
+ "cuda": null,
8
+ "args": [
9
+ "--local_rank=0",
10
+ "--lora_enable",
11
+ "True",
12
+ "--lora_r",
13
+ "128",
14
+ "--lora_alpha",
15
+ "256",
16
+ "--mm_projector_lr",
17
+ "2e-5",
18
+ "--deepspeed",
19
+ "LLaVA/scripts/zero3.json",
20
+ "--model_name_or_path",
21
+ "liuhaotian/llava-v1.5-7b",
22
+ "--version",
23
+ "v1",
24
+ "--data_path",
25
+ "/content/drive/MyDrive/Colab Notebooks/Final Project/FINAL_DATA/converted_data.json",
26
+ "--image_folder",
27
+ "/content/drive/MyDrive/Colab Notebooks/Final Project/FINAL_DATA/Images",
28
+ "--vision_tower",
29
+ "openai/clip-vit-large-patch14-336",
30
+ "--mm_projector_type",
31
+ "mlp2x_gelu",
32
+ "--mm_vision_select_layer",
33
+ "-2",
34
+ "--mm_use_im_start_end",
35
+ "False",
36
+ "--mm_use_im_patch_token",
37
+ "False",
38
+ "--image_aspect_ratio",
39
+ "pad",
40
+ "--group_by_modality_length",
41
+ "True",
42
+ "--bf16",
43
+ "True",
44
+ "--output_dir",
45
+ "./checkpoints/llava-v1.5-7b-task-lora",
46
+ "--num_train_epochs",
47
+ "8",
48
+ "--per_device_train_batch_size",
49
+ "16",
50
+ "--per_device_eval_batch_size",
51
+ "4",
52
+ "--gradient_accumulation_steps",
53
+ "1",
54
+ "--evaluation_strategy",
55
+ "no",
56
+ "--save_strategy",
57
+ "steps",
58
+ "--save_steps",
59
+ "50000",
60
+ "--save_total_limit",
61
+ "1",
62
+ "--learning_rate",
63
+ "2e-4",
64
+ "--weight_decay",
65
+ "0.",
66
+ "--warmup_ratio",
67
+ "0.03",
68
+ "--lr_scheduler_type",
69
+ "cosine",
70
+ "--logging_steps",
71
+ "1",
72
+ "--tf32",
73
+ "True",
74
+ "--model_max_length",
75
+ "2048",
76
+ "--gradient_checkpointing",
77
+ "True",
78
+ "--dataloader_num_workers",
79
+ "4",
80
+ "--lazy_preprocess",
81
+ "True"
82
+ ],
83
+ "state": "running",
84
+ "program": "/content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/LLaVA/llava/train/train_mem.py",
85
+ "codePathLocal": "LLaVA/llava/train/train_mem.py",
86
+ "codePath": "LLaVA/llava/train/train_mem.py",
87
+ "host": "decfd3532853",
88
+ "username": "root",
89
+ "executable": "/usr/bin/python3",
90
+ "cpu_count": 6,
91
+ "cpu_count_logical": 12,
92
+ "cpu_freq": {
93
+ "current": 2200.1379999999995,
94
+ "min": 0.0,
95
+ "max": 0.0
96
+ },
97
+ "cpu_freq_per_core": [
98
+ {
99
+ "current": 2200.138,
100
+ "min": 0.0,
101
+ "max": 0.0
102
+ },
103
+ {
104
+ "current": 2200.138,
105
+ "min": 0.0,
106
+ "max": 0.0
107
+ },
108
+ {
109
+ "current": 2200.138,
110
+ "min": 0.0,
111
+ "max": 0.0
112
+ },
113
+ {
114
+ "current": 2200.138,
115
+ "min": 0.0,
116
+ "max": 0.0
117
+ },
118
+ {
119
+ "current": 2200.138,
120
+ "min": 0.0,
121
+ "max": 0.0
122
+ },
123
+ {
124
+ "current": 2200.138,
125
+ "min": 0.0,
126
+ "max": 0.0
127
+ },
128
+ {
129
+ "current": 2200.138,
130
+ "min": 0.0,
131
+ "max": 0.0
132
+ },
133
+ {
134
+ "current": 2200.138,
135
+ "min": 0.0,
136
+ "max": 0.0
137
+ },
138
+ {
139
+ "current": 2200.138,
140
+ "min": 0.0,
141
+ "max": 0.0
142
+ },
143
+ {
144
+ "current": 2200.138,
145
+ "min": 0.0,
146
+ "max": 0.0
147
+ },
148
+ {
149
+ "current": 2200.138,
150
+ "min": 0.0,
151
+ "max": 0.0
152
+ },
153
+ {
154
+ "current": 2200.138,
155
+ "min": 0.0,
156
+ "max": 0.0
157
+ }
158
+ ],
159
+ "disk": {
160
+ "/": {
161
+ "total": 201.22513961791992,
162
+ "used": 52.21559143066406
163
+ }
164
+ },
165
+ "gpu": "NVIDIA A100-SXM4-40GB",
166
+ "gpu_count": 1,
167
+ "gpu_devices": [
168
+ {
169
+ "name": "NVIDIA A100-SXM4-40GB",
170
+ "memory_total": 42949672960
171
+ }
172
+ ],
173
+ "memory": {
174
+ "total": 83.47704696655273
175
+ }
176
+ }
My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/files/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_wandb": {"runtime": 166}}
My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug-internal.log ADDED
@@ -0,0 +1,227 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-08-18 06:10:29,062 INFO StreamThr :8404 [internal.py:wandb_internal():85] W&B internal server running at pid: 8404, started at: 2024-08-18 06:10:29.060598
2
+ 2024-08-18 06:10:29,065 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status
3
+ 2024-08-18 06:10:29,071 INFO WriterThread:8404 [datastore.py:open_for_write():87] open: /content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/run-xy8wzk0g.wandb
4
+ 2024-08-18 06:10:29,124 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: run_start
5
+ 2024-08-18 06:10:29,134 DEBUG HandlerThread:8404 [system_info.py:__init__():26] System info init
6
+ 2024-08-18 06:10:29,134 DEBUG HandlerThread:8404 [system_info.py:__init__():41] System info init done
7
+ 2024-08-18 06:10:29,134 INFO HandlerThread:8404 [system_monitor.py:start():194] Starting system monitor
8
+ 2024-08-18 06:10:29,135 INFO SystemMonitor:8404 [system_monitor.py:_start():158] Starting system asset monitoring threads
9
+ 2024-08-18 06:10:29,135 INFO HandlerThread:8404 [system_monitor.py:probe():214] Collecting system info
10
+ 2024-08-18 06:10:29,135 INFO SystemMonitor:8404 [interfaces.py:start():188] Started cpu monitoring
11
+ 2024-08-18 06:10:29,136 INFO SystemMonitor:8404 [interfaces.py:start():188] Started disk monitoring
12
+ 2024-08-18 06:10:29,137 INFO SystemMonitor:8404 [interfaces.py:start():188] Started gpu monitoring
13
+ 2024-08-18 06:10:29,138 INFO SystemMonitor:8404 [interfaces.py:start():188] Started memory monitoring
14
+ 2024-08-18 06:10:29,139 INFO SystemMonitor:8404 [interfaces.py:start():188] Started network monitoring
15
+ 2024-08-18 06:10:29,148 DEBUG HandlerThread:8404 [system_info.py:probe():152] Probing system
16
+ 2024-08-18 06:10:29,153 DEBUG HandlerThread:8404 [gitlib.py:_init_repo():56] git repository is invalid
17
+ 2024-08-18 06:10:29,154 DEBUG HandlerThread:8404 [system_info.py:probe():200] Probing system done
18
+ 2024-08-18 06:10:29,154 DEBUG HandlerThread:8404 [system_monitor.py:probe():223] {'os': 'Linux-6.1.85+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-08-18T06:10:29.149052', 'startedAt': '2024-08-18T06:10:29.000772', 'docker': None, 'cuda': None, 'args': ('--local_rank=0', '--lora_enable', 'True', '--lora_r', '128', '--lora_alpha', '256', '--mm_projector_lr', '2e-5', '--deepspeed', 'LLaVA/scripts/zero3.json', '--model_name_or_path', 'liuhaotian/llava-v1.5-7b', '--version', 'v1', '--data_path', '/content/drive/MyDrive/Colab Notebooks/Final Project/FINAL_DATA/converted_data.json', '--image_folder', '/content/drive/MyDrive/Colab Notebooks/Final Project/FINAL_DATA/Images', '--vision_tower', 'openai/clip-vit-large-patch14-336', '--mm_projector_type', 'mlp2x_gelu', '--mm_vision_select_layer', '-2', '--mm_use_im_start_end', 'False', '--mm_use_im_patch_token', 'False', '--image_aspect_ratio', 'pad', '--group_by_modality_length', 'True', '--bf16', 'True', '--output_dir', './checkpoints/llava-v1.5-7b-task-lora', '--num_train_epochs', '8', '--per_device_train_batch_size', '16', '--per_device_eval_batch_size', '4', '--gradient_accumulation_steps', '1', '--evaluation_strategy', 'no', '--save_strategy', 'steps', '--save_steps', '50000', '--save_total_limit', '1', '--learning_rate', '2e-4', '--weight_decay', '0.', '--warmup_ratio', '0.03', '--lr_scheduler_type', 'cosine', '--logging_steps', '1', '--tf32', 'True', '--model_max_length', '2048', '--gradient_checkpointing', 'True', '--dataloader_num_workers', '4', '--lazy_preprocess', 'True'), 'state': 'running', 'program': '/content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/LLaVA/llava/train/train_mem.py', 'codePathLocal': 'LLaVA/llava/train/train_mem.py', 'codePath': 'LLaVA/llava/train/train_mem.py', 'host': 'decfd3532853', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 6, 'cpu_count_logical': 12, 'cpu_freq': {'current': 2200.1379999999995, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}, {'current': 2200.138, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 52.21559143066406}}, 'gpu': 'NVIDIA A100-SXM4-40GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA A100-SXM4-40GB', 'memory_total': 42949672960}], 'memory': {'total': 83.47704696655273}}
19
+ 2024-08-18 06:10:29,154 INFO HandlerThread:8404 [system_monitor.py:probe():224] Finished collecting system info
20
+ 2024-08-18 06:10:29,154 INFO HandlerThread:8404 [system_monitor.py:probe():227] Publishing system info
21
+ 2024-08-18 06:10:29,158 INFO HandlerThread:8404 [system_monitor.py:probe():229] Finished publishing system info
22
+ 2024-08-18 06:10:29,597 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: python_packages
23
+ 2024-08-18 06:10:34,069 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
24
+ 2024-08-18 06:10:34,069 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
25
+ 2024-08-18 06:10:39,070 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
26
+ 2024-08-18 06:10:39,071 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
27
+ 2024-08-18 06:10:44,072 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
28
+ 2024-08-18 06:10:44,072 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
29
+ 2024-08-18 06:10:49,073 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
30
+ 2024-08-18 06:10:49,074 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
31
+ 2024-08-18 06:10:49,305 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
32
+ 2024-08-18 06:10:54,075 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
33
+ 2024-08-18 06:10:54,075 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
34
+ 2024-08-18 06:10:55,387 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
35
+ 2024-08-18 06:10:59,076 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
36
+ 2024-08-18 06:10:59,077 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
37
+ 2024-08-18 06:10:59,950 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
38
+ 2024-08-18 06:11:03,462 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
39
+ 2024-08-18 06:11:04,078 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
40
+ 2024-08-18 06:11:04,078 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
41
+ 2024-08-18 06:11:09,079 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
42
+ 2024-08-18 06:11:09,080 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
43
+ 2024-08-18 06:11:09,303 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
44
+ 2024-08-18 06:11:13,783 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
45
+ 2024-08-18 06:11:14,081 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
46
+ 2024-08-18 06:11:14,081 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
47
+ 2024-08-18 06:11:18,483 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
48
+ 2024-08-18 06:11:19,082 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
49
+ 2024-08-18 06:11:19,083 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
50
+ 2024-08-18 06:11:22,076 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
51
+ 2024-08-18 06:11:24,084 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
52
+ 2024-08-18 06:11:24,084 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
53
+ 2024-08-18 06:11:27,772 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
54
+ 2024-08-18 06:11:29,085 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
55
+ 2024-08-18 06:11:29,086 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
56
+ 2024-08-18 06:11:29,139 DEBUG SystemMonitor:8404 [system_monitor.py:_start():172] Starting system metrics aggregation loop
57
+ 2024-08-18 06:11:32,486 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
58
+ 2024-08-18 06:11:34,087 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
59
+ 2024-08-18 06:11:34,087 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
60
+ 2024-08-18 06:11:37,195 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
61
+ 2024-08-18 06:11:39,088 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
62
+ 2024-08-18 06:11:39,089 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
63
+ 2024-08-18 06:11:40,752 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
64
+ 2024-08-18 06:11:44,090 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
65
+ 2024-08-18 06:11:44,091 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
66
+ 2024-08-18 06:11:46,443 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
67
+ 2024-08-18 06:11:49,092 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
68
+ 2024-08-18 06:11:49,092 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
69
+ 2024-08-18 06:11:51,147 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
70
+ 2024-08-18 06:11:54,094 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
71
+ 2024-08-18 06:11:54,094 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
72
+ 2024-08-18 06:11:55,613 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
73
+ 2024-08-18 06:11:59,095 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
74
+ 2024-08-18 06:11:59,096 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
75
+ 2024-08-18 06:11:59,318 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
76
+ 2024-08-18 06:12:04,097 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
77
+ 2024-08-18 06:12:04,098 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
78
+ 2024-08-18 06:12:04,991 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
79
+ 2024-08-18 06:12:09,099 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
80
+ 2024-08-18 06:12:09,099 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
81
+ 2024-08-18 06:12:09,726 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
82
+ 2024-08-18 06:12:14,100 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
83
+ 2024-08-18 06:12:14,101 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
84
+ 2024-08-18 06:12:14,414 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
85
+ 2024-08-18 06:12:17,933 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
86
+ 2024-08-18 06:12:19,102 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
87
+ 2024-08-18 06:12:19,103 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
88
+ 2024-08-18 06:12:23,855 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
89
+ 2024-08-18 06:12:24,104 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
90
+ 2024-08-18 06:12:24,104 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
91
+ 2024-08-18 06:12:28,581 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
92
+ 2024-08-18 06:12:29,105 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
93
+ 2024-08-18 06:12:29,106 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
94
+ 2024-08-18 06:12:33,108 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
95
+ 2024-08-18 06:12:34,106 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
96
+ 2024-08-18 06:12:34,107 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
97
+ 2024-08-18 06:12:36,420 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
98
+ 2024-08-18 06:12:39,108 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
99
+ 2024-08-18 06:12:39,108 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
100
+ 2024-08-18 06:12:41,998 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
101
+ 2024-08-18 06:12:44,109 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
102
+ 2024-08-18 06:12:44,110 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
103
+ 2024-08-18 06:12:46,529 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
104
+ 2024-08-18 06:12:49,111 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
105
+ 2024-08-18 06:12:49,111 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
106
+ 2024-08-18 06:12:51,103 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
107
+ 2024-08-18 06:12:54,112 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
108
+ 2024-08-18 06:12:54,113 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
109
+ 2024-08-18 06:12:54,830 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
110
+ 2024-08-18 06:12:59,114 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
111
+ 2024-08-18 06:12:59,114 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
112
+ 2024-08-18 06:13:00,510 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
113
+ 2024-08-18 06:13:04,115 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
114
+ 2024-08-18 06:13:04,116 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
115
+ 2024-08-18 06:13:05,204 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
116
+ 2024-08-18 06:13:09,116 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
117
+ 2024-08-18 06:13:09,117 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
118
+ 2024-08-18 06:13:09,641 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
119
+ 2024-08-18 06:13:13,370 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
120
+ 2024-08-18 06:13:13,372 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: partial_history
121
+ 2024-08-18 06:13:14,118 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
122
+ 2024-08-18 06:13:14,118 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
123
+ 2024-08-18 06:13:16,025 DEBUG SenderThread:8404 [sender.py:send():391] send: exit
124
+ 2024-08-18 06:13:16,025 INFO SenderThread:8404 [sender.py:send_exit():598] handling exit code: 0
125
+ 2024-08-18 06:13:16,025 INFO SenderThread:8404 [sender.py:send_exit():600] handling runtime: 166
126
+ 2024-08-18 06:13:16,029 INFO SenderThread:8404 [sender.py:_save_file():1466] saving file wandb-summary.json with policy end
127
+ 2024-08-18 06:13:16,029 INFO SenderThread:8404 [sender.py:send_exit():606] send defer
128
+ 2024-08-18 06:13:16,029 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
129
+ 2024-08-18 06:13:16,030 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 0
130
+ 2024-08-18 06:13:16,030 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
131
+ 2024-08-18 06:13:16,030 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 0
132
+ 2024-08-18 06:13:16,030 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 1
133
+ 2024-08-18 06:13:16,030 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
134
+ 2024-08-18 06:13:16,030 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 1
135
+ 2024-08-18 06:13:16,031 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
136
+ 2024-08-18 06:13:16,031 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 1
137
+ 2024-08-18 06:13:16,031 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 2
138
+ 2024-08-18 06:13:16,031 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
139
+ 2024-08-18 06:13:16,031 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 2
140
+ 2024-08-18 06:13:16,031 INFO HandlerThread:8404 [system_monitor.py:finish():203] Stopping system monitor
141
+ 2024-08-18 06:13:16,031 INFO HandlerThread:8404 [interfaces.py:finish():200] Joined cpu monitor
142
+ 2024-08-18 06:13:16,031 DEBUG SystemMonitor:8404 [system_monitor.py:_start():179] Finished system metrics aggregation loop
143
+ 2024-08-18 06:13:16,032 INFO HandlerThread:8404 [interfaces.py:finish():200] Joined disk monitor
144
+ 2024-08-18 06:13:16,032 DEBUG SystemMonitor:8404 [system_monitor.py:_start():183] Publishing last batch of metrics
145
+ 2024-08-18 06:13:16,040 INFO HandlerThread:8404 [interfaces.py:finish():200] Joined gpu monitor
146
+ 2024-08-18 06:13:16,040 INFO HandlerThread:8404 [interfaces.py:finish():200] Joined memory monitor
147
+ 2024-08-18 06:13:16,040 INFO HandlerThread:8404 [interfaces.py:finish():200] Joined network monitor
148
+ 2024-08-18 06:13:16,041 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
149
+ 2024-08-18 06:13:16,041 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 2
150
+ 2024-08-18 06:13:16,041 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 3
151
+ 2024-08-18 06:13:16,041 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
152
+ 2024-08-18 06:13:16,041 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 3
153
+ 2024-08-18 06:13:16,041 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
154
+ 2024-08-18 06:13:16,042 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 3
155
+ 2024-08-18 06:13:16,042 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 4
156
+ 2024-08-18 06:13:16,042 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
157
+ 2024-08-18 06:13:16,042 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 4
158
+ 2024-08-18 06:13:16,042 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
159
+ 2024-08-18 06:13:16,042 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 4
160
+ 2024-08-18 06:13:16,043 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 5
161
+ 2024-08-18 06:13:16,043 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
162
+ 2024-08-18 06:13:16,043 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 5
163
+ 2024-08-18 06:13:16,043 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
164
+ 2024-08-18 06:13:16,043 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 5
165
+ 2024-08-18 06:13:16,044 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 6
166
+ 2024-08-18 06:13:16,044 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
167
+ 2024-08-18 06:13:16,044 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 6
168
+ 2024-08-18 06:13:16,044 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
169
+ 2024-08-18 06:13:16,044 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 6
170
+ 2024-08-18 06:13:16,044 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 7
171
+ 2024-08-18 06:13:16,045 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: status_report
172
+ 2024-08-18 06:13:16,045 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
173
+ 2024-08-18 06:13:16,045 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: status_report
174
+ 2024-08-18 06:13:16,045 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 7
175
+ 2024-08-18 06:13:16,045 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
176
+ 2024-08-18 06:13:16,045 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 7
177
+ 2024-08-18 06:13:16,046 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 8
178
+ 2024-08-18 06:13:16,046 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
179
+ 2024-08-18 06:13:16,046 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 8
180
+ 2024-08-18 06:13:16,046 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
181
+ 2024-08-18 06:13:16,046 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 8
182
+ 2024-08-18 06:13:16,046 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 9
183
+ 2024-08-18 06:13:16,046 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
184
+ 2024-08-18 06:13:16,046 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 9
185
+ 2024-08-18 06:13:16,047 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
186
+ 2024-08-18 06:13:16,047 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 9
187
+ 2024-08-18 06:13:16,047 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 10
188
+ 2024-08-18 06:13:16,047 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
189
+ 2024-08-18 06:13:16,047 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 10
190
+ 2024-08-18 06:13:16,047 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
191
+ 2024-08-18 06:13:16,047 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 10
192
+ 2024-08-18 06:13:16,047 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 11
193
+ 2024-08-18 06:13:16,048 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
194
+ 2024-08-18 06:13:16,048 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 11
195
+ 2024-08-18 06:13:16,048 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
196
+ 2024-08-18 06:13:16,048 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 11
197
+ 2024-08-18 06:13:16,048 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 12
198
+ 2024-08-18 06:13:16,048 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
199
+ 2024-08-18 06:13:16,048 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 12
200
+ 2024-08-18 06:13:16,048 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
201
+ 2024-08-18 06:13:16,049 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 12
202
+ 2024-08-18 06:13:16,049 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 13
203
+ 2024-08-18 06:13:16,049 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
204
+ 2024-08-18 06:13:16,049 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 13
205
+ 2024-08-18 06:13:16,049 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
206
+ 2024-08-18 06:13:16,049 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 13
207
+ 2024-08-18 06:13:16,049 INFO SenderThread:8404 [sender.py:transition_state():626] send defer: 14
208
+ 2024-08-18 06:13:16,050 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: defer
209
+ 2024-08-18 06:13:16,050 INFO HandlerThread:8404 [handler.py:handle_request_defer():184] handle defer: 14
210
+ 2024-08-18 06:13:16,050 DEBUG SenderThread:8404 [sender.py:send():391] send: final
211
+ 2024-08-18 06:13:16,050 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: defer
212
+ 2024-08-18 06:13:16,050 INFO SenderThread:8404 [sender.py:send_request_defer():622] handle sender defer: 14
213
+ 2024-08-18 06:13:16,050 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: poll_exit
214
+ 2024-08-18 06:13:16,051 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: server_info
215
+ 2024-08-18 06:13:16,051 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: poll_exit
216
+ 2024-08-18 06:13:16,051 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: poll_exit
217
+ 2024-08-18 06:13:16,051 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: server_info
218
+ 2024-08-18 06:13:16,052 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: get_summary
219
+ 2024-08-18 06:13:16,052 DEBUG SenderThread:8404 [sender.py:send_request():418] send_request: poll_exit
220
+ 2024-08-18 06:13:16,052 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: sampled_history
221
+ 2024-08-18 06:13:16,053 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: internal_messages
222
+ 2024-08-18 06:13:16,053 INFO MainThread:8404 [wandb_run.py:_footer_history_summary_info():4076] rendering history
223
+ 2024-08-18 06:13:16,054 INFO MainThread:8404 [wandb_run.py:_footer_history_summary_info():4108] rendering summary
224
+ 2024-08-18 06:13:16,054 DEBUG HandlerThread:8404 [handler.py:handle_request():158] handle_request: shutdown
225
+ 2024-08-18 06:13:16,055 INFO HandlerThread:8404 [handler.py:finish():880] shutting down handler
226
+ 2024-08-18 06:13:17,052 INFO WriterThread:8404 [datastore.py:close():296] close: /content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/run-xy8wzk0g.wandb
227
+ 2024-08-18 06:13:17,053 INFO SenderThread:8404 [sender.py:finish():1631] shutting down sender
My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug.log ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-08-18 06:10:29,050 INFO MainThread:7960 [wandb_setup.py:_flush():76] Current SDK version is 0.17.7
2
+ 2024-08-18 06:10:29,052 INFO MainThread:7960 [wandb_setup.py:_flush():76] Configure stats pid to 7960
3
+ 2024-08-18 06:10:29,052 INFO MainThread:7960 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
4
+ 2024-08-18 06:10:29,053 INFO MainThread:7960 [wandb_setup.py:_flush():76] Loading settings from /content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/wandb/settings
5
+ 2024-08-18 06:10:29,053 INFO MainThread:7960 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
6
+ 2024-08-18 06:10:29,053 INFO MainThread:7960 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
7
+ 2024-08-18 06:10:29,053 INFO MainThread:7960 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'LLaVA/llava/train/train_mem.py', 'program_abspath': '/content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/LLaVA/llava/train/train_mem.py', 'program': '/content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/LLaVA/llava/train/train_mem.py'}
8
+ 2024-08-18 06:10:29,053 INFO MainThread:7960 [wandb_setup.py:_flush():76] Applying login settings: {}
9
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_setup.py:_flush():76] Applying login settings: {'mode': 'offline'}
10
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_init.py:_log_setup():524] Logging user logs to /content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug.log
11
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_init.py:_log_setup():525] Logging internal logs to /content/drive/MyDrive/Colab Notebooks/Medical_Project/My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/logs/debug-internal.log
12
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_init.py:init():607] calling init triggers
13
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_init.py:init():614] wandb.init called with sweep_config: {}
14
+ config: {}
15
+ 2024-08-18 06:10:29,054 INFO MainThread:7960 [wandb_init.py:init():657] starting backend
16
+ 2024-08-18 06:10:29,055 INFO MainThread:7960 [wandb_init.py:init():661] setting up manager
17
+ 2024-08-18 06:10:29,059 INFO MainThread:7960 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
18
+ 2024-08-18 06:10:29,060 INFO MainThread:7960 [wandb_init.py:init():669] backend started and connected
19
+ 2024-08-18 06:10:29,070 INFO MainThread:7960 [wandb_init.py:init():764] updated telemetry
20
+ 2024-08-18 06:10:29,074 INFO MainThread:7960 [wandb_init.py:init():797] communicating run to backend with 90.0 second timeout
21
+ 2024-08-18 06:10:29,080 INFO MainThread:7960 [wandb_init.py:init():848] starting run threads in backend
22
+ 2024-08-18 06:10:29,597 INFO MainThread:7960 [wandb_run.py:_console_start():2457] atexit reg
23
+ 2024-08-18 06:10:29,598 INFO MainThread:7960 [wandb_run.py:_redirect():2303] redirect: wrap_raw
24
+ 2024-08-18 06:10:29,598 INFO MainThread:7960 [wandb_run.py:_redirect():2368] Wrapping output streams.
25
+ 2024-08-18 06:10:29,598 INFO MainThread:7960 [wandb_run.py:_redirect():2393] Redirects installed.
26
+ 2024-08-18 06:10:29,600 INFO MainThread:7960 [wandb_init.py:init():891] run started, returning control to user process
27
+ 2024-08-18 06:10:29,603 INFO MainThread:7960 [wandb_run.py:_config_callback():1386] config_cb None None {'vocab_size': 32000, 'max_position_embeddings': 4096, 'hidden_size': 4096, 'intermediate_size': 11008, 'num_hidden_layers': 32, 'num_attention_heads': 32, 'num_key_value_heads': 32, 'hidden_act': 'silu', 'initializer_range': 0.02, 'rms_norm_eps': 1e-05, 'pretraining_tp': 1, 'use_cache': False, 'rope_theta': 10000.0, 'rope_scaling': None, 'attention_bias': False, 'attention_dropout': 0.0, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 4096, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['LlavaLlamaForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 0, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'liuhaotian/llava-v1.5-7b', 'transformers_version': '4.37.2', 'freeze_mm_mlp_adapter': False, 'freeze_mm_vision_resampler': False, 'image_aspect_ratio': 'pad', 'mm_hidden_size': 1024, 'mm_projector_type': 'mlp2x_gelu', 'mm_resampler_type': None, 'mm_use_im_patch_token': False, 'mm_use_im_start_end': False, 'mm_vision_select_feature': 'patch', 'mm_vision_select_layer': -2, 'mm_vision_tower': 'openai/clip-vit-large-patch14-336', 'model_type': 'llava_llama', 'tune_mm_mlp_adapter': False, 'tune_mm_vision_resampler': False, 'unfreeze_mm_vision_tower': False, 'use_mm_proj': True, 'mm_patch_merge_type': 'flat', 'tokenizer_padding_side': 'right', 'tokenizer_model_max_length': 2048, 'mm_projector_lr': 2e-05, 'output_dir': './checkpoints/llava-v1.5-7b-task-lora', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 4, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0002, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 8.0, 'max_steps': -1, 'lr_scheduler_type': 'cosine', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.03, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './checkpoints/llava-v1.5-7b-task-lora/runs/Aug18_06-09-01_decfd3532853', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1.0, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 50000, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': True, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': True, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 4, 'past_index': -1, 'run_name': './checkpoints/llava-v1.5-7b-task-lora', 'disable_tqdm': False, 'remove_unused_columns': False, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': 'LLaVA/scripts/zero3.json', 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': True, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'cache_dir': None, 'mpt_attn_impl': 'triton', 'model_max_length': 2048, 'double_quant': True, 'quant_type': 'nf4', 'bits': 16, 'lora_enable': True, 'lora_r': 128, 'lora_alpha': 256, 'lora_dropout': 0.05, 'lora_weight_path': '', 'lora_bias': 'none', 'group_by_modality_length': True}
28
+ 2024-08-18 06:13:17,055 WARNING MsgRouterThr:7960 [router.py:message_loop():77] message_loop has been closed
My_new_LLaVA/wandb/offline-run-20240818_061029-xy8wzk0g/run-xy8wzk0g.wandb ADDED
Binary file (50 kB). View file