menheraorg
/

Qwen2.5-3B-lora-vericava1

@@ -1,91 +1,105 @@
----
-library_name: peft
-license: other
-base_model: Qwen/Qwen2.5-3B
-tags:
-- generated_from_trainer
-datasets:
-- menheraorg/vericava-posts
-model-index:
-- name: model-out
-  results: []
----
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
-<details><summary>See axolotl config</summary>
-axolotl version: `0.7.0`
-```yaml
-base_model: Qwen/Qwen2.5-3B
-load_in_8bit: true
-adapter: lora
-lora_r: 8
-lora_alpha: 16
-lora_dropout: 0.05
-lora_target_modules:
-  - q_proj
-  - v_proj
-# Training settings
-gradient_accumulation_steps: 1
-micro_batch_size: 1
-num_epochs: 3
-learning_rate: 0.0005
-gpu_memory_limit: 7.75GiB
-chat_template: alpaca
-# Your dataset
-datasets:
-  - path: vericava-alpaca.jsonl
-    type: alpaca
-```
-</details><br>
-# model-out
-This model is a fine-tuned version of [Qwen/Qwen2.5-3B](https://huggingface.co/Qwen/Qwen2.5-3B) on the vericava-alpaca.jsonl dataset.
-## Model description
-More information needed
-## Intended uses & limitations
-More information needed
-## Training and evaluation data
-More information needed
-## Training procedure
-### Training hyperparameters
-The following hyperparameters were used during training:
-- learning_rate: 0.0005
-- train_batch_size: 1
-- eval_batch_size: 1
-- seed: 42
-- optimizer: Use OptimizerNames.ADAMW_HF with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 100
-- num_epochs: 3.0
-### Training results
-### Framework versions
-- PEFT 0.14.0
-- Transformers 4.48.3
-- Pytorch 2.6.0+cu124
-- Datasets 3.2.0
-- Tokenizers 0.21.1

+---
+library_name: peft
+license: other
+base_model: Qwen/Qwen2.5-3B
+tags:
+- generated_from_trainer
+datasets:
+- menheraorg/vericava-posts
+language:
+- zho
+- eng
+- fra
+- spa
+- por
+- deu
+- ita
+- rus
+- jpn
+- kor
+- vie
+- tha
+- ara
+model-index:
+- name: model-out
+  results: []
+---
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
+<details><summary>See axolotl config</summary>
+axolotl version: `0.7.0`
+```yaml
+base_model: Qwen/Qwen2.5-3B
+load_in_8bit: true
+adapter: lora
+lora_r: 8
+lora_alpha: 16
+lora_dropout: 0.05
+lora_target_modules:
+  - q_proj
+  - v_proj
+# Training settings
+gradient_accumulation_steps: 1
+micro_batch_size: 1
+num_epochs: 3
+learning_rate: 0.0005
+gpu_memory_limit: 7.75GiB
+chat_template: alpaca
+# Your dataset
+datasets:
+  - path: vericava-alpaca.jsonl
+    type: alpaca
+```
+</details><br>
+# model-out
+This model is a fine-tuned version of [Qwen/Qwen2.5-3B](https://huggingface.co/Qwen/Qwen2.5-3B) on the vericava-alpaca.jsonl dataset.
+## Model description
+More information needed
+## Intended uses & limitations
+More information needed
+## Training and evaluation data
+More information needed
+## Training procedure
+### Training hyperparameters
+The following hyperparameters were used during training:
+- learning_rate: 0.0005
+- train_batch_size: 1
+- eval_batch_size: 1
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_HF with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_steps: 100
+- num_epochs: 3.0
+### Training results
+### Framework versions
+- PEFT 0.14.0
+- Transformers 4.48.3
+- Pytorch 2.6.0+cu124
+- Datasets 3.2.0
+- Tokenizers 0.21.1