Upload folder using huggingface_hub

README.md

@@ -1,57 +1,202 @@
 ---
 base_model: wcyat/cantonesellm-lihkg-story-merged
-library_name: transformers
-model_name: cantonesellm-lihkg-story-lora-3
-tags:
-- generated_from_trainer
-- trl
-- sft
-licence: license
+library_name: peft
 ---
 
-# Model Card for cantonesellm-lihkg-story-lora-3
+# Model Card for Model ID
 
-This model is a fine-tuned version of [wcyat/cantonesellm-lihkg-story-merged](https://huggingface.co/wcyat/cantonesellm-lihkg-story-merged).
-It has been trained using [TRL](https://github.com/huggingface/trl).
+<!-- Provide a quick summary of what the model is/does. -->
 
-## Quick start
 
-```python
-from transformers import pipeline
 
-question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
-generator = pipeline("text-generation", model="wcyat/cantonesellm-lihkg-story-lora-3", device="cuda")
-output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
-print(output["generated_text"])
-```
+## Model Details
 
-## Training procedure
+### Model Description
 
+<!-- Provide a longer summary of what this model is. -->
 
 
-This model was trained with SFT.
 
-### Framework versions
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
 
-- TRL: 0.12.1
-- Transformers: 4.46.2
-- Pytorch: 2.5.1+cu121
-- Datasets: 3.1.0
-- Tokenizers: 0.20.3
+<!-- This should link to a Dataset Card if possible. -->
 
-## Citations
+[More Information Needed]
 
+#### Factors
 
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
 
-Cite TRL as:
-    
-```bibtex
-@misc{vonwerra2022trl,
-	title        = {{TRL: Transformer Reinforcement Learning}},
-	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
-	year         = 2020,
-	journal      = {GitHub repository},
-	publisher    = {GitHub},
-	howpublished = {\url{https://github.com/huggingface/trl}}
-}
-```
+- PEFT 0.13.2

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b69c4f7077170286aab1c5b453342c5a6cef26a41493f039e6f66addbaeb3e14
+oid sha256:4b12bbc70fd9560e9f22424665679def69d18b79b107e7004a9613aa5b325c3e
 size 104874832

optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8be6ebd58a157860651976b73338ace29c42d2dd71e705115da01fa89662dafb
+size 209793914

rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9813a399c13388485ab02bed2a5f88cf56b7287a90da81a7102aab8c397387b
+size 14244

scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c275015688a17ce7aa2bf271a7bc97b17d692d82f56118639a1f1ff49399c4f8
+size 1064

trainer_state.json

@@ -0,0 +1,208 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.9412650602409639,
+  "eval_steps": 500,
+  "global_step": 625,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03765060240963856,
+      "grad_norm": 0.29182711243629456,
+      "learning_rate": 0.0002,
+      "loss": 2.048,
+      "step": 25
+    },
+    {
+      "epoch": 0.07530120481927711,
+      "grad_norm": 0.355770081281662,
+      "learning_rate": 0.0002,
+      "loss": 1.9254,
+      "step": 50
+    },
+    {
+      "epoch": 0.11295180722891567,
+      "grad_norm": 0.24575483798980713,
+      "learning_rate": 0.0002,
+      "loss": 1.8281,
+      "step": 75
+    },
+    {
+      "epoch": 0.15060240963855423,
+      "grad_norm": 0.370360791683197,
+      "learning_rate": 0.0002,
+      "loss": 1.8354,
+      "step": 100
+    },
+    {
+      "epoch": 0.18825301204819278,
+      "grad_norm": 0.30005237460136414,
+      "learning_rate": 0.0002,
+      "loss": 1.8066,
+      "step": 125
+    },
+    {
+      "epoch": 0.22590361445783133,
+      "grad_norm": 0.4004781246185303,
+      "learning_rate": 0.0002,
+      "loss": 2.0024,
+      "step": 150
+    },
+    {
+      "epoch": 0.2635542168674699,
+      "grad_norm": 0.37836953997612,
+      "learning_rate": 0.0002,
+      "loss": 1.9717,
+      "step": 175
+    },
+    {
+      "epoch": 0.30120481927710846,
+      "grad_norm": 0.38621386885643005,
+      "learning_rate": 0.0002,
+      "loss": 2.0938,
+      "step": 200
+    },
+    {
+      "epoch": 0.338855421686747,
+      "grad_norm": 0.32652556896209717,
+      "learning_rate": 0.0002,
+      "loss": 1.9128,
+      "step": 225
+    },
+    {
+      "epoch": 0.37650602409638556,
+      "grad_norm": 0.3783712387084961,
+      "learning_rate": 0.0002,
+      "loss": 1.7907,
+      "step": 250
+    },
+    {
+      "epoch": 0.4141566265060241,
+      "grad_norm": 0.2575533390045166,
+      "learning_rate": 0.0002,
+      "loss": 1.8501,
+      "step": 275
+    },
+    {
+      "epoch": 0.45180722891566266,
+      "grad_norm": 0.37206143140792847,
+      "learning_rate": 0.0002,
+      "loss": 1.7147,
+      "step": 300
+    },
+    {
+      "epoch": 0.4894578313253012,
+      "grad_norm": 0.3018392324447632,
+      "learning_rate": 0.0002,
+      "loss": 1.602,
+      "step": 325
+    },
+    {
+      "epoch": 0.5271084337349398,
+      "grad_norm": 0.45196229219436646,
+      "learning_rate": 0.0002,
+      "loss": 1.8455,
+      "step": 350
+    },
+    {
+      "epoch": 0.5647590361445783,
+      "grad_norm": 0.250590443611145,
+      "learning_rate": 0.0002,
+      "loss": 1.9206,
+      "step": 375
+    },
+    {
+      "epoch": 0.6024096385542169,
+      "grad_norm": 0.314155638217926,
+      "learning_rate": 0.0002,
+      "loss": 1.908,
+      "step": 400
+    },
+    {
+      "epoch": 0.6400602409638554,
+      "grad_norm": 0.319771409034729,
+      "learning_rate": 0.0002,
+      "loss": 1.6045,
+      "step": 425
+    },
+    {
+      "epoch": 0.677710843373494,
+      "grad_norm": 0.4088861346244812,
+      "learning_rate": 0.0002,
+      "loss": 1.7106,
+      "step": 450
+    },
+    {
+      "epoch": 0.7153614457831325,
+      "grad_norm": 0.29917973279953003,
+      "learning_rate": 0.0002,
+      "loss": 1.7349,
+      "step": 475
+    },
+    {
+      "epoch": 0.7530120481927711,
+      "grad_norm": 0.6233075857162476,
+      "learning_rate": 0.0002,
+      "loss": 1.9191,
+      "step": 500
+    },
+    {
+      "epoch": 0.7906626506024096,
+      "grad_norm": 0.24983790516853333,
+      "learning_rate": 0.0002,
+      "loss": 1.6759,
+      "step": 525
+    },
+    {
+      "epoch": 0.8283132530120482,
+      "grad_norm": 0.42871519923210144,
+      "learning_rate": 0.0002,
+      "loss": 1.7982,
+      "step": 550
+    },
+    {
+      "epoch": 0.8659638554216867,
+      "grad_norm": 0.3003176748752594,
+      "learning_rate": 0.0002,
+      "loss": 1.7154,
+      "step": 575
+    },
+    {
+      "epoch": 0.9036144578313253,
+      "grad_norm": 0.4300028681755066,
+      "learning_rate": 0.0002,
+      "loss": 1.6376,
+      "step": 600
+    },
+    {
+      "epoch": 0.9412650602409639,
+      "grad_norm": 0.38282954692840576,
+      "learning_rate": 0.0002,
+      "loss": 1.545,
+      "step": 625
+    }
+  ],
+  "logging_steps": 25,
+  "max_steps": 664,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 25,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2.109390150045696e+16,
+  "train_batch_size": 1,
+  "trial_name": null,
+  "trial_params": null
+}