ativilambit/neu-faq

README.md

@@ -17,11 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2242
-- Rouge1: 0.2012
-- Rouge2: 0.1143
-- Rougel: 0.1704
-- Rougelsum: 0.1885
+- Loss: 0.3877
+- Rouge1: 0.1916
+- Rouge2: 0.0900
+- Rougel: 0.1578
+- Rougelsum: 0.1799
 
 ## Model description
 
@@ -52,23 +52,23 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
-| No log        | 1.0   | 17   | 5.3687          | 0.1823 | 0.0899 | 0.1478 | 0.1616    |
-| No log        | 2.0   | 34   | 3.0748          | 0.1903 | 0.0931 | 0.1539 | 0.1741    |
-| No log        | 3.0   | 51   | 1.5007          | 0.1654 | 0.0620 | 0.1273 | 0.1507    |
-| No log        | 4.0   | 68   | 0.5415          | 0.1570 | 0.0597 | 0.1153 | 0.1389    |
-| No log        | 5.0   | 85   | 0.3232          | 0.1538 | 0.0702 | 0.1152 | 0.1377    |
-| No log        | 6.0   | 102  | 0.2662          | 0.1668 | 0.0704 | 0.1298 | 0.1467    |
-| No log        | 7.0   | 119  | 0.2379          | 0.1667 | 0.0684 | 0.1283 | 0.1475    |
-| No log        | 8.0   | 136  | 0.2296          | 0.1865 | 0.0911 | 0.1498 | 0.1720    |
-| No log        | 9.0   | 153  | 0.2266          | 0.2040 | 0.1084 | 0.1662 | 0.1860    |
-| No log        | 10.0  | 170  | 0.2238          | 0.2031 | 0.1136 | 0.1689 | 0.1877    |
-| No log        | 11.0  | 187  | 0.2239          | 0.2012 | 0.1148 | 0.1704 | 0.1885    |
-| No log        | 11.76 | 200  | 0.2242          | 0.2012 | 0.1143 | 0.1704 | 0.1885    |
+| No log        | 1.0   | 17   | 6.3841          | 0.0258 | 0.0043 | 0.0256 | 0.0255    |
+| No log        | 2.0   | 34   | 3.6116          | 0.0214 | 0.0020 | 0.0193 | 0.0203    |
+| No log        | 3.0   | 51   | 1.7410          | 0.0075 | 0.0016 | 0.0070 | 0.0071    |
+| No log        | 4.0   | 68   | 0.8219          | 0.0037 | 0.0013 | 0.0025 | 0.0025    |
+| No log        | 5.0   | 85   | 0.6052          | 0.0095 | 0.0050 | 0.0067 | 0.0074    |
+| No log        | 6.0   | 102  | 0.4904          | 0.1239 | 0.0566 | 0.0988 | 0.1164    |
+| No log        | 7.0   | 119  | 0.4477          | 0.1669 | 0.0745 | 0.1366 | 0.1570    |
+| No log        | 8.0   | 136  | 0.4218          | 0.1765 | 0.0781 | 0.1464 | 0.1665    |
+| No log        | 9.0   | 153  | 0.4044          | 0.1923 | 0.0955 | 0.1604 | 0.1845    |
+| No log        | 10.0  | 170  | 0.3937          | 0.1909 | 0.0967 | 0.1636 | 0.1794    |
+| No log        | 11.0  | 187  | 0.3887          | 0.1919 | 0.0893 | 0.1594 | 0.1795    |
+| No log        | 11.76 | 200  | 0.3877          | 0.1916 | 0.0900 | 0.1578 | 0.1799    |
 
 
 ### Framework versions
 
-- Transformers 4.33.1
+- Transformers 4.33.2
 - Pytorch 2.0.1+cu118
 - Datasets 2.14.5
 - Tokenizers 0.13.3

config.json

@@ -56,7 +56,7 @@
   },
   "tie_word_embeddings": false,
   "torch_dtype": "float32",
-  "transformers_version": "4.33.1",
+  "transformers_version": "4.33.2",
   "use_cache": true,
   "vocab_size": 32128
 }

generation_config.json

@@ -2,5 +2,5 @@
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
   "pad_token_id": 0,
-  "transformers_version": "4.33.1"
+  "transformers_version": "4.33.2"
 }

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d616a60ffd3542e2ebf93ccae79e7b3887851de6ad904e4e27d13b004659643b
+oid sha256:60568ddd5bf9e9e17232e8c1921f2fae0d8027d868cfcc60b52de61e7e181fad
 size 990404917

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff1097c45aeb3dccaf6bad4564f800ddf052353749006f59683051ec142a590c
+oid sha256:2ab55d472eb5a6e6e9eaff317be264d02920b1f06ae5f500be94a3b5a04b14e5
 size 4155