End of training

README.md

@@ -0,0 +1,68 @@
+---
+license: mit
+base_model: facebook/bart-large-cnn
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: PTS-Bart-Large-CNN
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# PTS-Bart-Large-CNN
+
+This model is a fine-tuned version of [facebook/bart-large-cnn](https://huggingface.co/facebook/bart-large-cnn) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0177
+- Rouge1: 0.6339
+- Rouge2: 0.4113
+- Rougel: 0.5344
+- Rougelsum: 0.5338
+- Gen Len: 76.1278
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 4
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
+| No log        | 1.0   | 180  | 0.9026          | 0.6109 | 0.3819 | 0.5098 | 0.5094    | 76.9722 |
+| No log        | 2.0   | 360  | 0.9012          | 0.6273 | 0.4054 | 0.5285 | 0.5284    | 76.3833 |
+| 0.6717        | 3.0   | 540  | 0.9357          | 0.6312 | 0.4071 | 0.5297 | 0.5295    | 76.25   |
+| 0.6717        | 4.0   | 720  | 1.0177          | 0.6339 | 0.4113 | 0.5344 | 0.5338    | 76.1278 |
+
+
+### Framework versions
+
+- Transformers 4.41.2
+- Pytorch 2.3.0+cu121
+- Datasets 2.20.0
+- Tokenizers 0.19.1

generation_config.json

@@ -0,0 +1,15 @@
+{
+  "bos_token_id": 0,
+  "decoder_start_token_id": 2,
+  "early_stopping": true,
+  "eos_token_id": 2,
+  "forced_bos_token_id": 0,
+  "forced_eos_token_id": 2,
+  "length_penalty": 2.0,
+  "max_length": 142,
+  "min_length": 56,
+  "no_repeat_ngram_size": 3,
+  "num_beams": 4,
+  "pad_token_id": 1,
+  "transformers_version": "4.41.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91f7f008b48d838f3a3f6de36c817e6e0e281724ad0f3b4aee2966ca9d6fffb3
+oid sha256:98c5eae65b3d164cf3eb3812dc024019fc5f7376f65132fc9d6f8a2a15c4ecb6
 size 1625422896

runs/Jun15_10-59-24_4441297fbb55/events.out.tfevents.1718449166.4441297fbb55.226.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ec7b315a5e24a4e9ad3b69bc5f525bf643a2d891b408e86bd3baf3d3227e51cb
-size 7205
+oid sha256:41f76e8ca9c49c4d049ba2b2af85d42890123363f39eddac1ea4af055d211285
+size 8609