kairos-posicao-bert-custom

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [belisards/congretimbau](https://huggingface.co/belisards/congretimbau) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1176
-- Accuracy: 0.8027
-- F1: 0.7358
-- Recall: 0.7544
-- Precision: 0.7236
+- Loss: 0.1076
+- Accuracy: 0.8503
+- F1: 0.7896
+- Recall: 0.7959
+- Precision: 0.7839
 
 ## Model description
 
@@ -45,31 +45,27 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 1e-05
-- train_batch_size: 64
-- eval_batch_size: 64
+- train_batch_size: 32
+- eval_batch_size: 32
 - seed: 5151
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 200
-- num_epochs: 15
+- num_epochs: 18
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Recall | Precision |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:---------:|
-| 0.3405        | 1.0   | 18   | 0.2083          | 0.7232   | 0.4751 | 0.5104 | 0.5393    |
-| 0.1467        | 2.0   | 36   | 0.1258          | 0.4107   | 0.4105 | 0.5463 | 0.5486    |
-| 0.1198        | 3.0   | 54   | 0.1127          | 0.6607   | 0.5988 | 0.6140 | 0.5964    |
-| 0.107         | 4.0   | 72   | 0.0999          | 0.6696   | 0.6339 | 0.6762 | 0.6380    |
-| 0.0987        | 5.0   | 90   | 0.0943          | 0.6339   | 0.6113 | 0.6745 | 0.6339    |
-| 0.0911        | 6.0   | 108  | 0.0930          | 0.6875   | 0.6492 | 0.6882 | 0.6492    |
-| 0.078         | 7.0   | 126  | 0.0953          | 0.7321   | 0.6883 | 0.7183 | 0.6805    |
-| 0.0671        | 8.0   | 144  | 0.0934          | 0.7232   | 0.6850 | 0.7235 | 0.6798    |
-| 0.0534        | 9.0   | 162  | 0.1065          | 0.8036   | 0.7441 | 0.7441 | 0.7441    |
-| 0.0355        | 10.0  | 180  | 0.1363          | 0.8214   | 0.7724 | 0.7786 | 0.7670    |
-| 0.0263        | 11.0  | 198  | 0.1411          | 0.8214   | 0.7724 | 0.7786 | 0.7670    |
-| 0.013         | 12.0  | 216  | 0.2712          | 0.8214   | 0.7560 | 0.7449 | 0.7710    |
-| 0.0074        | 13.0  | 234  | 0.3198          | 0.7946   | 0.7294 | 0.7268 | 0.7321    |
+| 0.1548        | 1.0   | 35   | 0.1456          | 0.7411   | 0.4571 | 0.5112 | 0.6227    |
+| 0.1572        | 2.0   | 70   | 0.1354          | 0.7411   | 0.6588 | 0.6570 | 0.6607    |
+| 0.1305        | 3.0   | 105  | 0.1212          | 0.7768   | 0.6402 | 0.6251 | 0.7194    |
+| 0.1069        | 4.0   | 140  | 0.1155          | 0.8393   | 0.7857 | 0.7794 | 0.7930    |
+| 0.0937        | 5.0   | 175  | 0.1216          | 0.8304   | 0.7764 | 0.7734 | 0.7798    |
+| 0.0639        | 6.0   | 210  | 0.1257          | 0.8482   | 0.7899 | 0.7742 | 0.8125    |
+| 0.0437        | 7.0   | 245  | 0.1610          | 0.8393   | 0.7614 | 0.7345 | 0.8195    |
+| 0.0254        | 8.0   | 280  | 0.2101          | 0.8482   | 0.7842 | 0.7630 | 0.8197    |
+| 0.0067        | 9.0   | 315  | 0.2555          | 0.8482   | 0.7899 | 0.7742 | 0.8125    |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e6e2ba5dd0e166261ec945162d8e79d2e859733d2b3200f2c280ed9a43e2d802
+oid sha256:5e98475e3643c74cadf401ba22ec56f223c7f43b5dc3d62fb197cc7f68607494
 size 1337640872

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6435f8462aca2daab46d187fd20638c82a75b3f148c4cada62a5aae5ab0a2e1b
+oid sha256:d52eab71080d2aed6a921ca9f734c67e7deaa4b336d62f88d5819be64e81acb2
 size 5304

wandb/debug-internal.log

@@ -1,42 +1,41 @@
-{"time":"2024-12-11T03:56:14.972563192Z","level":"INFO","msg":"using version","core version":"0.19.0"}
-{"time":"2024-12-11T03:56:14.972584119Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_035614-4h85t3a9/logs/debug-core.log"}
-{"time":"2024-12-11T03:56:15.07514169Z","level":"INFO","msg":"created new stream","id":"4h85t3a9"}
-{"time":"2024-12-11T03:56:15.075175758Z","level":"INFO","msg":"stream: started","id":"4h85t3a9"}
-{"time":"2024-12-11T03:56:15.075212228Z","level":"INFO","msg":"writer: Do: started","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T03:56:15.07523211Z","level":"INFO","msg":"sender: started","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T03:56:15.075321233Z","level":"INFO","msg":"handler: started","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T03:56:15.968097784Z","level":"INFO","msg":"Starting system monitor"}
-{"time":"2024-12-11T03:56:16.456638208Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T03:56:16.456680859Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T03:56:16.456686338Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T03:56:16.456690298Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T03:56:16.456694053Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T03:56:16.456697689Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T03:56:17.11108643Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T03:56:17.151485643Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:00:46.468742444Z","level":"INFO","msg":"api: retrying error","error":"Post \"https://api.wandb.ai/graphql\": read tcp 172.28.0.12:55104->35.186.228.49:443: read: connection reset by peer"}
-{"time":"2024-12-11T04:05:11.747524724Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:11.752230979Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:13.109043385Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:13.11322247Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:13.113974041Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:13.119121659Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:13.201633635Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:13.206478279Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:13.209051195Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:13.214107299Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:16.798316096Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:16.838607253Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:16.838637201Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:16.83864231Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:16.838647523Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:05:16.838651293Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:05:16.838673832Z","level":"INFO","msg":"Stopping system monitor"}
-{"time":"2024-12-11T04:05:16.839335764Z","level":"INFO","msg":"Stopped system monitor"}
-{"time":"2024-12-11T04:05:17.084769004Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
-{"time":"2024-12-11T04:05:17.148988564Z","level":"INFO","msg":"handler: operation stats","stats":{}}
-{"time":"2024-12-11T04:05:18.165248123Z","level":"INFO","msg":"stream: closing","id":"4h85t3a9"}
-{"time":"2024-12-11T04:05:18.165271526Z","level":"INFO","msg":"handler: closed","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T04:05:18.165281328Z","level":"INFO","msg":"writer: Close: closed","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T04:05:18.165315071Z","level":"INFO","msg":"sender: closed","stream_id":"4h85t3a9"}
-{"time":"2024-12-11T04:05:18.165351695Z","level":"INFO","msg":"stream: closed","id":"4h85t3a9"}
+{"time":"2024-12-11T04:30:31.64567442Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:30:31.645694977Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_043031-pfhjmc9v/logs/debug-core.log"}
+{"time":"2024-12-11T04:30:31.748128189Z","level":"INFO","msg":"created new stream","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748162278Z","level":"INFO","msg":"stream: started","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748191334Z","level":"INFO","msg":"writer: Do: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748217805Z","level":"INFO","msg":"handler: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748239576Z","level":"INFO","msg":"sender: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:34.483159987Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:30:35.046627667Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046662301Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.046670624Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046676728Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.046682641Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046688398Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.626440922Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.667423399Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:00.589693882Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:00.594358479Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.005522092Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.010541772Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.011288477Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.017364808Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.171915316Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.177365784Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.180571775Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.185372366Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.365253262Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.372555953Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.373998802Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.379408244Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.3922832Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.396859255Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.398980138Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:37:05.399571058Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:37:05.608796436Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:37:05.673605445Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-11T04:37:06.688087405Z","level":"INFO","msg":"stream: closing","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.68810837Z","level":"INFO","msg":"handler: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688117223Z","level":"INFO","msg":"writer: Close: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688143843Z","level":"INFO","msg":"sender: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688182944Z","level":"INFO","msg":"stream: closed","id":"pfhjmc9v"}

wandb/debug.log

@@ -1,73 +1,73 @@
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_setup.py:_flush():68] Configure stats pid to 5214
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_setup.py:_flush():68] Loading settings from environment variables
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_035614-4h85t3a9/logs/debug.log
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_035614-4h85t3a9/logs/debug-internal.log
-2024-12-11 03:56:14,967 INFO    MainThread:5214 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7bea66d57c70>
-2024-12-11 03:56:14,968 INFO    MainThread:5214 [wandb_init.py:init():639] calling init triggers
-2024-12-11 03:56:14,968 INFO    MainThread:5214 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Configure stats pid to 2341
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_043031-pfhjmc9v/logs/debug.log
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_043031-pfhjmc9v/logs/debug-internal.log
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7de625ba39d0>
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
 config: {}
-2024-12-11 03:56:14,968 INFO    MainThread:5214 [wandb_init.py:init():688] starting backend
-2024-12-11 03:56:14,968 INFO    MainThread:5214 [wandb_init.py:init():692] sending inform_init request
-2024-12-11 03:56:14,970 INFO    MainThread:5214 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
-2024-12-11 03:56:14,971 INFO    MainThread:5214 [wandb_init.py:init():705] backend started and connected
-2024-12-11 03:56:14,978 INFO    MainThread:5214 [wandb_run.py:_label_probe_notebook():1327] probe notebook
-2024-12-11 03:56:15,888 INFO    MainThread:5214 [wandb_init.py:init():798] updated telemetry
-2024-12-11 03:56:15,889 INFO    MainThread:5214 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
-2024-12-11 03:56:15,963 INFO    MainThread:5214 [wandb_init.py:init():882] starting run threads in backend
-2024-12-11 03:56:16,417 INFO    MainThread:5214 [wandb_run.py:_console_start():2443] atexit reg
-2024-12-11 03:56:16,417 INFO    MainThread:5214 [wandb_run.py:_redirect():2293] redirect: wrap_raw
-2024-12-11 03:56:16,417 INFO    MainThread:5214 [wandb_run.py:_redirect():2358] Wrapping output streams.
-2024-12-11 03:56:16,417 INFO    MainThread:5214 [wandb_run.py:_redirect():2383] Redirects installed.
-2024-12-11 03:56:16,419 INFO    MainThread:5214 [wandb_init.py:init():925] run started, returning control to user process
-2024-12-11 03:56:16,423 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 03:56:16,423 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 03:56:16,428 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 03:56:16,429 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 03:56:16,429 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 03:56:16,439 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 03:56:16,441 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 03:56:16,441 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 03:56:16,449 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 03:56:17,110 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 03:56:17,110 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 03:56:17,115 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 03:56:17,487 INFO    MainThread:5214 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 64, 'per_device_eval_batch_size': 64, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 15, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_03-56-16_0a818e0bf512', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 102, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 51, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
-2024-12-11 03:56:17,491 INFO    MainThread:5214 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7bea30363fd0>>
-2024-12-11 03:56:17,491 INFO    MainThread:5214 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
-2024-12-11 04:05:11,747 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:11,747 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:11,751 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:13,108 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:13,108 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:13,112 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:13,113 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:13,113 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:13,118 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:13,201 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:13,201 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:13,206 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:13,208 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:13,208 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:13,213 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:16,797 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:16,798 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:16,806 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:16,807 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:16,807 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:16,813 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:16,825 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:16,826 INFO    MainThread:5214 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:05:16,830 INFO    MainThread:5214 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:05:16,831 INFO    MainThread:5214 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/4h85t3a9
-2024-12-11 04:05:16,831 INFO    MainThread:5214 [jupyter.py:save_history():459] not saving jupyter history
-2024-12-11 04:05:16,831 INFO    MainThread:5214 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:05:16,831 INFO    MainThread:5214 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
-2024-12-11 04:05:16,832 INFO    MainThread:5214 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
-2024-12-11 04:05:16,832 INFO    MainThread:5214 [wandb_run.py:_restore():2390] restore
-2024-12-11 04:05:16,832 INFO    MainThread:5214 [wandb_run.py:_restore():2396] restore done
-2024-12-11 04:05:18,152 INFO    MainThread:5214 [wandb_run.py:_footer_history_summary_info():3951] rendering history
-2024-12-11 04:05:18,152 INFO    MainThread:5214 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
-2024-12-11 04:05:18,160 INFO    MainThread:5214 [wandb_run.py:_footer_sync_info():3912] logging synced files
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():688] starting backend
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:30:31,643 INFO    MainThread:2341 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:30:31,644 INFO    MainThread:2341 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:30:31,652 INFO    MainThread:2341 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:30:34,399 INFO    MainThread:2341 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:30:34,399 INFO    MainThread:2341 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:30:34,477 INFO    MainThread:2341 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:30:35,009 INFO    MainThread:2341 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:30:35,013 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,013 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,019 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,020 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,020 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,028 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,029 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,030 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,037 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,626 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,626 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,630 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:36,007 INFO    MainThread:2341 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 32, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 18, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-30-35_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 204, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 102, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:30:36,011 INFO    MainThread:2341 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7de6143df1c0>>
+2024-12-11 04:30:36,011 INFO    MainThread:2341 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:37:00,589 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:00,589 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:00,594 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,005 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,005 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,010 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,010 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,011 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,017 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,171 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,171 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,177 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,180 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,180 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,184 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,364 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,364 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,372 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,373 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,373 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,379 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,392 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,392 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,396 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/pfhjmc9v
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-11 04:37:05,398 INFO    MainThread:2341 [wandb_run.py:_restore():2390] restore
+2024-12-11 04:37:05,398 INFO    MainThread:2341 [wandb_run.py:_restore():2396] restore done
+2024-12-11 04:37:06,676 INFO    MainThread:2341 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-11 04:37:06,677 INFO    MainThread:2341 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-11 04:37:06,685 INFO    MainThread:2341 [wandb_run.py:_footer_sync_info():3912] logging synced files

wandb/run-20241211_042633-wah4vux1/files/config.yaml

@@ -0,0 +1,494 @@
+_attn_implementation_autoset:
+    value: true
+_name_or_path:
+    value: belisards/congretimbau
+_wandb:
+    value:
+        cli_version: 0.19.0
+        m:
+            - "1": train/global_step
+              "6":
+                - 3
+              "7": []
+        python_version: 3.10.12
+        t:
+            "1":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "2":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "3":
+                - 7
+                - 13
+                - 19
+                - 23
+                - 55
+                - 66
+            "4": 3.10.12
+            "5": 0.19.0
+            "6": 4.47.0
+            "8":
+                - 1
+                - 5
+                - 12
+            "9":
+                "1": transformers_trainer
+            "12": 0.19.0
+            "13": linux-x86_64
+accelerator_config:
+    value:
+        dispatch_batches: null
+        even_batches: true
+        gradient_accumulation_kwargs: null
+        non_blocking: false
+        split_batches: false
+        use_seedable_sampler: true
+adafactor:
+    value: false
+adam_beta1:
+    value: 0.9
+adam_beta2:
+    value: 0.999
+adam_epsilon:
+    value: 1e-08
+add_cross_attention:
+    value: false
+architectures:
+    value:
+        - BertForMaskedLM
+attention_probs_dropout_prob:
+    value: 0.05
+auto_find_batch_size:
+    value: false
+average_tokens_across_devices:
+    value: false
+bad_words_ids:
+    value: null
+batch_eval_metrics:
+    value: false
+begin_suppress_tokens:
+    value: null
+bf16:
+    value: false
+bf16_full_eval:
+    value: false
+bos_token_id:
+    value: null
+chunk_size_feed_forward:
+    value: 0
+classifier_dropout:
+    value: null
+cross_attention_hidden_size:
+    value: null
+data_seed:
+    value: null
+dataloader_drop_last:
+    value: false
+dataloader_num_workers:
+    value: 0
+dataloader_persistent_workers:
+    value: false
+dataloader_pin_memory:
+    value: true
+dataloader_prefetch_factor:
+    value: null
+ddp_backend:
+    value: null
+ddp_broadcast_buffers:
+    value: null
+ddp_bucket_cap_mb:
+    value: null
+ddp_find_unused_parameters:
+    value: null
+ddp_timeout:
+    value: 1800
+debug:
+    value: []
+decoder_start_token_id:
+    value: null
+deepspeed:
+    value: null
+directionality:
+    value: bidi
+disable_tqdm:
+    value: false
+dispatch_batches:
+    value: null
+diversity_penalty:
+    value: 0
+do_eval:
+    value: true
+do_predict:
+    value: false
+do_sample:
+    value: false
+do_train:
+    value: false
+early_stopping:
+    value: false
+encoder_no_repeat_ngram_size:
+    value: 0
+eos_token_id:
+    value: null
+eval_accumulation_steps:
+    value: null
+eval_delay:
+    value: 0
+eval_do_concat_batches:
+    value: true
+eval_on_start:
+    value: false
+eval_steps:
+    value: 24
+eval_strategy:
+    value: epoch
+eval_use_gather_object:
+    value: false
+evaluation_strategy:
+    value: null
+exponential_decay_length_penalty:
+    value: null
+finetuning_task:
+    value: null
+forced_bos_token_id:
+    value: null
+forced_eos_token_id:
+    value: null
+fp16:
+    value: false
+fp16_backend:
+    value: auto
+fp16_full_eval:
+    value: false
+fp16_opt_level:
+    value: O1
+fsdp:
+    value: []
+fsdp_config:
+    value:
+        min_num_params: 0
+        xla: false
+        xla_fsdp_grad_ckpt: false
+        xla_fsdp_v2: false
+fsdp_min_num_params:
+    value: 0
+fsdp_transformer_layer_cls_to_wrap:
+    value: null
+full_determinism:
+    value: false
+gradient_accumulation_steps:
+    value: 1
+gradient_checkpointing:
+    value: false
+gradient_checkpointing_kwargs:
+    value: null
+greater_is_better:
+    value: true
+group_by_length:
+    value: false
+half_precision_backend:
+    value: auto
+hidden_act:
+    value: gelu
+hidden_dropout_prob:
+    value: 0.05
+hidden_size:
+    value: 1024
+hub_always_push:
+    value: false
+hub_model_id:
+    value: null
+hub_private_repo:
+    value: null
+hub_strategy:
+    value: every_save
+hub_token:
+    value: <HUB_TOKEN>
+id2label:
+    value:
+        "0": "0"
+        "1": "1"
+ignore_data_skip:
+    value: false
+include_for_metrics:
+    value: []
+include_inputs_for_metrics:
+    value: false
+include_num_input_tokens_seen:
+    value: false
+include_tokens_per_second:
+    value: false
+initializer_range:
+    value: 0.02
+intermediate_size:
+    value: 4096
+is_decoder:
+    value: false
+is_encoder_decoder:
+    value: false
+jit_mode_eval:
+    value: false
+label_names:
+    value: null
+label_smoothing_factor:
+    value: 0
+label2id:
+    value:
+        "0": 0
+        "1": 1
+layer_norm_eps:
+    value: 1e-12
+learning_rate:
+    value: 1e-05
+length_column_name:
+    value: length
+length_penalty:
+    value: 1
+load_best_model_at_end:
+    value: true
+local_rank:
+    value: 0
+log_level:
+    value: passive
+log_level_replica:
+    value: warning
+log_on_each_node:
+    value: true
+logging_dir:
+    value: ./runs/Dec11_04-28-19_fd55a770be24
+logging_first_step:
+    value: false
+logging_nan_inf_filter:
+    value: true
+logging_steps:
+    value: 10
+logging_strategy:
+    value: steps
+lr_scheduler_type:
+    value: linear
+max_grad_norm:
+    value: 1
+max_length:
+    value: 20
+max_position_embeddings:
+    value: 512
+max_steps:
+    value: -1
+metric_for_best_model:
+    value: f1
+min_length:
+    value: 0
+model/num_parameters:
+    value: 334398466
+model_type:
+    value: bert
+mp_parameters:
+    value: ""
+neftune_noise_alpha:
+    value: null
+no_cuda:
+    value: false
+no_repeat_ngram_size:
+    value: 0
+num_attention_heads:
+    value: 16
+num_beam_groups:
+    value: 1
+num_beams:
+    value: 1
+num_hidden_layers:
+    value: 24
+num_return_sequences:
+    value: 1
+num_train_epochs:
+    value: 15
+optim:
+    value: adamw_torch
+optim_args:
+    value: null
+optim_target_modules:
+    value: null
+output_attentions:
+    value: false
+output_dir:
+    value: .
+output_hidden_states:
+    value: false
+output_past:
+    value: true
+output_scores:
+    value: false
+overwrite_output_dir:
+    value: false
+pad_token_id:
+    value: 0
+past_index:
+    value: -1
+per_device_eval_batch_size:
+    value: 128
+per_device_train_batch_size:
+    value: 128
+per_gpu_eval_batch_size:
+    value: null
+per_gpu_train_batch_size:
+    value: null
+pooler_fc_size:
+    value: 768
+pooler_num_attention_heads:
+    value: 12
+pooler_num_fc_layers:
+    value: 3
+pooler_size_per_head:
+    value: 128
+pooler_type:
+    value: first_token_transform
+position_embedding_type:
+    value: absolute
+prediction_loss_only:
+    value: false
+prefix:
+    value: null
+problem_type:
+    value: null
+push_to_hub:
+    value: false
+push_to_hub_model_id:
+    value: null
+push_to_hub_organization:
+    value: null
+push_to_hub_token:
+    value: <PUSH_TO_HUB_TOKEN>
+ray_scope:
+    value: last
+remove_invalid_values:
+    value: false
+remove_unused_columns:
+    value: true
+repetition_penalty:
+    value: 1
+report_to:
+    value:
+        - wandb
+restore_callback_states_from_checkpoint:
+    value: false
+resume_from_checkpoint:
+    value: null
+return_dict:
+    value: true
+return_dict_in_generate:
+    value: false
+run_name:
+    value: m2-congretimbau_tunado
+save_on_each_node:
+    value: false
+save_only_model:
+    value: false
+save_safetensors:
+    value: true
+save_steps:
+    value: 48
+save_strategy:
+    value: epoch
+save_total_limit:
+    value: 1
+seed:
+    value: 5151
+sep_token_id:
+    value: null
+skip_memory_metrics:
+    value: true
+split_batches:
+    value: null
+suppress_tokens:
+    value: null
+task_specific_params:
+    value: null
+temperature:
+    value: 1
+tf_legacy_loss:
+    value: false
+tf32:
+    value: null
+tie_encoder_decoder:
+    value: false
+tie_word_embeddings:
+    value: true
+tokenizer_class:
+    value: null
+top_k:
+    value: 50
+top_p:
+    value: 1
+torch_compile:
+    value: false
+torch_compile_backend:
+    value: null
+torch_compile_mode:
+    value: null
+torch_dtype:
+    value: float32
+torch_empty_cache_steps:
+    value: null
+torchdynamo:
+    value: null
+torchscript:
+    value: false
+tpu_metrics_debug:
+    value: false
+tpu_num_cores:
+    value: null
+transformers_version:
+    value: 4.47.0
+type_vocab_size:
+    value: 2
+typical_p:
+    value: 1
+use_bfloat16:
+    value: false
+use_cache:
+    value: true
+use_cpu:
+    value: false
+use_ipex:
+    value: false
+use_legacy_prediction_loop:
+    value: false
+use_liger_kernel:
+    value: false
+use_mps_device:
+    value: false
+vocab_size:
+    value: 29794
+warmup_ratio:
+    value: 0
+warmup_steps:
+    value: 200
+weight_decay:
+    value: 0.02

wandb/run-20241211_042633-wah4vux1/files/requirements.txt

@@ -0,0 +1,578 @@
+multiprocess==0.70.16
+accelerate==1.2.0
+fsspec==2024.9.0
+wandb==0.19.0
+transformers==4.47.0
+evaluate==0.4.3
+dill==0.3.8
+tokenizers==0.21.0
+datasets==3.2.0
+xxhash==3.5.0
+google-colab==1.0.0
+termcolor==2.5.0
+numexpr==2.10.2
+duckdb==1.1.3
+slicer==0.0.8
+pandas-stubs==2.2.2.240909
+yarl==1.18.3
+jupyter-client==6.1.12
+umf==0.9.1
+aiohappyeyeballs==2.4.4
+tensorflow-io-gcs-filesystem==0.37.1
+nibabel==5.3.2
+google-api-python-client==2.151.0
+gensim==4.3.3
+plotnine==0.14.3
+stanio==0.5.1
+pyogrio==0.10.0
+nvidia-curand-cu12==10.3.7.77
+Bottleneck==1.4.2
+openpyxl==3.1.5
+audioread==3.0.1
+libcudf-cu12==24.10.1
+networkx==3.4.2
+cupy-cuda12x==12.2.0
+nx-cugraph-cu12==24.10.0
+aiosignal==1.3.1
+StrEnum==0.4.15
+jsonpickle==4.0.0
+google-cloud-firestore==2.19.0
+scipy==1.13.1
+colour==0.1.5
+pycparser==2.22
+cmake==3.30.5
+fastdownload==0.0.7
+google-cloud-functions==1.18.1
+imagesize==1.4.1
+imageio==2.36.1
+frozendict==2.4.6
+ndindex==1.9.2
+html5lib==1.1
+python-louvain==0.16
+Cython==3.0.11
+fastai==2.7.18
+cuda-python==12.2.1
+parsy==2.1
+smmap==5.0.1
+weasel==0.4.1
+pyasn1==0.6.1
+matplotlib==3.8.0
+immutabledict==4.2.1
+dopamine_rl==4.0.9
+uc-micro-py==1.0.3
+websocket-client==1.8.0
+anyio==3.7.1
+msgpack==1.1.0
+multitasking==0.0.11
+albucore==0.0.19
+scikit-image==0.24.0
+setproctitle==1.3.4
+marisa-trie==1.2.1
+nvidia-cuda-nvcc-cu12==12.6.85
+sphinxcontrib-qthelp==2.0.0
+tables==3.10.1
+kaggle==1.6.17
+google-cloud-core==2.4.1
+soupsieve==2.6
+opencv-contrib-python==4.10.0.84
+python-box==7.2.0
+fonttools==4.55.1
+Markdown==3.7
+googleapis-common-protos==1.66.0
+tensorflow-metadata==1.13.1
+google-auth-httplib2==0.2.0
+autograd==1.7.0
+pydantic_core==2.27.1
+pexpect==4.9.0
+tweepy==4.14.0
+pyshp==2.3.1
+sklearn-pandas==2.2.0
+toml==0.10.2
+pydotplus==2.0.2
+click==8.1.7
+optree==0.13.1
+catalogue==2.0.10
+google-api-core==2.19.2
+en-core-web-sm==3.7.1
+tensorflow-datasets==4.9.7
+pynvjitlink-cu12==0.4.0
+pytest==8.3.4
+portpicker==1.5.2
+dm-tree==0.1.8
+h5py==3.12.1
+pandas-gbq==0.24.0
+qdldl==0.1.7.post4
+partd==1.4.2
+wrapt==1.17.0
+blis==0.7.11
+textblob==0.17.1
+jupyterlab_widgets==3.0.13
+filelock==3.16.1
+oauth2client==4.1.3
+iniconfig==2.0.0
+notebook==6.5.5
+pydot==3.0.3
+tomli==2.2.1
+py4j==0.10.9.7
+langchain-text-splitters==0.3.2
+typer==0.15.0
+contourpy==1.3.1
+aiohttp==3.11.9
+langchain==0.3.9
+datascience==0.17.6
+etuples==0.3.9
+six==1.16.0
+tornado==6.3.3
+torchaudio==2.5.1+cu121
+httpcore==1.0.7
+importlib_metadata==8.5.0
+holoviews==1.20.0
+google-ai-generativelanguage==0.6.10
+osqp==0.6.7.post3
+pymc==5.18.2
+google-pasta==0.2.0
+py-cpuinfo==9.0.0
+colorcet==3.1.0
+blosc2==2.7.1
+nvidia-cuda-cupti-cu12==12.6.80
+colorlover==0.3.0
+pymystem3==0.2.0
+MarkupSafe==3.0.2
+astunparse==1.6.3
+google-cloud-bigquery==3.25.0
+opencv-python==4.10.0.84
+Flask==3.0.3
+fastjsonschema==2.21.1
+pylibcugraph-cu12==24.10.0
+google-cloud-datastore==2.20.1
+jaxlib==0.4.33
+rich==13.9.4
+widgetsnbextension==3.6.10
+vega-datasets==0.9.0
+natsort==8.4.0
+blinker==1.9.0
+statsmodels==0.14.4
+sniffio==1.3.1
+cymem==2.0.10
+threadpoolctl==3.5.0
+proto-plus==1.25.0
+httpimport==1.4.0
+matplotlib-inline==0.1.7
+ratelim==0.1.6
+python-utils==3.9.1
+prompt_toolkit==3.0.48
+gspread==6.0.2
+google-cloud-storage==2.8.0
+PyDrive==1.3.1
+tensorflow-probability==0.24.0
+xarray==2024.10.0
+eerepr==0.0.4
+murmurhash==1.0.11
+pylibcudf-cu12==24.10.1
+music21==9.3.0
+geographiclib==2.0
+smart-open==7.0.5
+pygit2==1.16.0
+more-itertools==10.5.0
+cycler==0.12.1
+idna==3.10
+h11==0.14.0
+ipython-genutils==0.2.0
+referencing==0.35.1
+GitPython==3.1.43
+sentencepiece==0.2.0
+CacheControl==0.14.1
+tf_keras==2.17.0
+annotated-types==0.7.0
+ecos==2.0.14
+geopandas==1.0.1
+jieba==0.42.1
+shapely==2.0.6
+ipyparallel==8.8.0
+pyOpenSSL==24.2.1
+pyarrow==17.0.0
+opencv-python-headless==4.10.0.84
+openai==1.54.5
+sentry-sdk==2.19.0
+pyarrow-hotfix==0.6
+gitdb==4.0.11
+prophet==1.1.6
+ipython-sql==0.5.0
+tf-slim==1.1.0
+PySocks==1.7.1
+imbalanced-learn==0.12.4
+mlxtend==0.23.3
+mkl==2025.0.1
+itsdangerous==2.2.0
+gast==0.6.0
+torchsummary==1.5.1
+urllib3==2.2.3
+earthengine-api==1.2.0
+jupyter-server==1.24.0
+webencodings==0.5.1
+seaborn==0.13.2
+SQLAlchemy==2.0.36
+pyerfa==2.0.1.5
+xarray-einstats==0.8.0
+jsonschema==4.23.0
+parso==0.8.4
+tensorflow-hub==0.16.1
+ipyfilechooser==0.6.0
+packaging==24.2
+param==2.1.1
+et_xmlfile==2.0.0
+kagglehub==0.3.4
+yfinance==0.2.50
+spacy==3.7.5
+imgaug==0.4.0
+sqlparse==0.5.2
+certifi==2024.8.30
+plotly==5.24.1
+pandas-datareader==0.10.0
+charset-normalizer==3.4.0
+cloudpathlib==0.20.0
+decorator==4.4.2
+prometheus_client==0.21.1
+google-auth==2.27.0
+pyzmq==24.0.1
+tzdata==2024.2
+scs==3.2.7
+types-pytz==2024.2.0.20241003
+db-dtypes==1.3.1
+chex==0.1.87
+spacy-loggers==1.0.5
+peewee==3.17.8
+nvidia-cuda-runtime-cu12==12.6.77
+ibis-framework==9.2.0
+wasabi==1.1.3
+python-dateutil==2.8.2
+google-generativeai==0.8.3
+google-cloud-aiplatform==1.73.0
+jupyterlab_pygments==0.3.0
+google-cloud-translate==3.17.0
+exceptiongroup==1.2.2
+intel-openmp==2025.0.3
+nvidia-cufft-cu12==11.3.0.4
+timm==1.0.12
+python-slugify==8.0.4
+cryptography==43.0.3
+multipledispatch==1.0.0
+google-crc32c==1.6.0
+rsa==4.9
+cffi==1.17.1
+holidays==0.62
+tinycss2==1.4.0
+google-cloud-iam==2.16.1
+google-cloud-resource-manager==1.13.1
+typeguard==4.4.1
+xlrd==2.0.1
+google==2.0.3
+pandocfilters==1.5.1
+promise==2.3
+progressbar2==4.5.0
+wheel==0.45.1
+google-resumable-media==2.7.2
+einops==0.8.0
+defusedxml==0.7.1
+llvmlite==0.43.0
+attrs==24.2.0
+preshed==3.0.9
+geocoder==1.38.1
+firebase-admin==6.5.0
+ipython==7.34.0
+cvxopt==1.3.2
+greenlet==3.1.1
+confection==0.1.5
+keras==3.5.0
+pandas==2.2.2
+graphviz==0.20.3
+tenacity==9.0.0
+future==1.0.0
+inflect==7.4.0
+langsmith==0.1.147
+babel==2.16.0
+nvidia-cusparse-cu12==12.5.4.2
+importlib_resources==6.4.5
+jiter==0.8.0
+sphinxcontrib-htmlhelp==2.1.0
+moviepy==1.0.3
+typing_extensions==4.12.2
+tcmlib==1.2.0
+snowballstemmer==2.2.0
+scikit-learn==1.5.2
+jsonpatch==1.33
+notebook_shim==0.2.4
+mizani==0.13.0
+simple-parsing==0.1.6
+humanize==4.11.0
+hyperopt==0.2.7
+frozenlist==1.5.0
+uritemplate==4.1.1
+pydata-google-auth==1.9.0
+pyperclip==1.9.0
+lazy_loader==0.4
+bigframes==1.27.0
+numba==0.60.0
+pytensor==2.26.4
+geemap==0.35.1
+polars==1.9.0
+orjson==3.10.12
+fastrlock==0.8.2
+mistune==3.0.2
+sphinxcontrib-applehelp==2.0.0
+mpmath==1.3.0
+mdurl==0.1.2
+async-timeout==4.0.3
+jax==0.4.33
+panel==1.5.4
+patsy==1.0.1
+oauthlib==3.2.2
+librosa==0.10.2.post1
+imutils==0.5.4
+xyzservices==2024.9.0
+Pygments==2.18.0
+sphinxcontrib-jsmath==1.0.1
+pyasn1_modules==0.4.1
+pyproj==3.7.0
+Pyomo==6.8.2
+nvidia-cublas-cu12==12.6.4.1
+numpy==1.26.4
+google-cloud-bigquery-storage==2.27.0
+soxr==0.5.0.post1
+bleach==6.2.0
+sympy==1.13.1
+dask==2024.10.0
+miniKanren==1.0.3
+pathlib==1.0.1
+torch==2.5.1+cu121
+distro==1.9.0
+gym==0.25.2
+lxml==5.3.0
+folium==0.18.0
+altair==4.2.2
+tifffile==2024.9.20
+diffusers==0.31.0
+requests-oauthlib==1.3.1
+google-cloud-language==2.15.1
+ptyprocess==0.7.0
+tensorboard-data-server==0.7.2
+locket==1.0.0
+intel-cmplr-lib-ur==2025.0.3
+lightgbm==4.5.0
+flax==0.8.5
+mdit-py-plugins==0.4.2
+pygame==2.6.1
+pytz==2024.2
+pyparsing==3.2.0
+alabaster==1.0.0
+jupyter_core==5.7.2
+cloudpickle==3.1.0
+logical-unification==0.4.6
+traittypes==0.2.1
+terminado==0.18.1
+beautifulsoup4==4.12.3
+google-cloud-bigquery-connection==1.16.1
+scooby==0.10.0
+google-auth-oauthlib==1.2.1
+protobuf==4.25.5
+astropy==6.1.7
+GDAL==3.6.4
+nbformat==5.10.4
+safetensors==0.4.5
+tzlocal==5.2
+chardet==5.2.0
+psutil==5.9.5
+jsonpointer==3.0.0
+psycopg2==2.9.10
+cachetools==5.5.0
+pyspark==3.5.3
+google-cloud-pubsub==2.27.1
+pillow==11.0.0
+pydantic==2.10.3
+langcodes==3.5.0
+jsonschema-specifications==2024.10.1
+markdown-it-py==3.0.0
+nltk==3.9.1
+nbconvert==7.16.4
+pooch==1.8.2
+huggingface-hub==0.26.3
+tbb==2022.0.0
+ipywidgets==7.7.1
+matplotlib-venn==1.1.1
+rmm-cu12==24.10.0
+sphinxcontrib-serializinghtml==2.0.0
+branca==0.8.0
+gin-config==0.5.0
+bqplot==0.12.43
+opentelemetry-sdk==1.28.2
+community==1.0.0b1
+soundfile==0.12.1
+shap==0.46.0
+joblib==1.4.2
+entrypoints==0.4
+docstring_parser==0.16
+multidict==6.1.0
+grpcio-status==1.62.3
+wcwidth==0.2.13
+geopy==2.4.1
+prettytable==3.12.0
+propcache==0.2.1
+ml-dtypes==0.4.1
+atpublic==4.1.0
+stringzilla==3.11.0
+libclang==18.1.1
+arviz==0.20.0
+requests==2.32.3
+fastprogress==1.0.3
+dlib==19.24.2
+platformdirs==4.3.6
+tabulate==0.9.0
+cufflinks==0.17.3
+spacy-legacy==3.0.12
+grpcio==1.68.1
+cvxpy==1.5.4
+flatbuffers==24.3.25
+pluggy==1.5.0
+regex==2024.9.11
+clarabel==0.9.0
+httplib2==0.22.0
+language_data==1.3.0
+backcall==0.2.0
+nbclient==0.10.1
+ipyleaflet==0.19.2
+PyJWT==2.10.1
+toolz==0.12.1
+opt_einsum==3.4.0
+nvtx==0.2.10
+nvidia-nccl-cu12==2.23.4
+debugpy==1.8.0
+sphinxcontrib-devhelp==2.0.0
+jax-cuda12-pjrt==0.4.33
+missingno==0.5.2
+proglog==0.1.10
+nest-asyncio==1.6.0
+nvidia-cusolver-cu12==11.7.1.2
+gspread-dataframe==3.3.1
+bigquery-magics==0.4.0
+jellyfish==1.1.2
+text-unidecode==1.3
+Deprecated==1.2.15
+srsly==2.4.8
+ipytree==0.2.2
+gcsfs==2024.10.0
+ipyevents==2.0.2
+docker-pycreds==0.4.0
+glob2==0.7
+wordcloud==1.9.4
+traitlets==5.7.1
+nbclassic==1.1.0
+nvidia-cudnn-cu12==9.6.0.74
+easydict==1.13
+httpx==0.28.0
+Jinja2==3.1.4
+argon2-cffi==23.1.0
+linkify-it-py==2.0.3
+optax==0.2.4
+cons==0.4.6
+requests-toolbelt==1.0.0
+editdistance==0.8.1
+jupyter-leaflet==0.19.2
+webcolors==24.11.1
+jax-cuda12-plugin==0.4.33
+albumentations==1.4.20
+PyOpenGL==3.1.7
+tqdm==4.66.6
+googledrivedownloader==0.4
+peft==0.13.2
+absl-py==1.4.0
+eval_type_backport==0.2.0
+opentelemetry-api==1.28.2
+Send2Trash==1.8.3
+gdown==5.2.0
+google-cloud-bigtable==2.27.0
+grpc-google-iam-v1==0.13.1
+rpds-py==0.22.3
+xgboost==2.1.3
+pyviz_comms==3.0.3
+ipykernel==5.5.6
+gym-notices==0.0.8
+opentelemetry-semantic-conventions==0.49b2
+fastcore==1.7.22
+torchvision==0.20.1+cu121
+Sphinx==8.1.3
+ply==3.11
+tensorboard==2.17.1
+namex==0.0.8
+astropy-iers-data==0.2024.12.2.0.35.34
+rpy2==3.4.2
+nvidia-nvjitlink-cu12==12.6.85
+array_record==0.5.1
+PyYAML==6.0.2
+tensorflow==2.17.1
+yellowbrick==1.5
+pylibraft-cu12==24.10.0
+orbax-checkpoint==0.6.4
+Werkzeug==3.1.3
+jupyter-console==6.1.0
+thinc==8.2.5
+etils==1.11.0
+langchain-core==0.3.21
+cmdstanpy==1.2.4
+h5netcdf==1.4.1
+cudf-cu12==24.10.1
+zipp==3.21.0
+PyDrive2==1.21.3
+kiwisolver==1.4.7
+pickleshare==0.7.5
+bokeh==3.6.2
+shellingham==1.5.4
+imageio-ffmpeg==0.5.1
+pycocotools==2.0.8
+sqlglot==25.1.0
+tensorstore==0.1.69
+argon2-cffi-bindings==21.2.0
+sentence-transformers==3.2.1
+docutils==0.21.2
+python-apt==0.0.0
+setuptools==75.1.0
+pip==24.1.2
+requirements-parser==0.9.0
+types-setuptools==75.6.0.20241126
+importlib-metadata==4.6.4
+blinker==1.4
+PyJWT==2.3.0
+PyGObject==3.42.1
+cryptography==3.4.8
+pyparsing==2.4.7
+wadllib==1.3.6
+more-itertools==8.10.0
+zipp==1.0.0
+distro==1.7.0
+six==1.16.0
+python-apt==2.4.0+ubuntu4
+jeepney==0.7.1
+SecretStorage==3.3.1
+oauthlib==3.2.0
+lazr.restfulclient==0.14.4
+httplib2==0.20.2
+launchpadlib==1.10.16
+keyring==23.5.0
+lazr.uri==1.0.6
+dbus-python==1.2.18
+inflect==7.3.1
+wheel==0.43.0
+packaging==24.1
+importlib_metadata==8.0.0
+more-itertools==10.3.0
+platformdirs==4.2.2
+backports.tarfile==1.2.0
+typing_extensions==4.12.2
+jaraco.functools==4.0.1
+jaraco.collections==5.1.0
+tomli==2.0.1
+importlib_resources==6.4.0
+jaraco.text==3.12.1
+jaraco.context==5.3.0
+typeguard==4.3.0
+autocommand==2.2.2
+zipp==3.19.2

wandb/run-20241211_042633-wah4vux1/files/wandb-metadata.json

@@ -0,0 +1,38 @@
+{
+  "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
+  "python": "CPython 3.10.12",
+  "startedAt": "2024-12-11T04:26:33.646888Z",
+  "program": "m2-congretimbau-focal_loss-sempartido.ipynb",
+  "email": "[email protected]",
+  "root": "/content",
+  "host": "fd55a770be24",
+  "username": "root",
+  "executable": "/usr/bin/python3",
+  "colab": "https://colab.research.google.com/notebook#fileId=1a_b6x6zKkekdeqrCzP83ovWk7MhdV3DO",
+  "cpu_count": 6,
+  "cpu_count_logical": 12,
+  "gpu": "NVIDIA A100-SXM4-40GB",
+  "gpu_count": 1,
+  "disk": {
+    "/": {
+      "total": "120942624768",
+      "used": "36614164480"
+    }
+  },
+  "memory": {
+    "total": "89632796672"
+  },
+  "cpu": {
+    "count": 6,
+    "countLogical": 12
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA A100-SXM4-40GB",
+      "memoryTotal": "42949672960",
+      "cudaCores": 6912,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.2"
+}

wandb/run-20241211_042633-wah4vux1/files/wandb-summary.json

@@ -0,0 +1 @@
+{"_wandb":{"runtime":8}}

wandb/run-20241211_042633-wah4vux1/logs/debug-core.log

@@ -0,0 +1,14 @@
+{"time":"2024-12-11T04:26:32.996515483Z","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmp1ht12chm/port-464.txt","pid":464,"debug":false,"disable-analytics":false}
+{"time":"2024-12-11T04:26:32.99654412Z","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
+{"time":"2024-12-11T04:26:33.443154063Z","level":"INFO","msg":"Will exit if parent process dies.","ppid":464}
+{"time":"2024-12-11T04:26:33.443156332Z","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":40707,"Zone":""}}
+{"time":"2024-12-11T04:26:33.585385719Z","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:26:33.64885795Z","level":"INFO","msg":"handleInformInit: received","streamId":"wah4vux1","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:26:33.751779758Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"wah4vux1","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.430422355Z","level":"INFO","msg":"handleInformTeardown: server teardown initiated","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.430524985Z","level":"INFO","msg":"connection: Close: initiating connection closure","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.430642627Z","level":"INFO","msg":"connection: Close: connection successfully closed","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.430541905Z","level":"INFO","msg":"server is shutting down"}
+{"time":"2024-12-11T04:28:38.669777272Z","level":"INFO","msg":"handleInformTeardown: server shutdown complete","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.669791299Z","level":"INFO","msg":"connection: ManageConnectionData: connection closed","id":"127.0.0.1:53892"}
+{"time":"2024-12-11T04:28:38.669799437Z","level":"INFO","msg":"server is closed"}

wandb/run-20241211_042633-wah4vux1/logs/debug-internal.log

@@ -0,0 +1,29 @@
+{"time":"2024-12-11T04:26:33.649024782Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:26:33.649049094Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_042633-wah4vux1/logs/debug-core.log"}
+{"time":"2024-12-11T04:26:33.751742244Z","level":"INFO","msg":"created new stream","id":"wah4vux1"}
+{"time":"2024-12-11T04:26:33.75177344Z","level":"INFO","msg":"stream: started","id":"wah4vux1"}
+{"time":"2024-12-11T04:26:33.751819655Z","level":"INFO","msg":"writer: Do: started","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:26:33.751846429Z","level":"INFO","msg":"sender: started","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:26:33.751889938Z","level":"INFO","msg":"handler: started","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:26:37.433996195Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:26:37.918501173Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:26:37.918542387Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:26:37.918551346Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:26:37.918557135Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:26:38.209467967Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:28:13.514944092Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:28:13.517111071Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:28:19.599319Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:28:20.269551048Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:28:20.274021048Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:28:22.701050286Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:28:27.079815946Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:28:27.602762512Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:28:38.430506078Z","level":"INFO","msg":"stream: closing","id":"wah4vux1"}
+{"time":"2024-12-11T04:28:38.430543738Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:28:38.431098624Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:28:38.624699235Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:28:38.669629724Z","level":"INFO","msg":"handler: closed","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:28:38.669657538Z","level":"INFO","msg":"sender: closed","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:28:38.669655507Z","level":"INFO","msg":"writer: Close: closed","stream_id":"wah4vux1"}
+{"time":"2024-12-11T04:28:38.669727276Z","level":"INFO","msg":"stream: closed","id":"wah4vux1"}

wandb/run-20241211_042633-wah4vux1/logs/debug.log

@@ -0,0 +1,48 @@
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_setup.py:_flush():68] Configure stats pid to 464
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_042633-wah4vux1/logs/debug.log
+2024-12-11 04:26:33,635 INFO    MainThread:464 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_042633-wah4vux1/logs/debug-internal.log
+2024-12-11 04:26:33,636 INFO    MainThread:464 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7bbc23b69150>
+2024-12-11 04:26:33,636 INFO    MainThread:464 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:26:33,636 INFO    MainThread:464 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+config: {}
+2024-12-11 04:26:33,636 INFO    MainThread:464 [wandb_init.py:init():688] starting backend
+2024-12-11 04:26:33,636 INFO    MainThread:464 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:26:33,646 INFO    MainThread:464 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:26:33,646 INFO    MainThread:464 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:26:33,654 INFO    MainThread:464 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:26:37,354 INFO    MainThread:464 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:26:37,354 INFO    MainThread:464 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:26:37,429 INFO    MainThread:464 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:26:37,879 INFO    MainThread:464 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:26:37,879 INFO    MainThread:464 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:26:37,879 INFO    MainThread:464 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:26:37,879 INFO    MainThread:464 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:26:37,881 INFO    MainThread:464 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:26:37,884 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:26:37,884 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:26:37,888 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:26:37,889 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:26:37,889 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:26:37,896 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:26:38,208 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:26:38,209 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:28:13,514 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:28:13,516 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:28:13,516 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:28:19,598 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:28:20,269 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:28:20,269 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:28:20,273 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:28:20,618 INFO    MainThread:464 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 15, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-28-19_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 48, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 24, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:28:20,622 INFO    MainThread:464 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7bbc208d5ba0>>
+2024-12-11 04:28:20,622 INFO    MainThread:464 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:28:22,699 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:28:22,700 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:28:27,079 INFO    MainThread:464 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:28:27,602 INFO    MainThread:464 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:28:27,602 INFO    MainThread:464 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:28:38,430 WARNING MsgRouterThr:464 [router.py:message_loop():75] message_loop has been closed

wandb/run-20241211_042903-vt1hbdpt/files/config.yaml

@@ -0,0 +1,494 @@
+_attn_implementation_autoset:
+    value: true
+_name_or_path:
+    value: belisards/congretimbau
+_wandb:
+    value:
+        cli_version: 0.19.0
+        m:
+            - "1": train/global_step
+              "6":
+                - 3
+              "7": []
+        python_version: 3.10.12
+        t:
+            "1":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "2":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "3":
+                - 7
+                - 13
+                - 19
+                - 23
+                - 55
+                - 66
+            "4": 3.10.12
+            "5": 0.19.0
+            "6": 4.47.0
+            "8":
+                - 1
+                - 5
+                - 12
+            "9":
+                "1": transformers_trainer
+            "12": 0.19.0
+            "13": linux-x86_64
+accelerator_config:
+    value:
+        dispatch_batches: null
+        even_batches: true
+        gradient_accumulation_kwargs: null
+        non_blocking: false
+        split_batches: false
+        use_seedable_sampler: true
+adafactor:
+    value: false
+adam_beta1:
+    value: 0.9
+adam_beta2:
+    value: 0.999
+adam_epsilon:
+    value: 1e-08
+add_cross_attention:
+    value: false
+architectures:
+    value:
+        - BertForMaskedLM
+attention_probs_dropout_prob:
+    value: 0.05
+auto_find_batch_size:
+    value: false
+average_tokens_across_devices:
+    value: false
+bad_words_ids:
+    value: null
+batch_eval_metrics:
+    value: false
+begin_suppress_tokens:
+    value: null
+bf16:
+    value: false
+bf16_full_eval:
+    value: false
+bos_token_id:
+    value: null
+chunk_size_feed_forward:
+    value: 0
+classifier_dropout:
+    value: null
+cross_attention_hidden_size:
+    value: null
+data_seed:
+    value: null
+dataloader_drop_last:
+    value: false
+dataloader_num_workers:
+    value: 0
+dataloader_persistent_workers:
+    value: false
+dataloader_pin_memory:
+    value: true
+dataloader_prefetch_factor:
+    value: null
+ddp_backend:
+    value: null
+ddp_broadcast_buffers:
+    value: null
+ddp_bucket_cap_mb:
+    value: null
+ddp_find_unused_parameters:
+    value: null
+ddp_timeout:
+    value: 1800
+debug:
+    value: []
+decoder_start_token_id:
+    value: null
+deepspeed:
+    value: null
+directionality:
+    value: bidi
+disable_tqdm:
+    value: false
+dispatch_batches:
+    value: null
+diversity_penalty:
+    value: 0
+do_eval:
+    value: true
+do_predict:
+    value: false
+do_sample:
+    value: false
+do_train:
+    value: false
+early_stopping:
+    value: false
+encoder_no_repeat_ngram_size:
+    value: 0
+eos_token_id:
+    value: null
+eval_accumulation_steps:
+    value: null
+eval_delay:
+    value: 0
+eval_do_concat_batches:
+    value: true
+eval_on_start:
+    value: false
+eval_steps:
+    value: 24
+eval_strategy:
+    value: epoch
+eval_use_gather_object:
+    value: false
+evaluation_strategy:
+    value: null
+exponential_decay_length_penalty:
+    value: null
+finetuning_task:
+    value: null
+forced_bos_token_id:
+    value: null
+forced_eos_token_id:
+    value: null
+fp16:
+    value: false
+fp16_backend:
+    value: auto
+fp16_full_eval:
+    value: false
+fp16_opt_level:
+    value: O1
+fsdp:
+    value: []
+fsdp_config:
+    value:
+        min_num_params: 0
+        xla: false
+        xla_fsdp_grad_ckpt: false
+        xla_fsdp_v2: false
+fsdp_min_num_params:
+    value: 0
+fsdp_transformer_layer_cls_to_wrap:
+    value: null
+full_determinism:
+    value: false
+gradient_accumulation_steps:
+    value: 1
+gradient_checkpointing:
+    value: false
+gradient_checkpointing_kwargs:
+    value: null
+greater_is_better:
+    value: true
+group_by_length:
+    value: false
+half_precision_backend:
+    value: auto
+hidden_act:
+    value: gelu
+hidden_dropout_prob:
+    value: 0.05
+hidden_size:
+    value: 1024
+hub_always_push:
+    value: false
+hub_model_id:
+    value: null
+hub_private_repo:
+    value: null
+hub_strategy:
+    value: every_save
+hub_token:
+    value: <HUB_TOKEN>
+id2label:
+    value:
+        "0": "0"
+        "1": "1"
+ignore_data_skip:
+    value: false
+include_for_metrics:
+    value: []
+include_inputs_for_metrics:
+    value: false
+include_num_input_tokens_seen:
+    value: false
+include_tokens_per_second:
+    value: false
+initializer_range:
+    value: 0.02
+intermediate_size:
+    value: 4096
+is_decoder:
+    value: false
+is_encoder_decoder:
+    value: false
+jit_mode_eval:
+    value: false
+label_names:
+    value: null
+label_smoothing_factor:
+    value: 0
+label2id:
+    value:
+        "0": 0
+        "1": 1
+layer_norm_eps:
+    value: 1e-12
+learning_rate:
+    value: 1e-05
+length_column_name:
+    value: length
+length_penalty:
+    value: 1
+load_best_model_at_end:
+    value: true
+local_rank:
+    value: 0
+log_level:
+    value: passive
+log_level_replica:
+    value: warning
+log_on_each_node:
+    value: true
+logging_dir:
+    value: ./runs/Dec11_04-29-04_fd55a770be24
+logging_first_step:
+    value: false
+logging_nan_inf_filter:
+    value: true
+logging_steps:
+    value: 10
+logging_strategy:
+    value: steps
+lr_scheduler_type:
+    value: linear
+max_grad_norm:
+    value: 1
+max_length:
+    value: 20
+max_position_embeddings:
+    value: 512
+max_steps:
+    value: -1
+metric_for_best_model:
+    value: f1
+min_length:
+    value: 0
+model/num_parameters:
+    value: 334398466
+model_type:
+    value: bert
+mp_parameters:
+    value: ""
+neftune_noise_alpha:
+    value: null
+no_cuda:
+    value: false
+no_repeat_ngram_size:
+    value: 0
+num_attention_heads:
+    value: 16
+num_beam_groups:
+    value: 1
+num_beams:
+    value: 1
+num_hidden_layers:
+    value: 24
+num_return_sequences:
+    value: 1
+num_train_epochs:
+    value: 15
+optim:
+    value: adamw_torch
+optim_args:
+    value: null
+optim_target_modules:
+    value: null
+output_attentions:
+    value: false
+output_dir:
+    value: .
+output_hidden_states:
+    value: false
+output_past:
+    value: true
+output_scores:
+    value: false
+overwrite_output_dir:
+    value: false
+pad_token_id:
+    value: 0
+past_index:
+    value: -1
+per_device_eval_batch_size:
+    value: 128
+per_device_train_batch_size:
+    value: 128
+per_gpu_eval_batch_size:
+    value: null
+per_gpu_train_batch_size:
+    value: null
+pooler_fc_size:
+    value: 768
+pooler_num_attention_heads:
+    value: 12
+pooler_num_fc_layers:
+    value: 3
+pooler_size_per_head:
+    value: 128
+pooler_type:
+    value: first_token_transform
+position_embedding_type:
+    value: absolute
+prediction_loss_only:
+    value: false
+prefix:
+    value: null
+problem_type:
+    value: null
+push_to_hub:
+    value: false
+push_to_hub_model_id:
+    value: null
+push_to_hub_organization:
+    value: null
+push_to_hub_token:
+    value: <PUSH_TO_HUB_TOKEN>
+ray_scope:
+    value: last
+remove_invalid_values:
+    value: false
+remove_unused_columns:
+    value: true
+repetition_penalty:
+    value: 1
+report_to:
+    value:
+        - wandb
+restore_callback_states_from_checkpoint:
+    value: false
+resume_from_checkpoint:
+    value: null
+return_dict:
+    value: true
+return_dict_in_generate:
+    value: false
+run_name:
+    value: m2-congretimbau_tunado
+save_on_each_node:
+    value: false
+save_only_model:
+    value: false
+save_safetensors:
+    value: true
+save_steps:
+    value: 48
+save_strategy:
+    value: epoch
+save_total_limit:
+    value: 1
+seed:
+    value: 5151
+sep_token_id:
+    value: null
+skip_memory_metrics:
+    value: true
+split_batches:
+    value: null
+suppress_tokens:
+    value: null
+task_specific_params:
+    value: null
+temperature:
+    value: 1
+tf_legacy_loss:
+    value: false
+tf32:
+    value: null
+tie_encoder_decoder:
+    value: false
+tie_word_embeddings:
+    value: true
+tokenizer_class:
+    value: null
+top_k:
+    value: 50
+top_p:
+    value: 1
+torch_compile:
+    value: false
+torch_compile_backend:
+    value: null
+torch_compile_mode:
+    value: null
+torch_dtype:
+    value: float32
+torch_empty_cache_steps:
+    value: null
+torchdynamo:
+    value: null
+torchscript:
+    value: false
+tpu_metrics_debug:
+    value: false
+tpu_num_cores:
+    value: null
+transformers_version:
+    value: 4.47.0
+type_vocab_size:
+    value: 2
+typical_p:
+    value: 1
+use_bfloat16:
+    value: false
+use_cache:
+    value: true
+use_cpu:
+    value: false
+use_ipex:
+    value: false
+use_legacy_prediction_loop:
+    value: false
+use_liger_kernel:
+    value: false
+use_mps_device:
+    value: false
+vocab_size:
+    value: 29794
+warmup_ratio:
+    value: 0
+warmup_steps:
+    value: 200
+weight_decay:
+    value: 0.02

wandb/run-20241211_042903-vt1hbdpt/files/requirements.txt

@@ -0,0 +1,578 @@
+multiprocess==0.70.16
+accelerate==1.2.0
+fsspec==2024.9.0
+wandb==0.19.0
+transformers==4.47.0
+evaluate==0.4.3
+dill==0.3.8
+tokenizers==0.21.0
+datasets==3.2.0
+xxhash==3.5.0
+google-colab==1.0.0
+termcolor==2.5.0
+numexpr==2.10.2
+duckdb==1.1.3
+slicer==0.0.8
+pandas-stubs==2.2.2.240909
+yarl==1.18.3
+jupyter-client==6.1.12
+umf==0.9.1
+aiohappyeyeballs==2.4.4
+tensorflow-io-gcs-filesystem==0.37.1
+nibabel==5.3.2
+google-api-python-client==2.151.0
+gensim==4.3.3
+plotnine==0.14.3
+stanio==0.5.1
+pyogrio==0.10.0
+nvidia-curand-cu12==10.3.7.77
+Bottleneck==1.4.2
+openpyxl==3.1.5
+audioread==3.0.1
+libcudf-cu12==24.10.1
+networkx==3.4.2
+cupy-cuda12x==12.2.0
+nx-cugraph-cu12==24.10.0
+aiosignal==1.3.1
+StrEnum==0.4.15
+jsonpickle==4.0.0
+google-cloud-firestore==2.19.0
+scipy==1.13.1
+colour==0.1.5
+pycparser==2.22
+cmake==3.30.5
+fastdownload==0.0.7
+google-cloud-functions==1.18.1
+imagesize==1.4.1
+imageio==2.36.1
+frozendict==2.4.6
+ndindex==1.9.2
+html5lib==1.1
+python-louvain==0.16
+Cython==3.0.11
+fastai==2.7.18
+cuda-python==12.2.1
+parsy==2.1
+smmap==5.0.1
+weasel==0.4.1
+pyasn1==0.6.1
+matplotlib==3.8.0
+immutabledict==4.2.1
+dopamine_rl==4.0.9
+uc-micro-py==1.0.3
+websocket-client==1.8.0
+anyio==3.7.1
+msgpack==1.1.0
+multitasking==0.0.11
+albucore==0.0.19
+scikit-image==0.24.0
+setproctitle==1.3.4
+marisa-trie==1.2.1
+nvidia-cuda-nvcc-cu12==12.6.85
+sphinxcontrib-qthelp==2.0.0
+tables==3.10.1
+kaggle==1.6.17
+google-cloud-core==2.4.1
+soupsieve==2.6
+opencv-contrib-python==4.10.0.84
+python-box==7.2.0
+fonttools==4.55.1
+Markdown==3.7
+googleapis-common-protos==1.66.0
+tensorflow-metadata==1.13.1
+google-auth-httplib2==0.2.0
+autograd==1.7.0
+pydantic_core==2.27.1
+pexpect==4.9.0
+tweepy==4.14.0
+pyshp==2.3.1
+sklearn-pandas==2.2.0
+toml==0.10.2
+pydotplus==2.0.2
+click==8.1.7
+optree==0.13.1
+catalogue==2.0.10
+google-api-core==2.19.2
+en-core-web-sm==3.7.1
+tensorflow-datasets==4.9.7
+pynvjitlink-cu12==0.4.0
+pytest==8.3.4
+portpicker==1.5.2
+dm-tree==0.1.8
+h5py==3.12.1
+pandas-gbq==0.24.0
+qdldl==0.1.7.post4
+partd==1.4.2
+wrapt==1.17.0
+blis==0.7.11
+textblob==0.17.1
+jupyterlab_widgets==3.0.13
+filelock==3.16.1
+oauth2client==4.1.3
+iniconfig==2.0.0
+notebook==6.5.5
+pydot==3.0.3
+tomli==2.2.1
+py4j==0.10.9.7
+langchain-text-splitters==0.3.2
+typer==0.15.0
+contourpy==1.3.1
+aiohttp==3.11.9
+langchain==0.3.9
+datascience==0.17.6
+etuples==0.3.9
+six==1.16.0
+tornado==6.3.3
+torchaudio==2.5.1+cu121
+httpcore==1.0.7
+importlib_metadata==8.5.0
+holoviews==1.20.0
+google-ai-generativelanguage==0.6.10
+osqp==0.6.7.post3
+pymc==5.18.2
+google-pasta==0.2.0
+py-cpuinfo==9.0.0
+colorcet==3.1.0
+blosc2==2.7.1
+nvidia-cuda-cupti-cu12==12.6.80
+colorlover==0.3.0
+pymystem3==0.2.0
+MarkupSafe==3.0.2
+astunparse==1.6.3
+google-cloud-bigquery==3.25.0
+opencv-python==4.10.0.84
+Flask==3.0.3
+fastjsonschema==2.21.1
+pylibcugraph-cu12==24.10.0
+google-cloud-datastore==2.20.1
+jaxlib==0.4.33
+rich==13.9.4
+widgetsnbextension==3.6.10
+vega-datasets==0.9.0
+natsort==8.4.0
+blinker==1.9.0
+statsmodels==0.14.4
+sniffio==1.3.1
+cymem==2.0.10
+threadpoolctl==3.5.0
+proto-plus==1.25.0
+httpimport==1.4.0
+matplotlib-inline==0.1.7
+ratelim==0.1.6
+python-utils==3.9.1
+prompt_toolkit==3.0.48
+gspread==6.0.2
+google-cloud-storage==2.8.0
+PyDrive==1.3.1
+tensorflow-probability==0.24.0
+xarray==2024.10.0
+eerepr==0.0.4
+murmurhash==1.0.11
+pylibcudf-cu12==24.10.1
+music21==9.3.0
+geographiclib==2.0
+smart-open==7.0.5
+pygit2==1.16.0
+more-itertools==10.5.0
+cycler==0.12.1
+idna==3.10
+h11==0.14.0
+ipython-genutils==0.2.0
+referencing==0.35.1
+GitPython==3.1.43
+sentencepiece==0.2.0
+CacheControl==0.14.1
+tf_keras==2.17.0
+annotated-types==0.7.0
+ecos==2.0.14
+geopandas==1.0.1
+jieba==0.42.1
+shapely==2.0.6
+ipyparallel==8.8.0
+pyOpenSSL==24.2.1
+pyarrow==17.0.0
+opencv-python-headless==4.10.0.84
+openai==1.54.5
+sentry-sdk==2.19.0
+pyarrow-hotfix==0.6
+gitdb==4.0.11
+prophet==1.1.6
+ipython-sql==0.5.0
+tf-slim==1.1.0
+PySocks==1.7.1
+imbalanced-learn==0.12.4
+mlxtend==0.23.3
+mkl==2025.0.1
+itsdangerous==2.2.0
+gast==0.6.0
+torchsummary==1.5.1
+urllib3==2.2.3
+earthengine-api==1.2.0
+jupyter-server==1.24.0
+webencodings==0.5.1
+seaborn==0.13.2
+SQLAlchemy==2.0.36
+pyerfa==2.0.1.5
+xarray-einstats==0.8.0
+jsonschema==4.23.0
+parso==0.8.4
+tensorflow-hub==0.16.1
+ipyfilechooser==0.6.0
+packaging==24.2
+param==2.1.1
+et_xmlfile==2.0.0
+kagglehub==0.3.4
+yfinance==0.2.50
+spacy==3.7.5
+imgaug==0.4.0
+sqlparse==0.5.2
+certifi==2024.8.30
+plotly==5.24.1
+pandas-datareader==0.10.0
+charset-normalizer==3.4.0
+cloudpathlib==0.20.0
+decorator==4.4.2
+prometheus_client==0.21.1
+google-auth==2.27.0
+pyzmq==24.0.1
+tzdata==2024.2
+scs==3.2.7
+types-pytz==2024.2.0.20241003
+db-dtypes==1.3.1
+chex==0.1.87
+spacy-loggers==1.0.5
+peewee==3.17.8
+nvidia-cuda-runtime-cu12==12.6.77
+ibis-framework==9.2.0
+wasabi==1.1.3
+python-dateutil==2.8.2
+google-generativeai==0.8.3
+google-cloud-aiplatform==1.73.0
+jupyterlab_pygments==0.3.0
+google-cloud-translate==3.17.0
+exceptiongroup==1.2.2
+intel-openmp==2025.0.3
+nvidia-cufft-cu12==11.3.0.4
+timm==1.0.12
+python-slugify==8.0.4
+cryptography==43.0.3
+multipledispatch==1.0.0
+google-crc32c==1.6.0
+rsa==4.9
+cffi==1.17.1
+holidays==0.62
+tinycss2==1.4.0
+google-cloud-iam==2.16.1
+google-cloud-resource-manager==1.13.1
+typeguard==4.4.1
+xlrd==2.0.1
+google==2.0.3
+pandocfilters==1.5.1
+promise==2.3
+progressbar2==4.5.0
+wheel==0.45.1
+google-resumable-media==2.7.2
+einops==0.8.0
+defusedxml==0.7.1
+llvmlite==0.43.0
+attrs==24.2.0
+preshed==3.0.9
+geocoder==1.38.1
+firebase-admin==6.5.0
+ipython==7.34.0
+cvxopt==1.3.2
+greenlet==3.1.1
+confection==0.1.5
+keras==3.5.0
+pandas==2.2.2
+graphviz==0.20.3
+tenacity==9.0.0
+future==1.0.0
+inflect==7.4.0
+langsmith==0.1.147
+babel==2.16.0
+nvidia-cusparse-cu12==12.5.4.2
+importlib_resources==6.4.5
+jiter==0.8.0
+sphinxcontrib-htmlhelp==2.1.0
+moviepy==1.0.3
+typing_extensions==4.12.2
+tcmlib==1.2.0
+snowballstemmer==2.2.0
+scikit-learn==1.5.2
+jsonpatch==1.33
+notebook_shim==0.2.4
+mizani==0.13.0
+simple-parsing==0.1.6
+humanize==4.11.0
+hyperopt==0.2.7
+frozenlist==1.5.0
+uritemplate==4.1.1
+pydata-google-auth==1.9.0
+pyperclip==1.9.0
+lazy_loader==0.4
+bigframes==1.27.0
+numba==0.60.0
+pytensor==2.26.4
+geemap==0.35.1
+polars==1.9.0
+orjson==3.10.12
+fastrlock==0.8.2
+mistune==3.0.2
+sphinxcontrib-applehelp==2.0.0
+mpmath==1.3.0
+mdurl==0.1.2
+async-timeout==4.0.3
+jax==0.4.33
+panel==1.5.4
+patsy==1.0.1
+oauthlib==3.2.2
+librosa==0.10.2.post1
+imutils==0.5.4
+xyzservices==2024.9.0
+Pygments==2.18.0
+sphinxcontrib-jsmath==1.0.1
+pyasn1_modules==0.4.1
+pyproj==3.7.0
+Pyomo==6.8.2
+nvidia-cublas-cu12==12.6.4.1
+numpy==1.26.4
+google-cloud-bigquery-storage==2.27.0
+soxr==0.5.0.post1
+bleach==6.2.0
+sympy==1.13.1
+dask==2024.10.0
+miniKanren==1.0.3
+pathlib==1.0.1
+torch==2.5.1+cu121
+distro==1.9.0
+gym==0.25.2
+lxml==5.3.0
+folium==0.18.0
+altair==4.2.2
+tifffile==2024.9.20
+diffusers==0.31.0
+requests-oauthlib==1.3.1
+google-cloud-language==2.15.1
+ptyprocess==0.7.0
+tensorboard-data-server==0.7.2
+locket==1.0.0
+intel-cmplr-lib-ur==2025.0.3
+lightgbm==4.5.0
+flax==0.8.5
+mdit-py-plugins==0.4.2
+pygame==2.6.1
+pytz==2024.2
+pyparsing==3.2.0
+alabaster==1.0.0
+jupyter_core==5.7.2
+cloudpickle==3.1.0
+logical-unification==0.4.6
+traittypes==0.2.1
+terminado==0.18.1
+beautifulsoup4==4.12.3
+google-cloud-bigquery-connection==1.16.1
+scooby==0.10.0
+google-auth-oauthlib==1.2.1
+protobuf==4.25.5
+astropy==6.1.7
+GDAL==3.6.4
+nbformat==5.10.4
+safetensors==0.4.5
+tzlocal==5.2
+chardet==5.2.0
+psutil==5.9.5
+jsonpointer==3.0.0
+psycopg2==2.9.10
+cachetools==5.5.0
+pyspark==3.5.3
+google-cloud-pubsub==2.27.1
+pillow==11.0.0
+pydantic==2.10.3
+langcodes==3.5.0
+jsonschema-specifications==2024.10.1
+markdown-it-py==3.0.0
+nltk==3.9.1
+nbconvert==7.16.4
+pooch==1.8.2
+huggingface-hub==0.26.3
+tbb==2022.0.0
+ipywidgets==7.7.1
+matplotlib-venn==1.1.1
+rmm-cu12==24.10.0
+sphinxcontrib-serializinghtml==2.0.0
+branca==0.8.0
+gin-config==0.5.0
+bqplot==0.12.43
+opentelemetry-sdk==1.28.2
+community==1.0.0b1
+soundfile==0.12.1
+shap==0.46.0
+joblib==1.4.2
+entrypoints==0.4
+docstring_parser==0.16
+multidict==6.1.0
+grpcio-status==1.62.3
+wcwidth==0.2.13
+geopy==2.4.1
+prettytable==3.12.0
+propcache==0.2.1
+ml-dtypes==0.4.1
+atpublic==4.1.0
+stringzilla==3.11.0
+libclang==18.1.1
+arviz==0.20.0
+requests==2.32.3
+fastprogress==1.0.3
+dlib==19.24.2
+platformdirs==4.3.6
+tabulate==0.9.0
+cufflinks==0.17.3
+spacy-legacy==3.0.12
+grpcio==1.68.1
+cvxpy==1.5.4
+flatbuffers==24.3.25
+pluggy==1.5.0
+regex==2024.9.11
+clarabel==0.9.0
+httplib2==0.22.0
+language_data==1.3.0
+backcall==0.2.0
+nbclient==0.10.1
+ipyleaflet==0.19.2
+PyJWT==2.10.1
+toolz==0.12.1
+opt_einsum==3.4.0
+nvtx==0.2.10
+nvidia-nccl-cu12==2.23.4
+debugpy==1.8.0
+sphinxcontrib-devhelp==2.0.0
+jax-cuda12-pjrt==0.4.33
+missingno==0.5.2
+proglog==0.1.10
+nest-asyncio==1.6.0
+nvidia-cusolver-cu12==11.7.1.2
+gspread-dataframe==3.3.1
+bigquery-magics==0.4.0
+jellyfish==1.1.2
+text-unidecode==1.3
+Deprecated==1.2.15
+srsly==2.4.8
+ipytree==0.2.2
+gcsfs==2024.10.0
+ipyevents==2.0.2
+docker-pycreds==0.4.0
+glob2==0.7
+wordcloud==1.9.4
+traitlets==5.7.1
+nbclassic==1.1.0
+nvidia-cudnn-cu12==9.6.0.74
+easydict==1.13
+httpx==0.28.0
+Jinja2==3.1.4
+argon2-cffi==23.1.0
+linkify-it-py==2.0.3
+optax==0.2.4
+cons==0.4.6
+requests-toolbelt==1.0.0
+editdistance==0.8.1
+jupyter-leaflet==0.19.2
+webcolors==24.11.1
+jax-cuda12-plugin==0.4.33
+albumentations==1.4.20
+PyOpenGL==3.1.7
+tqdm==4.66.6
+googledrivedownloader==0.4
+peft==0.13.2
+absl-py==1.4.0
+eval_type_backport==0.2.0
+opentelemetry-api==1.28.2
+Send2Trash==1.8.3
+gdown==5.2.0
+google-cloud-bigtable==2.27.0
+grpc-google-iam-v1==0.13.1
+rpds-py==0.22.3
+xgboost==2.1.3
+pyviz_comms==3.0.3
+ipykernel==5.5.6
+gym-notices==0.0.8
+opentelemetry-semantic-conventions==0.49b2
+fastcore==1.7.22
+torchvision==0.20.1+cu121
+Sphinx==8.1.3
+ply==3.11
+tensorboard==2.17.1
+namex==0.0.8
+astropy-iers-data==0.2024.12.2.0.35.34
+rpy2==3.4.2
+nvidia-nvjitlink-cu12==12.6.85
+array_record==0.5.1
+PyYAML==6.0.2
+tensorflow==2.17.1
+yellowbrick==1.5
+pylibraft-cu12==24.10.0
+orbax-checkpoint==0.6.4
+Werkzeug==3.1.3
+jupyter-console==6.1.0
+thinc==8.2.5
+etils==1.11.0
+langchain-core==0.3.21
+cmdstanpy==1.2.4
+h5netcdf==1.4.1
+cudf-cu12==24.10.1
+zipp==3.21.0
+PyDrive2==1.21.3
+kiwisolver==1.4.7
+pickleshare==0.7.5
+bokeh==3.6.2
+shellingham==1.5.4
+imageio-ffmpeg==0.5.1
+pycocotools==2.0.8
+sqlglot==25.1.0
+tensorstore==0.1.69
+argon2-cffi-bindings==21.2.0
+sentence-transformers==3.2.1
+docutils==0.21.2
+python-apt==0.0.0
+setuptools==75.1.0
+pip==24.1.2
+requirements-parser==0.9.0
+types-setuptools==75.6.0.20241126
+importlib-metadata==4.6.4
+blinker==1.4
+PyJWT==2.3.0
+PyGObject==3.42.1
+cryptography==3.4.8
+pyparsing==2.4.7
+wadllib==1.3.6
+more-itertools==8.10.0
+zipp==1.0.0
+distro==1.7.0
+six==1.16.0
+python-apt==2.4.0+ubuntu4
+jeepney==0.7.1
+SecretStorage==3.3.1
+oauthlib==3.2.0
+lazr.restfulclient==0.14.4
+httplib2==0.20.2
+launchpadlib==1.10.16
+keyring==23.5.0
+lazr.uri==1.0.6
+dbus-python==1.2.18
+inflect==7.3.1
+wheel==0.43.0
+packaging==24.1
+importlib_metadata==8.0.0
+more-itertools==10.3.0
+platformdirs==4.2.2
+backports.tarfile==1.2.0
+typing_extensions==4.12.2
+jaraco.functools==4.0.1
+jaraco.collections==5.1.0
+tomli==2.0.1
+importlib_resources==6.4.0
+jaraco.text==3.12.1
+jaraco.context==5.3.0
+typeguard==4.3.0
+autocommand==2.2.2
+zipp==3.19.2

wandb/run-20241211_042903-vt1hbdpt/files/wandb-metadata.json

@@ -0,0 +1,38 @@
+{
+  "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
+  "python": "CPython 3.10.12",
+  "startedAt": "2024-12-11T04:29:03.449972Z",
+  "program": "m2-congretimbau-focal_loss-sempartido.ipynb",
+  "email": "[email protected]",
+  "root": "/content",
+  "host": "fd55a770be24",
+  "username": "root",
+  "executable": "/usr/bin/python3",
+  "colab": "https://colab.research.google.com/notebook#fileId=1a_b6x6zKkekdeqrCzP83ovWk7MhdV3DO",
+  "cpu_count": 6,
+  "cpu_count_logical": 12,
+  "gpu": "NVIDIA A100-SXM4-40GB",
+  "gpu_count": 1,
+  "disk": {
+    "/": {
+      "total": "120942624768",
+      "used": "36614742016"
+    }
+  },
+  "memory": {
+    "total": "89632796672"
+  },
+  "cpu": {
+    "count": 6,
+    "countLogical": 12
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA A100-SXM4-40GB",
+      "memoryTotal": "42949672960",
+      "cudaCores": 6912,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.2"
+}

wandb/run-20241211_042903-vt1hbdpt/files/wandb-summary.json

@@ -0,0 +1 @@
+{"_wandb":{"runtime":4}}

wandb/run-20241211_042903-vt1hbdpt/logs/debug-core.log

@@ -0,0 +1,14 @@
+{"time":"2024-12-11T04:29:03.186536795Z","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmphfycrb2n/port-1705.txt","pid":1705,"debug":false,"disable-analytics":false}
+{"time":"2024-12-11T04:29:03.186572308Z","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
+{"time":"2024-12-11T04:29:03.191093789Z","level":"INFO","msg":"Will exit if parent process dies.","ppid":1705}
+{"time":"2024-12-11T04:29:03.19108347Z","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":33261,"Zone":""}}
+{"time":"2024-12-11T04:29:03.375152489Z","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:29:03.451090957Z","level":"INFO","msg":"handleInformInit: received","streamId":"vt1hbdpt","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:29:03.553761261Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"vt1hbdpt","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.523626016Z","level":"INFO","msg":"handleInformTeardown: server teardown initiated","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.523720479Z","level":"INFO","msg":"connection: Close: initiating connection closure","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.523896711Z","level":"INFO","msg":"connection: Close: connection successfully closed","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.523761243Z","level":"INFO","msg":"server is shutting down"}
+{"time":"2024-12-11T04:30:04.758520303Z","level":"INFO","msg":"handleInformTeardown: server shutdown complete","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.758557239Z","level":"INFO","msg":"connection: ManageConnectionData: connection closed","id":"127.0.0.1:34992"}
+{"time":"2024-12-11T04:30:04.758576834Z","level":"INFO","msg":"server is closed"}

wandb/run-20241211_042903-vt1hbdpt/logs/debug-internal.log

@@ -0,0 +1,25 @@
+{"time":"2024-12-11T04:29:03.451234822Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:29:03.451254718Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_042903-vt1hbdpt/logs/debug-core.log"}
+{"time":"2024-12-11T04:29:03.553721829Z","level":"INFO","msg":"created new stream","id":"vt1hbdpt"}
+{"time":"2024-12-11T04:29:03.55375477Z","level":"INFO","msg":"stream: started","id":"vt1hbdpt"}
+{"time":"2024-12-11T04:29:03.553784092Z","level":"INFO","msg":"writer: Do: started","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:29:03.553816218Z","level":"INFO","msg":"sender: started","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:29:03.553854616Z","level":"INFO","msg":"handler: started","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:29:04.254776028Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:29:04.735542801Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:29:04.735565431Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:29:04.735570019Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:29:04.73557386Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:29:04.735577453Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:29:04.73558085Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:29:05.371333804Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:29:05.412455486Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:29:07.712940187Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:04.523703541Z","level":"INFO","msg":"stream: closing","id":"vt1hbdpt"}
+{"time":"2024-12-11T04:30:04.523822901Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:30:04.524610231Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:30:04.727360156Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:30:04.758327151Z","level":"INFO","msg":"handler: closed","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:30:04.758371023Z","level":"INFO","msg":"writer: Close: closed","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:30:04.758408383Z","level":"INFO","msg":"sender: closed","stream_id":"vt1hbdpt"}
+{"time":"2024-12-11T04:30:04.758441234Z","level":"INFO","msg":"stream: closed","id":"vt1hbdpt"}

wandb/run-20241211_042903-vt1hbdpt/logs/debug.log

@@ -0,0 +1,42 @@
+2024-12-11 04:29:03,445 INFO    MainThread:1705 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_setup.py:_flush():68] Configure stats pid to 1705
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_042903-vt1hbdpt/logs/debug.log
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_042903-vt1hbdpt/logs/debug-internal.log
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79799d31dc60>
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:29:03,446 INFO    MainThread:1705 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+config: {}
+2024-12-11 04:29:03,447 INFO    MainThread:1705 [wandb_init.py:init():688] starting backend
+2024-12-11 04:29:03,447 INFO    MainThread:1705 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:29:03,449 INFO    MainThread:1705 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:29:03,449 INFO    MainThread:1705 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:29:03,457 INFO    MainThread:1705 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:29:04,113 INFO    MainThread:1705 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:29:04,114 INFO    MainThread:1705 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:29:04,250 INFO    MainThread:1705 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:29:04,695 INFO    MainThread:1705 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:29:04,695 INFO    MainThread:1705 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:29:04,695 INFO    MainThread:1705 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:29:04,695 INFO    MainThread:1705 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:29:04,698 INFO    MainThread:1705 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:29:04,701 INFO    MainThread:1705 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:29:04,701 INFO    MainThread:1705 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:29:04,705 INFO    MainThread:1705 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:29:04,706 INFO    MainThread:1705 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:29:04,706 INFO    MainThread:1705 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:29:04,713 INFO    MainThread:1705 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:29:04,714 INFO    MainThread:1705 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:29:04,714 INFO    MainThread:1705 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:29:04,719 INFO    MainThread:1705 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:29:05,370 INFO    MainThread:1705 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:29:05,371 INFO    MainThread:1705 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:29:05,375 INFO    MainThread:1705 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:29:05,773 INFO    MainThread:1705 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 15, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-29-04_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 48, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 24, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:29:05,777 INFO    MainThread:1705 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x797955c8e920>>
+2024-12-11 04:29:05,777 INFO    MainThread:1705 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:29:07,712 INFO    MainThread:1705 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:29:07,712 INFO    MainThread:1705 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:04,523 WARNING MsgRouterThr:1705 [router.py:message_loop():75] message_loop has been closed

wandb/run-20241211_043031-pfhjmc9v/files/config.yaml

@@ -0,0 +1,568 @@
+_attn_implementation_autoset:
+    value: true
+_name_or_path:
+    value: belisards/congretimbau
+_wandb:
+    value:
+        cli_version: 0.19.0
+        m:
+            - "1": train/global_step
+              "6":
+                - 3
+              "7": []
+            - "1": train/learning_rate
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/accuracy
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/steps_per_second
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/runtime
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/loss
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/f1
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/loss
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/grad_norm
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/epoch
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/samples_per_second
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/precision
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/recall
+              "5": 1
+              "6":
+                - 1
+                - 3
+              "7": []
+        python_version: 3.10.12
+        t:
+            "1":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "2":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "3":
+                - 2
+                - 7
+                - 13
+                - 19
+                - 23
+                - 55
+                - 62
+                - 66
+            "4": 3.10.12
+            "5": 0.19.0
+            "6": 4.47.0
+            "8":
+                - 1
+                - 5
+                - 12
+            "9":
+                "1": transformers_trainer
+            "12": 0.19.0
+            "13": linux-x86_64
+accelerator_config:
+    value:
+        dispatch_batches: null
+        even_batches: true
+        gradient_accumulation_kwargs: null
+        non_blocking: false
+        split_batches: false
+        use_seedable_sampler: true
+adafactor:
+    value: false
+adam_beta1:
+    value: 0.9
+adam_beta2:
+    value: 0.999
+adam_epsilon:
+    value: 1e-08
+add_cross_attention:
+    value: false
+architectures:
+    value:
+        - BertForMaskedLM
+attention_probs_dropout_prob:
+    value: 0.05
+auto_find_batch_size:
+    value: false
+average_tokens_across_devices:
+    value: false
+bad_words_ids:
+    value: null
+batch_eval_metrics:
+    value: false
+begin_suppress_tokens:
+    value: null
+bf16:
+    value: false
+bf16_full_eval:
+    value: false
+bos_token_id:
+    value: null
+chunk_size_feed_forward:
+    value: 0
+classifier_dropout:
+    value: null
+cross_attention_hidden_size:
+    value: null
+data_seed:
+    value: null
+dataloader_drop_last:
+    value: false
+dataloader_num_workers:
+    value: 0
+dataloader_persistent_workers:
+    value: false
+dataloader_pin_memory:
+    value: true
+dataloader_prefetch_factor:
+    value: null
+ddp_backend:
+    value: null
+ddp_broadcast_buffers:
+    value: null
+ddp_bucket_cap_mb:
+    value: null
+ddp_find_unused_parameters:
+    value: null
+ddp_timeout:
+    value: 1800
+debug:
+    value: []
+decoder_start_token_id:
+    value: null
+deepspeed:
+    value: null
+directionality:
+    value: bidi
+disable_tqdm:
+    value: false
+dispatch_batches:
+    value: null
+diversity_penalty:
+    value: 0
+do_eval:
+    value: true
+do_predict:
+    value: false
+do_sample:
+    value: false
+do_train:
+    value: false
+early_stopping:
+    value: false
+encoder_no_repeat_ngram_size:
+    value: 0
+eos_token_id:
+    value: null
+eval_accumulation_steps:
+    value: null
+eval_delay:
+    value: 0
+eval_do_concat_batches:
+    value: true
+eval_on_start:
+    value: false
+eval_steps:
+    value: 102
+eval_strategy:
+    value: epoch
+eval_use_gather_object:
+    value: false
+evaluation_strategy:
+    value: null
+exponential_decay_length_penalty:
+    value: null
+finetuning_task:
+    value: null
+forced_bos_token_id:
+    value: null
+forced_eos_token_id:
+    value: null
+fp16:
+    value: false
+fp16_backend:
+    value: auto
+fp16_full_eval:
+    value: false
+fp16_opt_level:
+    value: O1
+fsdp:
+    value: []
+fsdp_config:
+    value:
+        min_num_params: 0
+        xla: false
+        xla_fsdp_grad_ckpt: false
+        xla_fsdp_v2: false
+fsdp_min_num_params:
+    value: 0
+fsdp_transformer_layer_cls_to_wrap:
+    value: null
+full_determinism:
+    value: false
+gradient_accumulation_steps:
+    value: 1
+gradient_checkpointing:
+    value: false
+gradient_checkpointing_kwargs:
+    value: null
+greater_is_better:
+    value: true
+group_by_length:
+    value: false
+half_precision_backend:
+    value: auto
+hidden_act:
+    value: gelu
+hidden_dropout_prob:
+    value: 0.05
+hidden_size:
+    value: 1024
+hub_always_push:
+    value: false
+hub_model_id:
+    value: null
+hub_private_repo:
+    value: null
+hub_strategy:
+    value: every_save
+hub_token:
+    value: <HUB_TOKEN>
+id2label:
+    value:
+        "0": "0"
+        "1": "1"
+ignore_data_skip:
+    value: false
+include_for_metrics:
+    value: []
+include_inputs_for_metrics:
+    value: false
+include_num_input_tokens_seen:
+    value: false
+include_tokens_per_second:
+    value: false
+initializer_range:
+    value: 0.02
+intermediate_size:
+    value: 4096
+is_decoder:
+    value: false
+is_encoder_decoder:
+    value: false
+jit_mode_eval:
+    value: false
+label_names:
+    value: null
+label_smoothing_factor:
+    value: 0
+label2id:
+    value:
+        "0": 0
+        "1": 1
+layer_norm_eps:
+    value: 1e-12
+learning_rate:
+    value: 1e-05
+length_column_name:
+    value: length
+length_penalty:
+    value: 1
+load_best_model_at_end:
+    value: true
+local_rank:
+    value: 0
+log_level:
+    value: passive
+log_level_replica:
+    value: warning
+log_on_each_node:
+    value: true
+logging_dir:
+    value: ./runs/Dec11_04-30-35_fd55a770be24
+logging_first_step:
+    value: false
+logging_nan_inf_filter:
+    value: true
+logging_steps:
+    value: 10
+logging_strategy:
+    value: steps
+lr_scheduler_type:
+    value: linear
+max_grad_norm:
+    value: 1
+max_length:
+    value: 20
+max_position_embeddings:
+    value: 512
+max_steps:
+    value: -1
+metric_for_best_model:
+    value: f1
+min_length:
+    value: 0
+model/num_parameters:
+    value: 334398466
+model_type:
+    value: bert
+mp_parameters:
+    value: ""
+neftune_noise_alpha:
+    value: null
+no_cuda:
+    value: false
+no_repeat_ngram_size:
+    value: 0
+num_attention_heads:
+    value: 16
+num_beam_groups:
+    value: 1
+num_beams:
+    value: 1
+num_hidden_layers:
+    value: 24
+num_return_sequences:
+    value: 1
+num_train_epochs:
+    value: 18
+optim:
+    value: adamw_torch
+optim_args:
+    value: null
+optim_target_modules:
+    value: null
+output_attentions:
+    value: false
+output_dir:
+    value: .
+output_hidden_states:
+    value: false
+output_past:
+    value: true
+output_scores:
+    value: false
+overwrite_output_dir:
+    value: false
+pad_token_id:
+    value: 0
+past_index:
+    value: -1
+per_device_eval_batch_size:
+    value: 32
+per_device_train_batch_size:
+    value: 32
+per_gpu_eval_batch_size:
+    value: null
+per_gpu_train_batch_size:
+    value: null
+pooler_fc_size:
+    value: 768
+pooler_num_attention_heads:
+    value: 12
+pooler_num_fc_layers:
+    value: 3
+pooler_size_per_head:
+    value: 128
+pooler_type:
+    value: first_token_transform
+position_embedding_type:
+    value: absolute
+prediction_loss_only:
+    value: false
+prefix:
+    value: null
+problem_type:
+    value: null
+push_to_hub:
+    value: false
+push_to_hub_model_id:
+    value: null
+push_to_hub_organization:
+    value: null
+push_to_hub_token:
+    value: <PUSH_TO_HUB_TOKEN>
+ray_scope:
+    value: last
+remove_invalid_values:
+    value: false
+remove_unused_columns:
+    value: true
+repetition_penalty:
+    value: 1
+report_to:
+    value:
+        - wandb
+restore_callback_states_from_checkpoint:
+    value: false
+resume_from_checkpoint:
+    value: null
+return_dict:
+    value: true
+return_dict_in_generate:
+    value: false
+run_name:
+    value: m2-congretimbau_tunado
+save_on_each_node:
+    value: false
+save_only_model:
+    value: false
+save_safetensors:
+    value: true
+save_steps:
+    value: 204
+save_strategy:
+    value: epoch
+save_total_limit:
+    value: 1
+seed:
+    value: 5151
+sep_token_id:
+    value: null
+skip_memory_metrics:
+    value: true
+split_batches:
+    value: null
+suppress_tokens:
+    value: null
+task_specific_params:
+    value: null
+temperature:
+    value: 1
+tf_legacy_loss:
+    value: false
+tf32:
+    value: null
+tie_encoder_decoder:
+    value: false
+tie_word_embeddings:
+    value: true
+tokenizer_class:
+    value: null
+top_k:
+    value: 50
+top_p:
+    value: 1
+torch_compile:
+    value: false
+torch_compile_backend:
+    value: null
+torch_compile_mode:
+    value: null
+torch_dtype:
+    value: float32
+torch_empty_cache_steps:
+    value: null
+torchdynamo:
+    value: null
+torchscript:
+    value: false
+tpu_metrics_debug:
+    value: false
+tpu_num_cores:
+    value: null
+transformers_version:
+    value: 4.47.0
+type_vocab_size:
+    value: 2
+typical_p:
+    value: 1
+use_bfloat16:
+    value: false
+use_cache:
+    value: true
+use_cpu:
+    value: false
+use_ipex:
+    value: false
+use_legacy_prediction_loop:
+    value: false
+use_liger_kernel:
+    value: false
+use_mps_device:
+    value: false
+vocab_size:
+    value: 29794
+warmup_ratio:
+    value: 0
+warmup_steps:
+    value: 200
+weight_decay:
+    value: 0.02

wandb/run-20241211_043031-pfhjmc9v/files/output.log

@@ -0,0 +1,8 @@
+              precision    recall  f1-score   support
+
+           0       0.91      0.89      0.90       114
+           1       0.66      0.70      0.68        33
+
+    accuracy                           0.85       147
+   macro avg       0.78      0.80      0.79       147
+weighted avg       0.85      0.85      0.85       147

wandb/run-20241211_043031-pfhjmc9v/files/requirements.txt

@@ -0,0 +1,578 @@
+multiprocess==0.70.16
+accelerate==1.2.0
+fsspec==2024.9.0
+wandb==0.19.0
+transformers==4.47.0
+evaluate==0.4.3
+dill==0.3.8
+tokenizers==0.21.0
+datasets==3.2.0
+xxhash==3.5.0
+google-colab==1.0.0
+termcolor==2.5.0
+numexpr==2.10.2
+duckdb==1.1.3
+slicer==0.0.8
+pandas-stubs==2.2.2.240909
+yarl==1.18.3
+jupyter-client==6.1.12
+umf==0.9.1
+aiohappyeyeballs==2.4.4
+tensorflow-io-gcs-filesystem==0.37.1
+nibabel==5.3.2
+google-api-python-client==2.151.0
+gensim==4.3.3
+plotnine==0.14.3
+stanio==0.5.1
+pyogrio==0.10.0
+nvidia-curand-cu12==10.3.7.77
+Bottleneck==1.4.2
+openpyxl==3.1.5
+audioread==3.0.1
+libcudf-cu12==24.10.1
+networkx==3.4.2
+cupy-cuda12x==12.2.0
+nx-cugraph-cu12==24.10.0
+aiosignal==1.3.1
+StrEnum==0.4.15
+jsonpickle==4.0.0
+google-cloud-firestore==2.19.0
+scipy==1.13.1
+colour==0.1.5
+pycparser==2.22
+cmake==3.30.5
+fastdownload==0.0.7
+google-cloud-functions==1.18.1
+imagesize==1.4.1
+imageio==2.36.1
+frozendict==2.4.6
+ndindex==1.9.2
+html5lib==1.1
+python-louvain==0.16
+Cython==3.0.11
+fastai==2.7.18
+cuda-python==12.2.1
+parsy==2.1
+smmap==5.0.1
+weasel==0.4.1
+pyasn1==0.6.1
+matplotlib==3.8.0
+immutabledict==4.2.1
+dopamine_rl==4.0.9
+uc-micro-py==1.0.3
+websocket-client==1.8.0
+anyio==3.7.1
+msgpack==1.1.0
+multitasking==0.0.11
+albucore==0.0.19
+scikit-image==0.24.0
+setproctitle==1.3.4
+marisa-trie==1.2.1
+nvidia-cuda-nvcc-cu12==12.6.85
+sphinxcontrib-qthelp==2.0.0
+tables==3.10.1
+kaggle==1.6.17
+google-cloud-core==2.4.1
+soupsieve==2.6
+opencv-contrib-python==4.10.0.84
+python-box==7.2.0
+fonttools==4.55.1
+Markdown==3.7
+googleapis-common-protos==1.66.0
+tensorflow-metadata==1.13.1
+google-auth-httplib2==0.2.0
+autograd==1.7.0
+pydantic_core==2.27.1
+pexpect==4.9.0
+tweepy==4.14.0
+pyshp==2.3.1
+sklearn-pandas==2.2.0
+toml==0.10.2
+pydotplus==2.0.2
+click==8.1.7
+optree==0.13.1
+catalogue==2.0.10
+google-api-core==2.19.2
+en-core-web-sm==3.7.1
+tensorflow-datasets==4.9.7
+pynvjitlink-cu12==0.4.0
+pytest==8.3.4
+portpicker==1.5.2
+dm-tree==0.1.8
+h5py==3.12.1
+pandas-gbq==0.24.0
+qdldl==0.1.7.post4
+partd==1.4.2
+wrapt==1.17.0
+blis==0.7.11
+textblob==0.17.1
+jupyterlab_widgets==3.0.13
+filelock==3.16.1
+oauth2client==4.1.3
+iniconfig==2.0.0
+notebook==6.5.5
+pydot==3.0.3
+tomli==2.2.1
+py4j==0.10.9.7
+langchain-text-splitters==0.3.2
+typer==0.15.0
+contourpy==1.3.1
+aiohttp==3.11.9
+langchain==0.3.9
+datascience==0.17.6
+etuples==0.3.9
+six==1.16.0
+tornado==6.3.3
+torchaudio==2.5.1+cu121
+httpcore==1.0.7
+importlib_metadata==8.5.0
+holoviews==1.20.0
+google-ai-generativelanguage==0.6.10
+osqp==0.6.7.post3
+pymc==5.18.2
+google-pasta==0.2.0
+py-cpuinfo==9.0.0
+colorcet==3.1.0
+blosc2==2.7.1
+nvidia-cuda-cupti-cu12==12.6.80
+colorlover==0.3.0
+pymystem3==0.2.0
+MarkupSafe==3.0.2
+astunparse==1.6.3
+google-cloud-bigquery==3.25.0
+opencv-python==4.10.0.84
+Flask==3.0.3
+fastjsonschema==2.21.1
+pylibcugraph-cu12==24.10.0
+google-cloud-datastore==2.20.1
+jaxlib==0.4.33
+rich==13.9.4
+widgetsnbextension==3.6.10
+vega-datasets==0.9.0
+natsort==8.4.0
+blinker==1.9.0
+statsmodels==0.14.4
+sniffio==1.3.1
+cymem==2.0.10
+threadpoolctl==3.5.0
+proto-plus==1.25.0
+httpimport==1.4.0
+matplotlib-inline==0.1.7
+ratelim==0.1.6
+python-utils==3.9.1
+prompt_toolkit==3.0.48
+gspread==6.0.2
+google-cloud-storage==2.8.0
+PyDrive==1.3.1
+tensorflow-probability==0.24.0
+xarray==2024.10.0
+eerepr==0.0.4
+murmurhash==1.0.11
+pylibcudf-cu12==24.10.1
+music21==9.3.0
+geographiclib==2.0
+smart-open==7.0.5
+pygit2==1.16.0
+more-itertools==10.5.0
+cycler==0.12.1
+idna==3.10
+h11==0.14.0
+ipython-genutils==0.2.0
+referencing==0.35.1
+GitPython==3.1.43
+sentencepiece==0.2.0
+CacheControl==0.14.1
+tf_keras==2.17.0
+annotated-types==0.7.0
+ecos==2.0.14
+geopandas==1.0.1
+jieba==0.42.1
+shapely==2.0.6
+ipyparallel==8.8.0
+pyOpenSSL==24.2.1
+pyarrow==17.0.0
+opencv-python-headless==4.10.0.84
+openai==1.54.5
+sentry-sdk==2.19.0
+pyarrow-hotfix==0.6
+gitdb==4.0.11
+prophet==1.1.6
+ipython-sql==0.5.0
+tf-slim==1.1.0
+PySocks==1.7.1
+imbalanced-learn==0.12.4
+mlxtend==0.23.3
+mkl==2025.0.1
+itsdangerous==2.2.0
+gast==0.6.0
+torchsummary==1.5.1
+urllib3==2.2.3
+earthengine-api==1.2.0
+jupyter-server==1.24.0
+webencodings==0.5.1
+seaborn==0.13.2
+SQLAlchemy==2.0.36
+pyerfa==2.0.1.5
+xarray-einstats==0.8.0
+jsonschema==4.23.0
+parso==0.8.4
+tensorflow-hub==0.16.1
+ipyfilechooser==0.6.0
+packaging==24.2
+param==2.1.1
+et_xmlfile==2.0.0
+kagglehub==0.3.4
+yfinance==0.2.50
+spacy==3.7.5
+imgaug==0.4.0
+sqlparse==0.5.2
+certifi==2024.8.30
+plotly==5.24.1
+pandas-datareader==0.10.0
+charset-normalizer==3.4.0
+cloudpathlib==0.20.0
+decorator==4.4.2
+prometheus_client==0.21.1
+google-auth==2.27.0
+pyzmq==24.0.1
+tzdata==2024.2
+scs==3.2.7
+types-pytz==2024.2.0.20241003
+db-dtypes==1.3.1
+chex==0.1.87
+spacy-loggers==1.0.5
+peewee==3.17.8
+nvidia-cuda-runtime-cu12==12.6.77
+ibis-framework==9.2.0
+wasabi==1.1.3
+python-dateutil==2.8.2
+google-generativeai==0.8.3
+google-cloud-aiplatform==1.73.0
+jupyterlab_pygments==0.3.0
+google-cloud-translate==3.17.0
+exceptiongroup==1.2.2
+intel-openmp==2025.0.3
+nvidia-cufft-cu12==11.3.0.4
+timm==1.0.12
+python-slugify==8.0.4
+cryptography==43.0.3
+multipledispatch==1.0.0
+google-crc32c==1.6.0
+rsa==4.9
+cffi==1.17.1
+holidays==0.62
+tinycss2==1.4.0
+google-cloud-iam==2.16.1
+google-cloud-resource-manager==1.13.1
+typeguard==4.4.1
+xlrd==2.0.1
+google==2.0.3
+pandocfilters==1.5.1
+promise==2.3
+progressbar2==4.5.0
+wheel==0.45.1
+google-resumable-media==2.7.2
+einops==0.8.0
+defusedxml==0.7.1
+llvmlite==0.43.0
+attrs==24.2.0
+preshed==3.0.9
+geocoder==1.38.1
+firebase-admin==6.5.0
+ipython==7.34.0
+cvxopt==1.3.2
+greenlet==3.1.1
+confection==0.1.5
+keras==3.5.0
+pandas==2.2.2
+graphviz==0.20.3
+tenacity==9.0.0
+future==1.0.0
+inflect==7.4.0
+langsmith==0.1.147
+babel==2.16.0
+nvidia-cusparse-cu12==12.5.4.2
+importlib_resources==6.4.5
+jiter==0.8.0
+sphinxcontrib-htmlhelp==2.1.0
+moviepy==1.0.3
+typing_extensions==4.12.2
+tcmlib==1.2.0
+snowballstemmer==2.2.0
+scikit-learn==1.5.2
+jsonpatch==1.33
+notebook_shim==0.2.4
+mizani==0.13.0
+simple-parsing==0.1.6
+humanize==4.11.0
+hyperopt==0.2.7
+frozenlist==1.5.0
+uritemplate==4.1.1
+pydata-google-auth==1.9.0
+pyperclip==1.9.0
+lazy_loader==0.4
+bigframes==1.27.0
+numba==0.60.0
+pytensor==2.26.4
+geemap==0.35.1
+polars==1.9.0
+orjson==3.10.12
+fastrlock==0.8.2
+mistune==3.0.2
+sphinxcontrib-applehelp==2.0.0
+mpmath==1.3.0
+mdurl==0.1.2
+async-timeout==4.0.3
+jax==0.4.33
+panel==1.5.4
+patsy==1.0.1
+oauthlib==3.2.2
+librosa==0.10.2.post1
+imutils==0.5.4
+xyzservices==2024.9.0
+Pygments==2.18.0
+sphinxcontrib-jsmath==1.0.1
+pyasn1_modules==0.4.1
+pyproj==3.7.0
+Pyomo==6.8.2
+nvidia-cublas-cu12==12.6.4.1
+numpy==1.26.4
+google-cloud-bigquery-storage==2.27.0
+soxr==0.5.0.post1
+bleach==6.2.0
+sympy==1.13.1
+dask==2024.10.0
+miniKanren==1.0.3
+pathlib==1.0.1
+torch==2.5.1+cu121
+distro==1.9.0
+gym==0.25.2
+lxml==5.3.0
+folium==0.18.0
+altair==4.2.2
+tifffile==2024.9.20
+diffusers==0.31.0
+requests-oauthlib==1.3.1
+google-cloud-language==2.15.1
+ptyprocess==0.7.0
+tensorboard-data-server==0.7.2
+locket==1.0.0
+intel-cmplr-lib-ur==2025.0.3
+lightgbm==4.5.0
+flax==0.8.5
+mdit-py-plugins==0.4.2
+pygame==2.6.1
+pytz==2024.2
+pyparsing==3.2.0
+alabaster==1.0.0
+jupyter_core==5.7.2
+cloudpickle==3.1.0
+logical-unification==0.4.6
+traittypes==0.2.1
+terminado==0.18.1
+beautifulsoup4==4.12.3
+google-cloud-bigquery-connection==1.16.1
+scooby==0.10.0
+google-auth-oauthlib==1.2.1
+protobuf==4.25.5
+astropy==6.1.7
+GDAL==3.6.4
+nbformat==5.10.4
+safetensors==0.4.5
+tzlocal==5.2
+chardet==5.2.0
+psutil==5.9.5
+jsonpointer==3.0.0
+psycopg2==2.9.10
+cachetools==5.5.0
+pyspark==3.5.3
+google-cloud-pubsub==2.27.1
+pillow==11.0.0
+pydantic==2.10.3
+langcodes==3.5.0
+jsonschema-specifications==2024.10.1
+markdown-it-py==3.0.0
+nltk==3.9.1
+nbconvert==7.16.4
+pooch==1.8.2
+huggingface-hub==0.26.3
+tbb==2022.0.0
+ipywidgets==7.7.1
+matplotlib-venn==1.1.1
+rmm-cu12==24.10.0
+sphinxcontrib-serializinghtml==2.0.0
+branca==0.8.0
+gin-config==0.5.0
+bqplot==0.12.43
+opentelemetry-sdk==1.28.2
+community==1.0.0b1
+soundfile==0.12.1
+shap==0.46.0
+joblib==1.4.2
+entrypoints==0.4
+docstring_parser==0.16
+multidict==6.1.0
+grpcio-status==1.62.3
+wcwidth==0.2.13
+geopy==2.4.1
+prettytable==3.12.0
+propcache==0.2.1
+ml-dtypes==0.4.1
+atpublic==4.1.0
+stringzilla==3.11.0
+libclang==18.1.1
+arviz==0.20.0
+requests==2.32.3
+fastprogress==1.0.3
+dlib==19.24.2
+platformdirs==4.3.6
+tabulate==0.9.0
+cufflinks==0.17.3
+spacy-legacy==3.0.12
+grpcio==1.68.1
+cvxpy==1.5.4
+flatbuffers==24.3.25
+pluggy==1.5.0
+regex==2024.9.11
+clarabel==0.9.0
+httplib2==0.22.0
+language_data==1.3.0
+backcall==0.2.0
+nbclient==0.10.1
+ipyleaflet==0.19.2
+PyJWT==2.10.1
+toolz==0.12.1
+opt_einsum==3.4.0
+nvtx==0.2.10
+nvidia-nccl-cu12==2.23.4
+debugpy==1.8.0
+sphinxcontrib-devhelp==2.0.0
+jax-cuda12-pjrt==0.4.33
+missingno==0.5.2
+proglog==0.1.10
+nest-asyncio==1.6.0
+nvidia-cusolver-cu12==11.7.1.2
+gspread-dataframe==3.3.1
+bigquery-magics==0.4.0
+jellyfish==1.1.2
+text-unidecode==1.3
+Deprecated==1.2.15
+srsly==2.4.8
+ipytree==0.2.2
+gcsfs==2024.10.0
+ipyevents==2.0.2
+docker-pycreds==0.4.0
+glob2==0.7
+wordcloud==1.9.4
+traitlets==5.7.1
+nbclassic==1.1.0
+nvidia-cudnn-cu12==9.6.0.74
+easydict==1.13
+httpx==0.28.0
+Jinja2==3.1.4
+argon2-cffi==23.1.0
+linkify-it-py==2.0.3
+optax==0.2.4
+cons==0.4.6
+requests-toolbelt==1.0.0
+editdistance==0.8.1
+jupyter-leaflet==0.19.2
+webcolors==24.11.1
+jax-cuda12-plugin==0.4.33
+albumentations==1.4.20
+PyOpenGL==3.1.7
+tqdm==4.66.6
+googledrivedownloader==0.4
+peft==0.13.2
+absl-py==1.4.0
+eval_type_backport==0.2.0
+opentelemetry-api==1.28.2
+Send2Trash==1.8.3
+gdown==5.2.0
+google-cloud-bigtable==2.27.0
+grpc-google-iam-v1==0.13.1
+rpds-py==0.22.3
+xgboost==2.1.3
+pyviz_comms==3.0.3
+ipykernel==5.5.6
+gym-notices==0.0.8
+opentelemetry-semantic-conventions==0.49b2
+fastcore==1.7.22
+torchvision==0.20.1+cu121
+Sphinx==8.1.3
+ply==3.11
+tensorboard==2.17.1
+namex==0.0.8
+astropy-iers-data==0.2024.12.2.0.35.34
+rpy2==3.4.2
+nvidia-nvjitlink-cu12==12.6.85
+array_record==0.5.1
+PyYAML==6.0.2
+tensorflow==2.17.1
+yellowbrick==1.5
+pylibraft-cu12==24.10.0
+orbax-checkpoint==0.6.4
+Werkzeug==3.1.3
+jupyter-console==6.1.0
+thinc==8.2.5
+etils==1.11.0
+langchain-core==0.3.21
+cmdstanpy==1.2.4
+h5netcdf==1.4.1
+cudf-cu12==24.10.1
+zipp==3.21.0
+PyDrive2==1.21.3
+kiwisolver==1.4.7
+pickleshare==0.7.5
+bokeh==3.6.2
+shellingham==1.5.4
+imageio-ffmpeg==0.5.1
+pycocotools==2.0.8
+sqlglot==25.1.0
+tensorstore==0.1.69
+argon2-cffi-bindings==21.2.0
+sentence-transformers==3.2.1
+docutils==0.21.2
+python-apt==0.0.0
+setuptools==75.1.0
+pip==24.1.2
+requirements-parser==0.9.0
+types-setuptools==75.6.0.20241126
+importlib-metadata==4.6.4
+blinker==1.4
+PyJWT==2.3.0
+PyGObject==3.42.1
+cryptography==3.4.8
+pyparsing==2.4.7
+wadllib==1.3.6
+more-itertools==8.10.0
+zipp==1.0.0
+distro==1.7.0
+six==1.16.0
+python-apt==2.4.0+ubuntu4
+jeepney==0.7.1
+SecretStorage==3.3.1
+oauthlib==3.2.0
+lazr.restfulclient==0.14.4
+httplib2==0.20.2
+launchpadlib==1.10.16
+keyring==23.5.0
+lazr.uri==1.0.6
+dbus-python==1.2.18
+inflect==7.3.1
+wheel==0.43.0
+packaging==24.1
+importlib_metadata==8.0.0
+more-itertools==10.3.0
+platformdirs==4.2.2
+backports.tarfile==1.2.0
+typing_extensions==4.12.2
+jaraco.functools==4.0.1
+jaraco.collections==5.1.0
+tomli==2.0.1
+importlib_resources==6.4.0
+jaraco.text==3.12.1
+jaraco.context==5.3.0
+typeguard==4.3.0
+autocommand==2.2.2
+zipp==3.19.2

wandb/run-20241211_043031-pfhjmc9v/files/wandb-metadata.json

@@ -0,0 +1,38 @@
+{
+  "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
+  "python": "CPython 3.10.12",
+  "startedAt": "2024-12-11T04:30:31.644444Z",
+  "program": "m2-congretimbau-focal_loss-sempartido.ipynb",
+  "email": "[email protected]",
+  "root": "/content",
+  "host": "fd55a770be24",
+  "username": "root",
+  "executable": "/usr/bin/python3",
+  "colab": "https://colab.research.google.com/notebook#fileId=1a_b6x6zKkekdeqrCzP83ovWk7MhdV3DO",
+  "cpu_count": 6,
+  "cpu_count_logical": 12,
+  "gpu": "NVIDIA A100-SXM4-40GB",
+  "gpu_count": 1,
+  "disk": {
+    "/": {
+      "total": "120942624768",
+      "used": "36615233536"
+    }
+  },
+  "memory": {
+    "total": "89632796672"
+  },
+  "cpu": {
+    "count": 6,
+    "countLogical": 12
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA A100-SXM4-40GB",
+      "memoryTotal": "42949672960",
+      "cudaCores": 6912,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.2"
+}

wandb/run-20241211_043031-pfhjmc9v/files/wandb-summary.json

@@ -0,0 +1 @@
+{"train_samples_per_second":52.456,"_step":41,"eval/f1":0.7895627277459656,"train/loss":0.0067,"train_loss":0.08594005133897539,"train/global_step":315,"train/epoch":9,"train/learning_rate":7.44186046511628e-06,"eval/recall":0.79585326953748,"train/grad_norm":0.3785024583339691,"eval/accuracy":0.8503401360544217,"_timestamp":1.7338918220029504e+09,"train_runtime":383.9768,"eval/samples_per_second":104.597,"eval/runtime":1.4054,"_wandb":{"runtime":393},"train_steps_per_second":1.641,"eval/loss":0.1075880378484726,"eval/precision":0.7839285714285714,"eval/steps_per_second":3.558,"total_flos":4.03282376409528e+15,"_runtime":390.313178795}

wandb/run-20241211_043031-pfhjmc9v/logs/debug-core.log

@@ -0,0 +1,9 @@
+{"time":"2024-12-11T04:30:31.400373612Z","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmpvhcya0ch/port-2341.txt","pid":2341,"debug":false,"disable-analytics":false}
+{"time":"2024-12-11T04:30:31.40040802Z","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
+{"time":"2024-12-11T04:30:31.406301911Z","level":"INFO","msg":"Will exit if parent process dies.","ppid":2341}
+{"time":"2024-12-11T04:30:31.406260591Z","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":40057,"Zone":""}}
+{"time":"2024-12-11T04:30:31.589054926Z","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:50024"}
+{"time":"2024-12-11T04:30:31.645539858Z","level":"INFO","msg":"handleInformInit: received","streamId":"pfhjmc9v","id":"127.0.0.1:50024"}
+{"time":"2024-12-11T04:30:31.748169115Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"pfhjmc9v","id":"127.0.0.1:50024"}
+{"time":"2024-12-11T04:37:06.688042547Z","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"pfhjmc9v","id":"127.0.0.1:50024"}
+{"time":"2024-12-11T04:37:06.688190655Z","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"pfhjmc9v","id":"127.0.0.1:50024"}

wandb/run-20241211_043031-pfhjmc9v/logs/debug-internal.log

@@ -0,0 +1,41 @@
+{"time":"2024-12-11T04:30:31.64567442Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:30:31.645694977Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_043031-pfhjmc9v/logs/debug-core.log"}
+{"time":"2024-12-11T04:30:31.748128189Z","level":"INFO","msg":"created new stream","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748162278Z","level":"INFO","msg":"stream: started","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748191334Z","level":"INFO","msg":"writer: Do: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748217805Z","level":"INFO","msg":"handler: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:31.748239576Z","level":"INFO","msg":"sender: started","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:30:34.483159987Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:30:35.046627667Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046662301Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.046670624Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046676728Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.046682641Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.046688398Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:30:35.626440922Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:30:35.667423399Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:00.589693882Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:00.594358479Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.005522092Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.010541772Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.011288477Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.017364808Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.171915316Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.177365784Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:02.180571775Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:02.185372366Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.365253262Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.372555953Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.373998802Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.379408244Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.3922832Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:37:05.396859255Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:37:05.398980138Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:37:05.399571058Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:37:05.608796436Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:37:05.673605445Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-11T04:37:06.688087405Z","level":"INFO","msg":"stream: closing","id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.68810837Z","level":"INFO","msg":"handler: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688117223Z","level":"INFO","msg":"writer: Close: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688143843Z","level":"INFO","msg":"sender: closed","stream_id":"pfhjmc9v"}
+{"time":"2024-12-11T04:37:06.688182944Z","level":"INFO","msg":"stream: closed","id":"pfhjmc9v"}

wandb/run-20241211_043031-pfhjmc9v/logs/debug.log

@@ -0,0 +1,73 @@
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Configure stats pid to 2341
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_043031-pfhjmc9v/logs/debug.log
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_043031-pfhjmc9v/logs/debug-internal.log
+2024-12-11 04:30:31,640 INFO    MainThread:2341 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7de625ba39d0>
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+config: {}
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():688] starting backend
+2024-12-11 04:30:31,641 INFO    MainThread:2341 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:30:31,643 INFO    MainThread:2341 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:30:31,644 INFO    MainThread:2341 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:30:31,652 INFO    MainThread:2341 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:30:34,399 INFO    MainThread:2341 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:30:34,399 INFO    MainThread:2341 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:30:34,477 INFO    MainThread:2341 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:30:35,007 INFO    MainThread:2341 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:30:35,009 INFO    MainThread:2341 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:30:35,013 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,013 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,019 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,020 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,020 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,028 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,029 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,030 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,037 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:35,626 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:30:35,626 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:30:35,630 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:30:36,007 INFO    MainThread:2341 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 32, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 18, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-30-35_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 204, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 102, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:30:36,011 INFO    MainThread:2341 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7de6143df1c0>>
+2024-12-11 04:30:36,011 INFO    MainThread:2341 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:37:00,589 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:00,589 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:00,594 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,005 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,005 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,010 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,010 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,011 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,017 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,171 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,171 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,177 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:02,180 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:02,180 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:02,184 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,364 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,364 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,372 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,373 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,373 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,379 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,392 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,392 INFO    MainThread:2341 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:37:05,396 INFO    MainThread:2341 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/pfhjmc9v
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-11 04:37:05,397 INFO    MainThread:2341 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-11 04:37:05,398 INFO    MainThread:2341 [wandb_run.py:_restore():2390] restore
+2024-12-11 04:37:05,398 INFO    MainThread:2341 [wandb_run.py:_restore():2396] restore done
+2024-12-11 04:37:06,676 INFO    MainThread:2341 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-11 04:37:06,677 INFO    MainThread:2341 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-11 04:37:06,685 INFO    MainThread:2341 [wandb_run.py:_footer_sync_info():3912] logging synced files