pretrained model: tapas_masklm_id_3.0, accuracy: 42.629% on epoch 41

pretrained model: tapas_masklm_id_5.0, accuracy: 42.032% on epoch 18

pretrained model: tapas_masklm_id_1.0, accuracy: 28.685% on epoch 5

pretrained model: tapas_masklm_id_4.0, accuracy: 40.438% on epoch 21

pretrained model: tapas_masklm_id_5.0, accuracy: 36.653% on epoch 31

pretrained model: tapas_masklm_id_4.0, accuracy: 35.259% on epoch 55

pretrained model: tapas_masklm_id_1.0, accuracy: 33.865% on epoch 56

pretrained model: tapas_masklm_id_2.0, accuracy: 33.068% on epoch 19

pretrained model: tapas_masklm_id_1.0, accuracy: 32.072% on epoch 29

pretrained model: tapas_masklm_id_2.0, accuracy: 36.454% on epoch 17

pretrained model: tapas_masklm_id_1.0, accuracy: 34.263% on epoch 16