File size: 1,757 Bytes
d758c99 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
Date= qui 23 set 2021 10:25:20 -03 Folder=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap SubFolder=iedir/mT5-large-NoGAP-en-pt-es-fr-train Gold File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/gold-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval.txt Predict File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/predict-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval_1_true_1-step-step.txt Database=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/database Type=match Command example: python3 evaluation.py --gold=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/gold-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval.txt --pred=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/predict-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval_1_true_1-step51300.txt --db=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/database --table=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/tables.json --etype match --plug_value ====================== EXACT MATCHING ACCURACY ===================== . . . . count 248 446 174 166 1034 Train Infer Checkpoint Type Type Easy Medium Hard Extra All mT5-large-NoGAP-en-pt-es-fr-train fr-eval 42100 exact match 0.843 0.713 0.523 0.446 0.669 mT5-large-NoGAP-en-pt-es-fr-train fr-eval 49100 exact match 0.827 0.706 0.511 0.458 0.662 mT5-large-NoGAP-en-pt-es-fr-train fr-eval 50100 exact match 0.847 0.709 0.534 0.458 0.672 mT5-large-NoGAP-en-pt-es-fr-train fr-eval 51100 exact match 0.839 0.713 0.517 0.440 0.666 mT5-large-NoGAP-en-pt-es-fr-train fr-eval 51300 exact match 0.835 0.717 0.534 0.428 0.668 |