gap-text2sql-main/mrat-sql-gap/inference-results/mT5-large-en-pt-es-fr-51Ksteps-train/mT5-large-NoGAP-en-pt-es-fr-train_fr-eval_match-results.txt

Date= qui 23 set 2021 10:25:20 -03
Folder=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap
SubFolder=iedir/mT5-large-NoGAP-en-pt-es-fr-train
Gold File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/gold-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval.txt
Predict File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/predict-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval_1_true_1-step-step.txt
Database=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/database
Type=match
Command example:
python3 evaluation.py --gold=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/gold-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval.txt --pred=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/mT5-large-NoGAP-en-pt-es-fr-train/divided/predict-fr_mT5-large-NoGAP-en-pt-es-fr-train_en-pt-es-fr-eval_1_true_1-step51300.txt --db=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/database --table=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-fr/tables.json --etype match --plug_value
====================== EXACT MATCHING ACCURACY =====================
. . . . count 248 446 174 166 1034
Train Infer Checkpoint Type Type Easy Medium Hard Extra All
mT5-large-NoGAP-en-pt-es-fr-train fr-eval 42100 exact match 0.843 0.713 0.523 0.446 0.669
mT5-large-NoGAP-en-pt-es-fr-train fr-eval 49100 exact match 0.827 0.706 0.511 0.458 0.662
mT5-large-NoGAP-en-pt-es-fr-train fr-eval 50100 exact match 0.847 0.709 0.534 0.458 0.672
mT5-large-NoGAP-en-pt-es-fr-train fr-eval 51100 exact match 0.839 0.713 0.517 0.440 0.666
mT5-large-NoGAP-en-pt-es-fr-train fr-eval 51300 exact match 0.835 0.717 0.534 0.428 0.668