gap-text2sql-main/mrat-sql-gap/inference-results/T5-v1_1-large-FIT-en-150Ksteps-train/T5-v1_1-large-NoGAP-150Ksteps-FIT-en_One-en-eval_exec-results.txt

Date= qua 09 mar 2022 19:43:44 -03
Folder=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap
SubFolder=iedir/T5-v1_1-large-NoGAP-150Ksteps-FIT-en
Gold File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/T5-v1_1-large-NoGAP-150Ksteps-FIT-en/gold.txt
Predict File=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/T5-v1_1-large-NoGAP-150Ksteps-FIT-en/T5-v1_1-large-NoGAP-150Ksteps-FIT-en-train_en-eval_1_true_1-step-step.txt
Database=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-en/database
Type=exec
Command example:
python3 evaluation.py --gold=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/T5-v1_1-large-NoGAP-150Ksteps-FIT-en/gold.txt --pred=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/ie_dirs/T5-v1_1-large-NoGAP-150Ksteps-FIT-en/T5-v1_1-large-NoGAP-150Ksteps-FIT-en-train_en-eval_1_true_1-step150300.txt --db=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-en/database --table=/mnt/Files/nl2sql/gap-text2sql/rat-sql-gap/data/spider-en/tables.json --etype exec --plug_value
===================== EXECUTION ACCURACY =====================
. . . count 248 446 174 166 1034
Train Infer Checkpoint Type Easy Medium Hard Extra All
T5-v1_1-large-NoGAP-150Ksteps-FIT-en One-en-eval 150300 execution 0.883 0.556 0.489 0.229 0.571