TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: there is a spanish restaurant called piperade.
Original Reference: do you want to try piperade, its spanish food.

SOLUTION: 1

PROBLEM: System Reference: what area are you looking for?
Original Reference: what area would you be looking for?.

SOLUTION: 0

PROBLEM: System Reference: mochica, is in the hayes valley or financial district south call 4152780480.
Original Reference: mochica is located in hayes valley or financial district south, the phone number is 4152780480.

SOLUTION:
1

