TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: may i ask near where?
Original Reference: sorry in which area do you want a hotel?.

SOLUTION: 0

PROBLEM: System Reference: what price range are you comfortable with?
Original Reference: what price range would you like this restaurant to be?.

SOLUTION: 0

PROBLEM: System Reference: x is a chinese restaurant in x, near x.
Original Reference: x is a restaurant in x near x providing chinese food.

SOLUTION:
1

