TASK DEFINITION: In this task, you will be shown a conversation and a question. You should categorize the question into matching, summary, logic, arithmetic and, commonsense groups. Matching is a question entailed or paraphrased by exactly one sentence in a dialogue. The answer can be extracted from the same sentence. Questions that cannot be answered by the surface meaning of a single sentence belong to the reasoning category. We further define summary, logic, arithmetic and, commonsense subcategories. Answering summary questions requires the whole picture of dialogue, such as the topic of dialogue and the relation between speakers. We require logical reasoning to answer logical questions. in arithmetic questions Inferring the answer requires arithmetic knowledge. To answer commonsense questions, besides the textual information in the dialogue, we also require additional commonsense knowledge that cannot be obtained from the dialogue. Note that a question can be in more than one group. "W" and "M" in the conversations stand for "woman" and "man".
PROBLEM: M: So, what's your plan for this weekend? W: I just want to stay at home. M: How about going to see a movie? W: Sorry, I've been tired these days. I just want to have a good rest. M: But I think going to movies is a better way to relax yourself. W: You're probably right. M: Maybe we should go out to eat first. W: Yeah. I think so. M: I know pizza's been your favorite. Let's meet at Summer Pizza House. I heard they just came out with the new pizza. W: Really? I haven't been there for a long time. When shall we meet? M: Well, the movie is at 2:00 pm and 4:00 pm. W: Why don't we go to the 2:00 pm show? M: No problem. We can meet at Summer Pizza House at 11:00 am. W: Perfect. If so, we can have plenty of time to enjoy our pizza., Question: When will the two speakers meet? (A) At 11:00 am. (B) At 2:00 pm. (C) At 4:00 pm.

SOLUTION: matching

PROBLEM: M: You're not looking too good. Are you sure you are all right? W: It was a long flight. I'll be fine after a good night's sleep. M: You look very pale. W: These long flights are just so boring, and you just have to sit there in your seat without moving and you know I like to get as much exercise as possible. I'm sure I'll be back to normal tomorrow., Question: Where does the conversation take place? (A) At a hospital. (B) At an airport. (C) At school.

SOLUTION: commonsense

PROBLEM: W: I'm really angry at John. He never listens to me. M: Take it easy, Alen. Things will work out., Question: What does the man advise Alen to do? (A) Go out to work. (B) Listen carefully to John. (C) Be calm and patient.

SOLUTION:
commonsense

