TASK DEFINITION: In this task, you will be shown a conversation and a question. You should categorize the question into matching, summary, logic, arithmetic and, commonsense groups. Matching is a question entailed or paraphrased by exactly one sentence in a dialogue. The answer can be extracted from the same sentence. Questions that cannot be answered by the surface meaning of a single sentence belong to the reasoning category. We further define summary, logic, arithmetic and, commonsense subcategories. Answering summary questions requires the whole picture of dialogue, such as the topic of dialogue and the relation between speakers. We require logical reasoning to answer logical questions. in arithmetic questions Inferring the answer requires arithmetic knowledge. To answer commonsense questions, besides the textual information in the dialogue, we also require additional commonsense knowledge that cannot be obtained from the dialogue. Note that a question can be in more than one group. "W" and "M" in the conversations stand for "woman" and "man".
PROBLEM: W: What are you doing up there? M: I'm getting dressed. W: Well, hurry up. We're already late. M: OK. OK. Just a minute. By the away, Susan, where is my red tie? W: It's on the dresser next to the jewelry box. M: Oh, yes. I've got it. Thanks. And do you know where my watch is? W: Isn't it on the top drawer on the right? M: No, it's not there. W: Well. I don't know where it is. M: What time is it now? W: It's 6:45. M: And when does the play start? W: At 8:00 sharp. M: All right, I'm coming... Well, what are you waiting for?, Question: Where is the man's red tie? (A) In the jewelry box. (B) In the shop drawer. (C) On the dresser next to the jewelry box.

SOLUTION: logic

PROBLEM: W: Good morning, sir. May I help you? M: Yes, would you please find a room for our business meeting? W: Certainly, sir. How many people do you have? M: Well, about 10. W: Fine. We have a conference room which can seat up to 20 people. M: That's great. What about the charge? W: It is 90 RMB per hour. There is no minimum charge. Do you want to book it? M: Yes, I think so. W: May I have your name and room number, please, sir? M: Mr. Black, Room 1208. W: Thank you, Mr. Black. How long will you be using the conference room? M: We'll start at 10 o'clock tomorrow morning but I'm not sure when we'll finish. W: No problem, Mr. Black. The room will be at your disposal then., Question: What's the probable relationship between the two speakers? (A) Clerk and guest. (B) Shop assistant and customer. (C) Employer and employee.

SOLUTION: commonsense

PROBLEM: M: I hear you drive a long way to work every day. W: Oh, yes. It's about sixty miles. But it doesn't seem that far, the road is not bad, and there's not much traffic., Question: How does the woman feel about driving to work? (A) She is tired of driving in heavy traffic. (B) She doesn't mind it as the road conditions are good. (C) She is unhappy to have to drive such along way every day.

SOLUTION:
commonsense

