TASK DEFINITION: In this task, you will be shown a conversation and a question. You should categorize the question into matching, summary, logic, arithmetic and, commonsense groups. Matching is a question entailed or paraphrased by exactly one sentence in a dialogue. The answer can be extracted from the same sentence. Questions that cannot be answered by the surface meaning of a single sentence belong to the reasoning category. We further define summary, logic, arithmetic and, commonsense subcategories. Answering summary questions requires the whole picture of dialogue, such as the topic of dialogue and the relation between speakers. We require logical reasoning to answer logical questions. in arithmetic questions Inferring the answer requires arithmetic knowledge. To answer commonsense questions, besides the textual information in the dialogue, we also require additional commonsense knowledge that cannot be obtained from the dialogue. Note that a question can be in more than one group. "W" and "M" in the conversations stand for "woman" and "man".
PROBLEM: W: Okay, Mr. Taylor, let's go ahead and begin. First of all, tell me about your last job. M: Well, I worked for five years at Hi Tech Computers. W: Okay. Hi Tech. How about your website authoring skills? Oh. We are looking for someone to create and manage our company's website. M: Umm... uh, website, website. Huh... I don't think I've read that book. W: Huh?! And what about the experience with making a flash? M: Well... I think sometimes computers flash.., if that's what you mean. W: Okay, Mr. Taylor, I think I have all the information I need! M: Oh, and I really like computer games. I play them every day. W: Right, right. Thanks, Mr. Taylor. We'll be in touch., Question: For what is Mr. Taylor talking to the woman? (A) To ask for a job. (B) To ask her to make a website. (C) To invite her to play games.

SOLUTION: commonsense

PROBLEM: Carl: Hi. My name's Carl. Nice to meet you. Pancho: Nice to meet you, too. My name is Francisco. Carl: What? Pancho: Francisco, but all my friends and family back in Peru call me Pancho. Carl: Okay, Pancho. So, tell me about your family? Pancho: Well, I have seven brothers and six sisters. Carl: Wow. That is a big family. So are you the oldest, Pancho? Pancho: No. I'm the second oldest in my family. Carl: So, what do your parents do? Pancho: My father is a taxi driver in Lima, Peru. It's a hard job, but he works hard to support the family. Carl: How about your mother? Pancho: She helps run a small family store with some of my older brothers and sisters. Carl: What kind of store? Pancho: We mainly sell food, like bread, eggs, soft drinks, rice, sugar, and cookies. Things that people buy every day., Question: How many brothers and sisters does Pancho have? (A) 11 (B) 12 (C) 13

SOLUTION: arithmetic

PROBLEM: W: Good morning, sir. May I help you? M: Yes, would you please find a room for our business meeting? W: Certainly, sir. How many people do you have? M: Well, about 10. W: Fine. We have a conference room which can seat up to 20 people. M: That's great. What about the charge? W: It is 90 RMB per hour. There is no minimum charge. Do you want to book it? M: Yes, I think so. W: May I have your name and room number, please, sir? M: Mr. Black, Room 1208. W: Thank you, Mr. Black. How long will you be using the conference room? M: We'll start at 10 o'clock tomorrow morning but I'm not sure when we'll finish. W: No problem, Mr. Black. The room will be at your disposal then., Question: What is the man doing? (A) Renting a house. (B) Reserving a meeting room. (C) Having a meeting.

SOLUTION:
commonsense

