TASK DEFINITION: In this task, you will be shown a conversation and a question. You should categorize the question into matching, summary, logic, arithmetic and, commonsense groups. Matching is a question entailed or paraphrased by exactly one sentence in a dialogue. The answer can be extracted from the same sentence. Questions that cannot be answered by the surface meaning of a single sentence belong to the reasoning category. We further define summary, logic, arithmetic and, commonsense subcategories. Answering summary questions requires the whole picture of dialogue, such as the topic of dialogue and the relation between speakers. We require logical reasoning to answer logical questions. in arithmetic questions Inferring the answer requires arithmetic knowledge. To answer commonsense questions, besides the textual information in the dialogue, we also require additional commonsense knowledge that cannot be obtained from the dialogue. Note that a question can be in more than one group. "W" and "M" in the conversations stand for "woman" and "man".
PROBLEM: M: This hotel in India just got ranked the number one hotel in the world! W: What, by some silly website that specializes in top ten lists just to sell more ads? M: No, by Travel + Leisure magazine. W: Oh, really? They really know their stuff. Hey, that looks more like a palace! M: It's designed after the ancient palaces of northern India. W: It looks like a lot of the rooms have balconies. M: Yeah, those are the suites that have direct access to private pools. But all the rooms have Wi-Fi, flat screen TVs, king-size beds, daily newspapers, and... W: OK, stop talking! We've got to make our reservations! M: Well, hang on a second. You don't really like Indian food. W: But I thought they offer other choices besides Indian food... M: Maybe. Also, this part of India is pretty quiet. There's no shopping or clubbing. People go there to relax. W: That's OK. I can go shopping anywhere. M: The rooms start at $350 per night, and those suites are $750 per night. W: Whoa! I thought India was supposed to be inexpensive!, Question: Who ranked the number one hotel in the world? (A) A popular website. (B) A famous newspaper. (C) A high-quality magazine.

SOLUTION: commonsense

PROBLEM: W: Hi, Peter. What are you going to do this afternoon? M: I'd like to go swimming. You know, it's my favourite sport. W: Oh, really? How often do you go swimming? M: Twice a week. W: Whom do you usually go with? M: I usually go with my brother, David. W: That must be great fun. M: Sure!, Question: With whom does Peter usually go swimming? (A) His friend. (B) His father. (C) His brother.

SOLUTION: logic

PROBLEM: Greg: Hey, sorry, I can't come to the phone now. Just leave a message ... [Beep] Dave: Greg, greg. Where in the world are you? Hey, man. I'm in hot water, and it's all your fault! I thought you said Cindy was single and available!! Man, were you wrong!! You should have told me that your sis had just broken up with a seven-foot gorilla named Butch. I mean the guy is huge, and he caught me dropping her at her place, and he nearly strangled me before I could get in my car. And the guy's dog. You might have warned me about his vicious beast dog. The thing nearly ripped off my arm. Well, once I peeled out of the drive way, the maniac started chasing me in his monster truck and nearly ran me off the road. And man, you could have told me that your car didn't have much gas 'cause it ran out in the middle of this dark parking lot, and I'm now hiding in the men's room of the gas station. Now, pick up the phone ... pick it up, ... Oh, no I can hear the guy outside and ... hey, and your phone is going dead ... Ah, man ... you might have told me that this thing couldn't hold a charge ... Ah man ... I should have stayed home and done the laundry ... I shouldn't have listened to your wacky idea of going out tonight ... Greg, Greg? Where are you?, Question: Where is the man at the time of this phone call? (A) at home (B) in a restroom (C) in his car

SOLUTION:
matching

