[[ ]{}]{} [[ ]{}]{} [[ ]{}]{} [[ ]{}]{}?\
& & &\
Extent ([[ ]{}]{}) & **By how much** [[ ]{}]{} [[ ]{}]{} otherAux [[ ]{}]{} [[ ]{}]{} [[ ]{}]{} ? & New Mexico was won by Obama [[ ]{}by a margin of 5%]{} in 2008. & **By how much** [[ ]{}]{} [[ ]{}]{} [[ ]{}]{} by [[ ]{}]{} [[ ]{}]{}?\

We also use WordNet [@miller1998wordnet] hypernyms of all potential short answers and replace ***What*** with the bigram ***Which hypernym***. So, for a sentence like “Hermione plays badminton at the venue”, we generate a question “***Which sport*** does Hermione play at the venue?”. For computing the hypernym, we use the sense disambiguation implementation of @pywsd14. While supersenses do display a richer lexical variety, sense definitions don’t always fit well.

Handling modals and auxilliaries
--------------------------------

During explicit inversion of the verb and arguments around it via our templates, we tried to ensure that the positions of auxiliaries are set, and negations are correctly treated. We define a few simple rules to ensure that.

-   When there are multiple auxiliaries, we only invert the first auxiliary while the second and further auxiliaries remain as they are just before the main verb.

-   We 