In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.

Probing Methodology and Modeling ::: Task Definition and Modeling ::: Baselines and Sanity Checks.
When creating synthetic datasets, it is important to ensure that systematic biases, or annotation artifacts BIBREF41, are not introduced into the resulting probes and that the target datasets are sufficiently challenging (or good, in the sense of BIBREF42). To test for this, we use several of the MCQA baseline models first introduced in BIBREF0, which take inspiration from the LSTM-based models used in BIBREF43 for NLI and various partial-input baselines based on these models. 
 Question: How do they control for annotation artificats?
 we use several of the MCQA baseline models first introduced in BIBREF0

To study the lexical and semantic diversities of responses, we performed three analyses. First, we aggregated all worker responses to a particular question into a single list corresponding to that question. Second, we compared the diversity of individual responses between Control and AUI for each question. To measure diversity for a question, we computed the number of responses divided by the number of unique responses to that question. We call this the response density.  
 Question: How was lexical diversity measured?
By computing number of unique responses and number of responses divided by the number of unique responses to that question for each of the questions

To identify new keywords in the selected microposts, we again leverage crowdsourcing, as humans are typically better than machines at providing specific explanations BIBREF18, BIBREF19. In the crowdsourcing task, workers are first asked to find those microposts where the model predictions are deemed correct. Then, from those microposts, workers are asked to find the keyword that best indicates the class of the microposts as predicted by the model. 
 Question: How is the keyword specific expectation elicited from the crowd?

workers are first asked to find those microposts where the model predictions are deemed correct  asked to find the keyword that best indicates the class of the microposts

