In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.

To assess the consistency of annotations and also eliminate coincidental annotations, we used agreement rates, which is calculated by dividing the number of senses under each category where the annotators annotate consistently by the total number of each kind of sense. And considering the potential impact of unbalanced distribution of senses, we also used the Kappa value. 
 Question: Which inter-annotator metric do they use?
agreement rates Kappa value

Table TABREF46 shows that our Open model achieves more than 3 points of f1-score than the state-of-the-art result, and RelAwe with DepPath&RelPath achieves the best in both Closed and Open settings. 
 Question: How big is improvement over the old  state-of-the-art performance on CoNLL-2009 dataset?
our Open model achieves more than 3 points of f1-score than the state-of-the-art result

This action space is of the order of $A=\mathcal {O}(|V| \times |O|^2)$ where $V$ is the number of action verbs, and $O$ is the number of distinct objects in the world that the agent can interact with. As this is too large a space for a RL agent to effectively explore, the knowledge graph is used to prune this space by ranking actions based on their presence in the current knowledge graph and the relations between the objects in the graph as in BIBREF7 
 Question: How is the domain knowledge transfer represented as knowledge graph?

the knowledge graph is used to prune this space by ranking actions based on their presence in the current knowledge graph and the relations between the objects in the graph as in BIBREF7

