original_docstring: 
      Implementation of Consensus Score (CS) formula from Shah et al. (2019): https://arxiv.org/abs/1902.05660
      :param Q_accs: List of accuracies for a question grouping
      :param k_val: k from CS definition
      :return:
      
docstring: Implementation of Consensus Score (CS) formula from Shah et al.
docstring_tokens: Implementation of Consensus Score ( CS ) formula from Shah et al .
code: def calc_consistency(Q_accs, k_val):
      """
      Implementation of Consensus Score (CS) formula from Shah et al. (2019): https://arxiv.org/abs/1902.05660
      :param Q_accs: List of accuracies for a question grouping
      :param k_val: k from CS definition
      :return:
      """
      total_Q_S = 0.
      n_C_k = 0.
      for Q_prime in itertools.combinations(Q_accs, k_val):
          n_C_k += 1.
          total_Q_S += float(all(score > 0. for score in Q_prime))
      return total_Q_S / n_C_k
code_tokens: def calc_consistency ( Q_accs , k_val ) : total_Q_S = 0. n_C_k = 0. for Q_prime in itertools . combinations ( Q_accs , k_val ) : n_C_k += 1. total_Q_S += float ( all ( score > 0. for score in Q_prime ) ) return total_Q_S / n_C_k
short_docstring: Implementation of Consensus Score (CS) formula from Shah et al.
short_docstring_tokens: Implementation of Consensus Score ( CS ) formula from Shah et al .
comment: """
      Implementation of Consensus Score (CS) formula from Shah et al. (2019): https://arxiv.org/abs/1902.05660
      :param Q_accs: List of accuracies for a question grouping
      :param k_val: k from CS definition
      :return:
      """