public static String tokenText(List<Token> tokens){
  return tokenText(tokens,null);
}

public static String tokenText ( List < Token > tokens ) { return tokenText ( tokens , null ) ; }
compare an input document ' s original text with its formatted output and return the ratio of the incorrectwhitespacecount to total whitespace count in the original document text . it is a measure of document similarity .
