    def batch_tokenize(self, texts: List[str]) -> List[List[Token]]:
        """
        Batches together tokenization of several texts, in case that is faster for particular
        tokenizers.

        By default we just do this without batching.  Override this in your tokenizer if you have a
        good way of doing batched computation.
        """
        return [self.tokenize(text) for text in texts]
Batches together tokenization of several texts, in case that is faster for particular
tokenizers.

By default we just do this without batching.  Override this in your tokenizer if you have a
good way of doing batched computation.
allennlp/data/tokenizers/tokenizer.py