def to_id_int(tokens, vocab_map, offset=0):
    unk = VocabConstants.UNK
    return [int(vocab_map[token] + offset) if token in vocab_map else str(vocab_map[unk] + offset) for token in tokens]
Map a list of tokens to their correponding int representations (id).
dataset/ETHPy150Open yuhaozhang/nnjm-global/code/io_vocab.py/to_id_int