``` high_frequency_tokens = [] pikeun token, freq dina self.token_freqs: lamun freq >= min_freq: high_frequency_tokens.append(token) self.idx_to_token = list(sorted(set([' '] + reserved_tokens + high_frequency_tokens))) ```
spam lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor creativity violence