a non - transitory computer readable storage medium includes instructions to maintain an original training set of labeled documents , where the labeled documents correspond to a variety of topics . a new labeled document corresponding to a new topic is received . the original training set of labeled documents is modulated such that the new labeled document is over - represented with respect to the original training set . this results in a modulated training set . a classifier is trained with the modulated training set to form a trained classifier .