original_docstring: 
      Function that takes in a raw email, preprocesses it, tokenizes it,
      stems each word, and returns a list of tokens in the e-mail
      
docstring: Function that takes in a raw email, preprocesses it, tokenizes it,
  stems each word, and returns a list of tokens in the e-mail
docstring_tokens: Function that takes in a raw email preprocesses it tokenizes it stems each word and returns a list of tokens in the e - mail
code: def email2TokenList(raw_email):
      """
      Function that takes in a raw email, preprocesses it, tokenizes it,
      stems each word, and returns a list of tokens in the e-mail
      """
  
      stemmer = nltk.stem.porter.PorterStemmer()
      email = preProcess(raw_email)
  
      # Split the e-mail into individual words (tokens) 
      tokens = re.split('[ \@\$\/\#\.\-\:\&\*\+\=\[\]\?\!\(\)\{\}\,\'\"\>\_\<\;\%]',
                        email)
  
      # Loop over each token and use a stemmer to shorten it
      tokenlist = []
      for token in tokens:
  
          token = re.sub('[^a-zA-Z0-9]', '', token)
          stemmed = stemmer.stem(token)
          #Throw out empty tokens
          if not len(token):
              continue
          # Store a list of all unique stemmed words
          tokenlist.append(stemmed)
  
      return tokenlist
code_tokens: def email2TokenList ( raw_email ) : stemmer = nltk . stem . porter . PorterStemmer ( ) email = preProcess ( raw_email ) tokens = re . split ( '[ \@\$\/\#\.\-\:\&\*\+\=\[\]\?\!\(\)\{\}\,\'\"\>\_\<\;\%]' , email ) tokenlist = [ ] for token in tokens : token = re . sub ( '[^a-zA-Z0-9]' , '' , token ) stemmed = stemmer . stem ( token ) if not len ( token ) : continue tokenlist . append ( stemmed ) return tokenlist
short_docstring: Function that takes in a raw email, preprocesses it, tokenizes it,
  stems each word, and returns a list of tokens in the e-mail
short_docstring_tokens: Function that takes in a raw email preprocesses it tokenizes it stems each word and returns a list of tokens in the e - mail
comment: """
      Function that takes in a raw email, preprocesses it, tokenizes it,
      stems each word, and returns a list of tokens in the e-mail
      """$SEP$# Split the e-mail into individual words (tokens) $SEP$# Loop over each token and use a stemmer to shorten it$SEP$#Throw out empty tokens$SEP$# Store a list of all unique stemmed words