a method of processing a sequence of characters , the method comprising converting the sequence of characters into a sequence of tokens so that each token comprises a lexeme and one of a plurality of token types . each of the plurality of token types relates to at least one of a plurality of predetermined functions , wherein at least one said token type relates to multiple functions of the plurality of predetermined functions .