Release of an N-terminal dipeptide from a peptide comprising four or more residues, with broad specificity. Also acts on dipeptidyl 2-naphthylamides. Binds 1 zinc ion per subunit. Belongs to the peptidase M49 family.