Hydrolyzes dipeptides containing N-terminal aspartate residues. Dipeptidase E catalyzes the hydrolysis of dipeptides Asp-|-Xaa. It does not act on peptides with N-terminal Glu, Asn or Gln, nor does it cleave isoaspartyl peptides. Belongs to the peptidase S51 family.