Catalyzes the attachment of aspartate to tRNA(Asp) in the mitochondrion. ATP + L-aspartate + tRNA(Asp) = AMP + diphosphate + L-aspartyl-tRNA(Asp) Present with 1550 molecules/cell in log phase SD medium. Belongs to the class-II aminoacyl-tRNA synthetase family. Type 1 subfamily.