DNA–protein cross-links remain the least-studied type of DNA damage. Recently, their repair was shown to involve proteolysis; however, the fate of the peptide remnant attached to DNA is unclear. Particularly, peptide cross-links could interfere with DNA polymerases. Apurinuic/apyrimidinic (AP) sites, abundant and spontaneously arising DNA lesions, readily form cross-links with proteins. Their degradation products (AP site–peptide cross-links, APPXLs) are non-instructive and should be even more problematic for polymerases. Here, we address the ability of human DNA polymerases involved in DNA repair and translesion synthesis (POLβ, POLλ, POLη, POLκ and PrimPOL) to carry out synthesis on templates containing AP sites cross-linked to the N-terminus of a 10-mer peptide (APPXL-I) or to an internal lysine of a 23-mer peptide (APPXL-Y). Generally, APPXLs strongly blocked processive DNA synthesis. The blocking properties of APPXL-I were comparable with those of an AP site, while APPXL-Y constituted a much stronger obstruction. POLη and POLκ demonstrated the highest bypass ability. DNA polymerases mostly used dNTP-stabilized template misalignment to incorporate nucleotides when encountering an APPXL. We conclude that APPXLs are likely highly cytotoxic and mutagenic intermediates of AP site–protein cross-link repair and must be quickly eliminated before replication.