Could I just let the delinquency or default notices alone until I can pay it?
It is smart to never ignore your delinquency or default notices from your loan servicer.
What about my promissory note?
You should always read your promissory note because it is a legal document and once signed it means you are legally responsible to repay your loan according to the terms.