In reality, we know next to nothing about Joseph.  Whether or not he prayed, whether he remained silent, even whether or not he and Mary ever had intercourse...It's all irrelevant, really, to the message and the mission of the Church.