There were numerous, so called, Infancy Gospels.   None were ever recognized  by the western churches as canonical, but some of the Eastern Churches may have at times.  However, they were the source of many "traditions" about the lives of Mary, Joseph, Jesus, etc.  Do you remember how many statues of St. Joseph show him holding what appears to be a hollyhock stalk with blooms?   That comes from some of these, I think James.   The Feast of the Presentation of Mary into the Temple is another one that comes from an Infancy Gospel, again I think it was James.   The story of Joseph being an old man is from these works as well.  
They make some very interesting reading and some them truly are quite old.  

https://en.wikipedia.org/wiki/Category:Infancy_Gospels