Stunt work is not steady work. Stuntmen who work in movie are only employed on a movie-by-movie basis, sometimes they are needed for a number of months if they are lucky to double for the lead actor but could quite easily only be needed for a single stunt that is filmed over the space of a day or two.