A man who quits his job and refuses to take other work that is available is hardly unemployed in the legal sense.  And if he then takes public assistance, he may very well be guilty of fraud.

So, no, not a crime to be poor, but yes, a crime to commit fraud.

Did that answer your question sufficiently?  If not, please say so and I will try to make it more clear...