Come sweater season, you'll be back!
The woman is breaking up with the man probably because of all of the goats he keeps in the house. His response is that when the weather gets cold, she will come back to their relationship because on of the benefits the goats provide is fur for sweaters.