I am not a fan of Pope Francis, but I would definitely classify this particular comment as a "no biggie."

The Pope rightly thinks that excessive attention to clothing is a character flaw strongly associated with the female sex. He is not perspicacious enough to realize that most women who are obsessed with clothing are obsessed for perfectly sound reasons. (E.g., society treats an unstylishly-dressed woman much less kindly than an unstylishly-dressed men, and women, in countries like Argentina, have only limited opportunities to distinguish themselves through qualities other than appearance.) But his point is unexceptional. Obsession with clothing, wasting money on clothing, taking pride in clothing are quintessentially female vices.