Thus, "stuff" in this context refers to fabric not made of silk or silk substitutes. The word was still in English upper-class usage in this sense in the 1960s.
The term "stuff" in this context refers to fabrics other than those made from silk or its substitutes.  This usage was prevalent among upper-class English speakers during the 1960s.