these frequent and unwelcome visitors , at least as the neighbors saw it , only caused further scandal and disquiet in the community , which continued to heighten the dames infamy and only drew sooth seekers from even more distant climes .