the fact that only a few of the children were actually orphans led to speculation that the families had been scurried out of harms way by fearful wealthy patrons who believed that remaining in poland would be fatal , their fears proved correct ; many believed we were polish jews .