The marriage was troubled for unknown reasons, and the couple lived apart. They had separated for the first time by the spring of 1853. Jane took Marion to Lewistown, Pennsylvania, where her mother and sister lived. Stephen went to New York City to pursue songwriting. The couple reunited within a year, but separated again and again.