Upon his release, he emigrated to the United States where he clung to various priests as an organist. He felt called to the religious life and joined the Franciscan order in Pulaski, Wisconsin, but was expelled and moved to Manitowoc, Wisconsin, where he worked in various menial jobs. He was organist at the independent Sweetest Heart of Mary Church in Detroit, Michigan (which Vilatte consecrated in 1893) but later quarreled with and wrote in newspapers against the pastor, , and left.
Upon his release, he fled to the United States where he clung to various priests as an organist. He felt called to the religious life and joined the Franciscan order in Pulaski, Wisconsin, but was expelled and moved to Manitowoc, Wisconsin, where he performed menial jobs. He served as organist at the independent Sweetest Heart of Mary Church in Detroit, Michigan (which Vilatte consecrated in 1893) but later had a dispute with and wrote critical articles about the pastor, , and left.