After his marriage, Fillmore began farming in Vermont. Shortly thereafter, Nathaniel and his brother Calvin Fillmore were approached by land agents offering tracts in New York state. Unhappy with trying to make the stony ground of their Vermont land productive, they quickly grabbed the opportunity and moved to western New York, sight unseen.