One of Very's students, a fellow native of Salem named Samuel Johnson Jr., said that people ridiculed Very behind his back since he had "gained the fame of being cracked (or crazy, if you are not acquainted with Harvard technicalities)". During one of his tutoring sessions, Very declared that he was "infallible: that he was a man of heaven, and superior to all the world around him". He then cried out to his students, "Flee to the mountains, for the end of all things is at hand". Harvard president Josiah Quincy III relieved Very of his duties, referring to a "nervous collapse" that required him to be left in the care of his younger brother Washington Very, himself a freshman at Harvard. After returning to Salem, he visited Elizabeth Peabody on September 16, 1838, apparently having given up his rule "not to speak or look at women". As she recalled,