Following his graduation, Breckinridge returned to Kentucky with no clear direction in his life. He began to amuse himself by attending various parties and other social engagements. During a visit to the state capital, he so offended one man that he was challenged to a duel. Though he obtained two pistols, he never accepted the man's challenge, and was branded a coward. The dispute was later settled in the Masonic Lodge of which both Breckinridge and the other man were members.