In 1853, he finished school and started working as a writer and chancellor in various towns. During this period he began a relationship with the Samogitian poet Karolina Proniewska (Karolina Praniauskaitė) and her family. The two shared a passion for the poetry of Adam Mickiewicz. Praniauskaitė suggested that Baranauskas should try to write more in Lithuanian. In 1856, Karolina's family tried to separate the couple by sponsoring Baranauskas' entry into the Catholic Seminary of Varniai. While studying there, he began to concentrate on the development of the written Lithuanian language, and wrote a commentary on Lithuanian and Samogitian dialects "Apie lietuvių ir žemaičių kalbą". It was the first scholarly attempt to distinguish these different Lithuanian dialects.