It was originally a nunnery, founded in 1080 by the Benedictine Order. The oldest preserved document that mentions Bosjö Abbey was written by Pope Lucius III in 1181, when he confirmed its privileges. The abbey was transformed into a castle in the 16th century, and only parts of the original building remains. During the Danish Reformation in the 16th century, the nunnery was closed down and the estate became Danish crown property. It was subsequently donated to Torbern Bille, the former archbishop of the Diocese of Lund under the condition that he took care of the remaining nuns. In 1560 King Frederick II of Denmark gave the estate as a barter to the widowed Scanian noble woman Thale Ulfstand. Her initials and the year 1569 are carved into the large oak doors of the entrance and are still visible.