Brown started his own legal defense fund before resigning, a move he said was necessary to protect his family's assets. However, some insiders claimed that this was what really led to his ousting. He raised money from breeders for the fund as well as the International Arabian Horse Association, creating what some called a conflict of interest. Despite his contract stipulating that association was to pay all his personal legal expenses, on top of his $100,000 annual salary, the association initially refused to pay the legal bills. It was claimed that Brown created the legal defense fund on the advice of the association's own legal counsel.