One of the main reasons for Abu Bakr's unpopularity was his declaration that crayfish, a staple item of the diet of the Muslims of the Cape, was "khabahith" or "evil food". The matter was taken to court by the "kreef (crayfish) party" in 1863. Magistrate Hill found in favour of the "kreef party" and against Abu Bakr. After this and his evidence in the 1869 imam succession trial, a petition was drawn up by some Muslims to have him removed from the Cape. He left his residence in Cape Town and moved 12 km away to Newlands to a spacious house, "Stony Place".