Bishop was born at Totnes, Devon, in 1846. His early schooling was received in Ashburton and then at the Exeter School. Afterwards he was sent to a Catholic school in Belgium.
Bishop's early education took place in Totnes, Devon, at Ashburton and Exeter School. He then attended a Catholic school in Belgium.