the warning to not add to or take away does n't refer to either the new testament or to the whole bible because it only pertains to 'the words of the book of this prophecy which refers only to the prophecy contained in the book of revelation that many scholars concede john wrote while on the isle of patmos .