Randolph, to his utter "chagrin", could not prevent the marriage of the queen to Lord Darnley, yet after the marriage, he declined to recognise Darnley's authority. His representations and promises were mainly responsible for the rebellion of James Stewart, 1st Earl of Moray, known as the Chaseabout Raid. On 14 February 1566 Randolph wrote to the Earl of Leicester that he was unable and unwilling to commit his opinions on Mary's actions on paper for fear of appearing "malicieus foolyshe and unadvised". In February 1566 he was accused by Mary of having assisted Moray and her rebellious subjects with a gift of three thousand crowns, and was required to quit the country within six days. Ultimately he retired to Berwick upon Tweed, and while there he was, after the murder of Riccio, accused by Mary of having written a book against her, called "Mr. Randolph's Phantasy".