On 9 June 1792 he fought a duel with a Captain Cuthbert of the Guards, when the latter refused to let the former's carriage pass through Mount Street in London where some rioting had been taking place. The Earl asked him if he knew who he was which this led to an unpleasant exchange of words following which the Earl felt obliged to challenge the Captain to a duel the next morning. A pistol ball passed through the flap of Cuthbert's coat but after the exchange of fire both men were unhurt. The matter was concluded with a handshake.