Kelly-Kenny lived largely in Britain, where his clubs were Army and Navy and Arthur's, and he let his house at Doolough Lodge in County Clare to his brother Matthew Butler Kelly JP, who is recorded as living at that address in Thom's Directories. There are unsubstantiated reports that royalty stayed at Doolough Lodge with Kelly-Kenny, for example that King George V visited Doolough Lodge, as Prince of Wales in 1906 and that George V stayed at Doolough Lodge during his visit to Ireland in July 1911.