From Ryoanji, a 20-minute stroll or a short bus ride takes you to Kinkakuji, Japan's famous Temple of the Golden Pavilion. 
It takes around 20 minutes to walk from Kinkakuji to Ryoanji.
There are no buses going from Ryoanji to Kinkakuji.