he did get up to the todaiji temple , and largest wooden structure in the world , but time never let him return to that place of garden spirits as wil had to collect his bag from the ryokan , have some lunch , and catch a bus to osaka and the flight back to australia .