Mr. Poirot, here, will show me the way." As they all went out of the room, Poirot turned and made me a sign to follow him upstairs. 
There is more than one level in the building that Poirot is in.
They all stayed in the room and Poirot told me to stay where I was.