at length naught was left of them but a strange people wandering secretly in the wild , and other men knew not their homes nor the purpose of their journeys , and save in imladris , in the house of elrond , their ancestry was forgotten .