the plot where the manor house now stood had seen the coming and goings of many structures , from the original small wooden dwelling built by daninfald to the seventeenth and eighteenth century mansion that stood now .