`` but it seemed unfair to agnes to just thrust my son on her , especially when they made it plain they did n't plan to move back in with me but were going to buy their own little farm in the next town over .