Is there an absence of a logical link between 'I was old enough at the time that I knew what was going on.' and 'By that age, I knew what was happening.'
I was old enough at the time that I knew what was going on.###By that age, I knew what was happening.