Analysis of the Memorization and Generalization Capabilities of AI Agents: Are Continual Learners Robust?