This point is exactly why Harper was never done in by the economy.  The general public rightly didn't blame him for the recession (it wasn't the Liberals fault either) so all you could do was look at how they handled it.

Now just imagine what would happen if Trudeau gets into a similar situation.  They have no base on which to stand to support any stimulus, so doing so would make a bad situation even worse.