100% only worth going to when the deck is open.  As an undergrad, I hated this place unless the weather was nice and I had a good group with me.  There's often drunk kids falling over and breaking things.  As a grown person, I have the same feelings...I've only stopped here twice or so for an afternoon beverage.  It's okay before 7pm.