second lstm layer first layer lstm global context memory softmax classifier initialize refine informativeness gate attention .
Moving Poselets: A Discriminative and Interpretable Skeletal Motion Representation for Action Recognition