Seems like this paper is more focused on recognizing action than tracking. Most of the paper seems to be focused on how to determine if two images belong to the same type of action and the so-called tracking is just figuring out the point correspondences between related images.
Meifang mentioned a point I was also wondering about: how does the rate of motion affect the tracking ability?
Looking forward to the presentation tomorrow for answers to these questions.