On Wed, Apr 17, 2013 at 11:16 PM, Zachary Pincus <zachary.pincus@yale.edu> wrote:
Identifying features to track between frames is a pretty classic task in computer vision. Things that come to mind would include the simple Harris corner detector (in skimage), or more recent things like SIFT features and its variants like SURF etc. (DAISY is in skimage) might be of use. All of these tools should be in OpenCV too, IIRC. (Time to spend a while on wikipedia reading about these things and related, if it's all totally unfamiliar.)
Having binary features (there are many) and Star Features (also known as "Consensus") in skimage would be very valuable.
Alternately, you could try optical flow based techniques to densely track local pixel patches between frames.
That's also a fun application, and a good way to learn Cython! Stéfan