calibration

I am doing project on video tracking. In that I need to find the feature points each frame and estimate the 3D coordinates of each point. Can somebody explain me how to go about this