A rate feed forward control-based sensor fusion is proposed to improve the closed-loop performance for a charge couple device (CCD) tracking loop. The target trajectory is recovered by combining line of sight (LOS) errors from the CCD and the angular rate from a fiber-optic gyroscope (FOG). A Kalman filter based on the Singer acceleration model utilizes the reconstructive target trajectory to estimate the target velocity. Different from classical feed forward control, additive feedback loops are inevitably added to the original control loops due to the fact some closed-loop information is used. The transfer function of the Kalman filter in the frequency domain is built for analyzing the closed loop stability. The bandwidth of the Kalman filter is the major factor affecting the control stability and close-loop performance. Both simulations and experiments are provided to demonstrate the benefits of the proposed algorithm.