A piezoelectric fast steering mirror (PFSM) is a complex, strong coupling nonlinear system that integrates optics, mechanics, electrics, and control. Due to the existence of hysteresis nonlinearity, mechanical resonance, and all kinds of disturbances, precise tracking control of a PFSM is a challenging task. This paper presents a comprehensive study of modeling, controller design, and simulation evaluation for a PFSM system. First a general model of a PFSM system integrating mechanical dynamics, electrical dynamics, and hysteresis nonlinearity is proposed, and then a robust adaptive controller is developed under both unknown hysteresis nonlinearities and parameter uncertainties. The parameters needed directly in the formulation of the controller are adaptively estimated. The proposed control law ensures the uniform boundedness of all signals in the closed-loop system. Furthermore, a stability analysis of the control system is performed to guarantee that the output tracking error converges to zero asymptotically. Finally, simulation tests with different motion trajectories are conducted to verify the effectiveness of the proposed method.