Fourier-domain rapid scanning optical delay line (RSOD) was introduced for phase modulation and depth scanning in a time-domain optical coherence tomography (TD-OCT) system. Investigation of parameter optimization of RSOD was conducted. Experiments for RSOD characterization at different parameters of the groove pitch, focal length, galvomirror size, etc. were performed. By implementing the optimized RSOD in our established TD-OCT system with a broadband light source centered at 840 nm with 50 nm bandwidth, in vivo retina imaging of a rabbit was presented, demonstrating the feasibility of high-quality TD-OCT imaging using an RSOD-based phase modulator.