With the development of technology, distance education has become an important tool to achieve educational equity. This paper aims to analyze the impact mechanism of modern distance teacher training on narrowing the gap between urban and rural education of China, and put forward a new path to improve the basic education. The research takes the China Education Panel Survey (CEPS) as the data source for analysis and find that the gap between urban and rural basic education does exist, but the academic achievement gap reflected by students at different quantiles is different; Distance teacher training is conducive to improving urban and rural students with different academic performance levels, and it has a higher promotion effect on students with better academic performance in rural areas; Different distance teacher training methods have different effects on students' academic performance, and the effects on mathematics and English subjects are more significant than those on Chinese subjects. Finally, this paper put forward some suggestions for the improvement of modern distance teacher training from the aspects of organization and management, training content, so as to provide a valuable reference for the balanced development of urban and rural education.