The distracted driving state of the car driver has caused serious harm to traffic safety and the personal safety of the driver. The most frequent and common distraction is the distracted driving behavior of the driver on the phone. In order to accurately identify the car driver's phone call is distracting driving behavior. A driver's phone call behavior recognition method based on the joint point information of the driver's body was proposed in this manuscript. After using the OpenPose network structure to extract the joint points of the human body, the driver’s angle of the driver's upper and lower arms and the normalized distance between the joint points are calculated and compared to relatively accurate identification of car drivers' phone calls and distracted driving behaviors The experimental results show that the method proposed in this paper has an accuracy rate of 97.23% for the distracted driving state of the car driver's phone call.