Gender classification can be stated as inferring female or male from a collection of facial images. There exist different methods for gender classification, such as gait, iris, hand shape and hair, it is probably better way to find out gender based on facial features. In this paper SVM basic kernel function has been employed firstly to detect and classify the human gender Image into two labels i.e. (1) male and (2) female. The gender classifier achieves over 96% accuracy.