The discipline of Computer Vision has generated interested in computer scientists, psychologists and neuroscientists. In this, Computer vision has been successfully used in face detection, face recognition, facial expression recognition and emotion identification. The next great step in computer vision is to identify personality traits from facial appearance. From ancient times, it has been proved that it is possible to assess personality traits and types from facial appearance or features of the face. While personality traits can be assessed using psychological or psychometric tests, interviews, and direct observation it is important, as the fields of AI and deep learning advance, that the psychological tests are automated to build and develop digital physiognomy software. The advantages of automatic personality traits assessment from facial appearances are far and wide ranging. This automation can be easily arrived at using deep learning algorithms especially by retraining the Inception v3 CNN model.