In this paper, an effort is made to combine the knowledge of computer vision techniques and deep learning to build and end-to-end facial keypoint recognition system. Facial keypoints include points around the eyes, nose, and mouth on any face and are used in many applications, from facial tracking to emotion recognition. The partially complete module should be able to take in any image containing faces and identify the location of each face and their facial keypoints. The proposed facial recognition system uses few of the many computer vision algorithms built into the OpenCV library and are implemented at the basic level. This expansive computer vision library is open source and is still growing. The proposed system does real time filtering and facial key point detection. This implementation uses a Convolutional Neural Network to train the system at each step, visualize the loss and learn in the next detection.