Compressive sensing based facial expression recognition

In this paper, face recognition technology is studied and explored, and the classical local binary pattern (LBP) algorithm is studied and improved. An improved LBP algorithm is proposed to solve the deficiency of LBP: a "double circle" LBP algorithm is proposed, which improves the rotation invariability of LBP to a greater extent and has a good recognition effect on small-pose face images. On the basis of good recognition effect of LBP based on partitioning, the idea of "multiple partitioning + intermediate partitioning" is put forward, which effectively makes up for the shortage of incomplete extraction of peripheral information of original segmentation line. Facial features are the key features of face recognition. Different organs contribute differently to face image recognition. The idea of "key block" based on the original block is proposed. Finally, the application of an LBP algorithm for face recognition is taken as an example, and the experimental results verify the reliability of the face recognition method based on LBP for weak light and expression change images.

Palm tree detection using remote sensing images has received increasing attention in recent years, concerning the issues of sustainability, productivity and profitability. There has been significant progress in the research of using machine learning techniques, especially convolutional neural networks (CNNs) for automatic palm tree detection. However, whether CNNs can actually outperform traditional human-engineered approaches in terms of classification accuracy and detection speed is yet unknown. In the present study, we have compared human-engineered features namely histogram of oriented gradients (HOG), local binary pattern (LBP) and scale-invariant feature transform (SIFT) with features extracted using pre-trained AlexNet model for detecting palm trees in high resolution images obtained via unmanned aerial vehicle (UAV). Support vector machines (SVM) with linear and non-linear kernels were used to classify feature vectors obtained by different feature extractors. Haar-like features used in Viola-Jones framework was also tested in the study. Results showed that features extracted from the fifth convolutional layer of AlexNet achieved the highest accuracy of 96.1% using SVM with RBF kernel as classifier, which surpassed the accuracy obtained by fully-connected CNN, namely 95.6%. The results also suggest that SVM classifier with radial basis function (RBF) kernel using LBP as features is the optimal combination as it achieved comparable accuracy but higher detection speed than CNN approaches.

The texture is an essential property of an image that tells about the arrangements of pixels of different intensities in an image matrix. Researchers have used many descriptors for texture classification of the images in computer vision and image processing. Local Binary Pattern (LBP) is one of the descriptors, which is computationally efficient and straightforward for texture classification. In recent years, researchers have made many enhancements to the basic LBP method to improve the quality of extracted features for an image. This paper presents a Local Roughness Binary Pattern (LRBP) descriptor for feature extraction of an image to increase LBP discriminative capability. This new descriptor extracts features from the local region of an image called a partial feature vector and concatenates these local features to obtain a feature vector of an image. This feature vector is used as input to a classifier to classify the class of an image. We tested the proposed descriptor for the images available on CUReT and KTHTIPS2b databases with Support Vector Machine (SVM) and k-nearest Neighbors (KNN) classifiers. We have presented the experimental results obtained from the analysis process regarding classification accuracy and confusion matrix. Finally, we have presented a performance comparison between the proposed method, basic LBP descriptor, and its variants. Results show that the proposed descriptor gives much better results than other descriptors on the KTHTIPS2b Database when we use the KNN classifier.KeywordsLBPLocal binary patternLRBPLocal roughness binary patternSVMSupport vector machineKNN K-nearest neighbors

This paper proposes a novel face representation approach, local Gabor binary mapping pattern (LGBMP), for multi-view gender classification. In this approach, a face image is first represented as a series of Gabor magnitude pictures (GMP) by applying multi-scale and multi-orientation Gabor filters. Each GMP is then encoded as a LGBP image where a uniform local binary pattern (LBP) operator is used. After that, each LGBP image is divided into non-overlapping rectangular regions, from which spatial histograms are extracted. Although an LGBP feature vector can be obtained by fitting together the regional histograms, it can not be employed in pattern classification due to its high dimension. We propose that each regional LGBP feature be mapped onto a one-dimensional subspace independently before they are concatenated as a whole feature vector. This is attractive since we reduce the feature dimension and also preserve the spatial information of LGBP image. Two ways have been proposed to map the regional LGBP feature in this paper. One is so-called LGBMP-LDA using linear discriminant analysis (LDA) for dimensionality reduction while the other is to project the regional LGBP feature onto the class center connecting line, namely, LGBMP-CCL. As a result, despite several decades of Gabor filters, the final feature dimension is even less than that of the feature extracted by using LBP directly on gray-scale images. The classification tasks in our work are performed by support vector machines (SVM). The experimental results on the CAS-PEAL face database indicate that the proposed approach achieves higher accuracy than the others such as SVMs+Gray-scale pixel, SVMs+Gabor and SVMs+LBP approach, more particularly, it has the lowest dimension of feature vector.

In computer vision, Local Binary Pattern (LBP) and Scale Invariant Feature Transform (SIFT) are two widely used local descriptors. In this paper, we propose to combine them effectively for scene categorization. First, LBP and SIFT features are regularly extracted from training images for constructing a LBP feature codebook and a SIFT feature codebook. Then, a two-dimensional table is created by combining the obtained codebooks. For creating a representation for an image, LBP and SIFT features extracted from the same positions of the image are encoded together based on sparse coding by using the two-dimensional table. After processing all features in the input image, we adopt spatial max pooling to determine its representation. Obtained image representations are forwarded to a Support Vector Machine classifier for categorization. In addition, in order to improve the scene categorization performance further, we propose a method to select correlated visual words from large codebooks for constructing the two-dimensional table. Finally, for evaluating the proposed method, extensive experiments are implemented on datasets Scene Categories 8, Scene Categories 15 and MIT 67 Indoor Scene. It is demonstrated that the proposed method is effective for scene categorization.

Based on neural network and local binary pattern algorithm, this paper builds a lightweight artificial face recognition system on chip Firefly-RK3399, with high speed, strong robustness and high recognition accuracy. Our embedded artificial intelligent face recognition system mainly consists of face detection, feature extraction and recognition. Multi-task convolutional neural network (MTCNN) under the CaffeOnACL framework is utilized for face detection, and the local binary pattern (LBP) is applied as face recognition algorithm. Experiments illustrate that our artificial intelligent embedded face recognition system has high speed and accuracy, which is easy-carrying and of high commercial value as well.

This work has the objective of developing a methodology for the classification of regions of interest (ROI) extracted from mammograms into masses and non-masses. To this end, we conducted a comparative study by combining several techniques in the various stages of the problem. We compared several texture-based techniques for the classification of ROIs. This study combines image processing, phylogenetic trees (PT), local binary patterns (LBP), support vector machines (SVM) and the micro-genetic algorithm (GA). The analysis of texture is performed, either through the combination PT/LBP or with grey levels, to compute the taxonomic diversity () and taxonomic distinction (*) indexes extracted from sub-regions (circular, circular crown, internal mask, external mask and the combination of internal and external mask) of an ROI. A GA is used to estimate the best phylogenetic weights. Then, its results are compared with the results achieved with the use of PT only. We also analyse the behaviour of the methodology when using the ROIs with and without enhancement. This enhancement consists of the application of a mean filter and the contrast-limited adaptive histogram equalisation (CLAHE). PTs and SVM were used to perform the selection of features. To evaluate the performance of the methodologies under analysis, we used the following metrics: sensitivity, specificity, accuracy and area under the receiver operating characteristic (ROC) curve (). Sensitivity and specificity measure the efficiency of the classifier at the correct detection of positive (masses) and negative (non-masses) cases, respectively. Accuracy measures the performance of the classification in both cases. The ROC curve is the graphical representation of the pairs (1-specificity, sensitivity). is the area formed by the ROC curve, which equals to 1 in an ideal test. The comparison of the possible combinations for each stage of the study revealed the following results. In the analyses without feature selection, the best results were (1) 100% accuracy and of 0.99 for the combination of PT, LBP and internal masks and (2) 99.5% accuracy and of 0.99 for the combination of GA, LBP and internal masks for the extraction of features. In the analyses with feature selection, the best results were (1) 100% accuracy and of 1.0 for the combination of GA and LBP (feature extraction) with the union of internal and external masks and (2) 98.5% accuracy and of 0.99 for the combination of PT, LBP and the union of internal and external masks.

Gender identification is a new domain in image recognition. Gender identification of human face is to judge one's gender according to his/her face features. The article adopted local binary pattern (LBP) algorithm to build feature subspaces, and processed data using Support Vector Machine (SVM) learning models. Experiments showed that integration of LBP algorithm with linear SVM and integration of LBP algorithm with low-order polynomial SVM are better than Gauss-kernel function.

Digital image manipulation has become increasingly prevalent due to the widespread availability of sophisticated image editing tools. In copy-move forgery, a portion of an image is copied and pasted into another area within the same image. The proposed methodology begins with extracting the image's Local Binary Pattern (LBP) algorithm features. Two main statistical functions, Stander Deviation (STD) and Angler Second Moment (ASM), are computed for each LBP feature, capturing additional statistical information about the local textures. Next, a multi-level LBP feature selection is applied to select the most relevant features. This process involves performing LBP computation at multiple scales or levels, capturing textures at different resolutions. By considering features from multiple levels, the detection algorithm can better capture both global and local characteristics of the manipulated regions, enhancing the accuracy of forgery detection. To achieve a high accuracy rate, this paper presents a variety of scenarios based on a machine-learning approach. In Copy-Move detection, artifacts and their properties are used as image features and support Vector Machine (SVM) to determine whether an image is tampered with. The dataset is manipulated to train and test each classifier; the target is to learn the discriminative patterns that detect instances of copy-move forgery. Media Integration and Call Center Forgery (MICC-F2000) were utilized in this paper. Experimental evaluations demonstrate the effectiveness of the proposed methodology in detecting copy-move. The implementation phases in the proposed work have produced encouraging outcomes. In the case of the best-implemented scenario involving multiple trials, the detection stage achieved a copy-move accuracy of 97.8 %.

Local Binary Patterns (LBP) is an effective texture description operator and the histogram that it generates has been proved to be a very useful texture feature to adapt to rotation and illumination. Using the LBP features as feature vectors in adaBoost classifier for target identification has become a trend. But LBP is bound by the scale transformation, so it is not widely used in adaBoost face detector. This paper proposes a scale transform formula for Local Binary Patterns. Based on this formula, LBP features extracted from single fixed size templates can be trained to identify any size of faces. This paper also proposes a method to obtain particular detecting sub-areas called binary ring-shaped sub-windows, which can keep the LBP features rotation invariant. Experimental results show that the method we proposed here is feasible in face detecting.

We investigated the feasibility of using multiresolution Local Binary Pattern (LBP) texture analysis to reduce falsepositive (FP) detection in a computerized mass detection framework. A new and novel approach for extracting LBP features is devised to differentiate masses and normal breast tissue on mammograms. In particular, to characterize the LBP texture patterns of the boundaries of masses, as well as to preserve the spatial structure pattern of the masses, two individual LBP texture patterns are then extracted from the core region and the ribbon region of pixels of the respective ROI regions, respectively. These two texture patterns are combined to produce the so-called multiresolution LBP feature of a given ROI. The proposed LBP texture analysis of the information in mass core region and its margin has clearly proven to be significant and is not sensitive to the precise location of the boundaries of masses. In this study, 89 mammograms were collected from the public MAIS database (DB). To perform a more realistic assessment of FP reduction process, the LBP texture analysis was applied directly to a total of 1,693 regions of interest (ROIs) automatically segmented by computer algorithm. Support Vector Machine (SVM) was applied for the classification of mass ROIs from ROIs containing normal tissue. Receiver Operating Characteristic (ROC) analysis was conducted to evaluate the classification accuracy and its improvement using multiresolution LBP features. With multiresolution LBP features, the classifier achieved an average area under the ROC curve, , z A of 0.956 during testing. In addition, the proposed LBP features outperform other state-of-the-arts features designed for false positive reduction.

Detecting the moving vehicles in jittering traffic scenes is a very difficult problem because of the complex environment. Only by the color features of the pixel or only by the texture features of image cannot establish a suitable background model for the moving vehicles. In order to solve this problem, the Gaussian pyramid layered algorithm is proposed, combining with the advantages of the Codebook algorithm and the Local binary patterns (LBP) algorithm. Firstly, the image pyramid is established to eliminate the noises generated by the camera shake. Then, codebook model and LBP model are constructed on the low-resolution level and the high-resolution level of Gaussian pyramid, respectively. At last, the final test results are obtained through a set of operations according to the spatial relations of pixels. The experimental results show that this algorithm can not only eliminate the noises effectively, but also save the calculating time with high detection sensitivity and high detection accuracy.

Acetabulum fractures are a clinical problem that primarily affects people between the ages of 21 and 30. The incidence of this type of injury has increased due to accidents involving both immediate and late implications. The analysis of an x-ray image is the first step in evaluating this type of injury and determining the type of treatment the patient should undergo. Identifying if the traumatic injury is located in the pelvis, is an acetabular fracture or not, serves as a support for all those orthopedic surgeons who have to deal with this type of injury. A method of X-ray image processing was proposed using the Local Binary Pattern (LBP) feature extractor and the Support Vector Machine (SVM) classification method. Also, the use of pre-processing methods to improve image quality is a key contribution. The results show 80% accuracy in classification using the CLAHE preprocessing method.

Cervical cancer is a global health problem that threatens the lives of women. Liquid-based cytology (LBC) is one of the most used techniques for diagnosing cervical cancer; converting from vitreous slides to whole-slide images (WSIs) allows images to be evaluated by artificial intelligence techniques. Because of the lack of cytologists and cytology devices, it is major to promote automated systems that receive and diagnose huge amounts of images quickly and accurately, which are useful in hospitals and clinical laboratories. This study aims to extract features in a hybrid method to obtain representative features to achieve promising results. Three proposed approaches have been applied with different methods and materials as follows: The first approach is a hybrid method called VGG-16 with SVM and GoogLeNet with SVM. The second approach is to classify the cervical abnormal cell images by ANN classifier with hybrid features extracted by the VGG-16 and GoogLeNet. A third approach is to classify the images of abnormal cervical cells by an ANN classifier with features extracted by the VGG-16 and GoogLeNet and combine them with hand-crafted features, which are extracted using Fuzzy Color Histogram (FCH), Gray Level Co-occurrence Matrix (GLCM) and Local Binary Pattern (LBP) algorithms. Based on the mixed features of CNN with features of FCH, GLCM, and LBP (hand-crafted), the ANN classifier reached the best results for diagnosing abnormal cells of the cervix. The ANN network achieved with the hybrid features of VGG-16 and hand-crafted an accuracy of 99.4%, specificity of 100%, sensitivity of 99.35%, AUC of 99.89% and precision of 99.42%.

A face occlusion detection scheme which is based on both skin color ratio (SCR) and Local Binary Pattern (LBP) feature, is proposed.The proposed method mainly consists of four steps: foreground extraction, head detection, feature extraction, and occlusion detection.First, foreground is extracted by codebook background subtraction algorithm.Then, the head region is located using HOG head detector.After that, the skin-color ratio and LBP feature are extracted.Finally, SVM is trained based on LBP feature.The recognition result of SVM and the result of skin-color ratio feature are merged by weighted voting strategy, and then occluded faces are classified as three categories: concealed, partially concealed, and visible.Experimental results show that the proposed detection system can achieve desirable results in intelligent video surveillance systems.