Random forest for intermediate descriptor fusion in shot boundary detection

Video Shot Boundary Detection (SBD) is the fundamental process towards video summarization and retrieval. A fast and efficient SBD algorithm is necessary for real-time video processing applications. Extensive work has focused on accurate shot boundary detection at the expense of demanding computational costs. In this paper, we propose a fast SBD approach that reduces the computation pixel-wise and frame-wise while still giving satisfactory accuracy. The proposed approach substantially speeds up the computation through reducing both detection region and scope. Color histogram and mutual information are used together to measure the difference between frames. Corner distribution of frames is utilized to exclude most of false boundaries. We conduct extensive experiments to evaluate the proposed approach, and the results show that our approach can not only speed up SBD, but also detect shot boundaries with high accuracy in both Cut (CUT) and Gradual Transition (GT) boundaries.

ABSTRACTThe proposed content-based video retrieval method in this study uses feature extraction, shot boundary detection, shot noise filter, shot cluster, the key feature set of shot extraction and shot classification. Shot boundary detection is conducted using a weight selection genetic algorithm. In order to verify the video retrieval method in this paper, three video databases were used in the experiment. These video databases are used to verify the shot boundary detection, the shot classification and video retrieval of this study. A series of comparisons and analyses were then conducted using the above video databases. The experiment results showed that the shot boundary detection method exhibits better performance than the other compared methods. Moreover, the video retrieval experiment results showed that the proposed method is able to precisely catch a shot in the search video, and do so with reduced video retrieval time.

In multimedia information retrieval, shot boundary detection is a very active research topic. In order to perform shot boundary detection, we propose an algorithm for modeling temporal statistics using a novel eigenspace updating method. The feature extracted from the current frame is compared with a model trained from features in the previous frames. A shot boundary is detected if the new feature does not fit well to the existing model. The model is based on principal component analysis (PCA), or the eigenspace method, in which the eigenspace can be updated to capture the non-stationary statistics of the features. The experiment results show that the proposed algorithm outperforms the traditional direct differencing method.

Many recent cases of illegal activities have been reported regarding the video and all the unlawful activities designed to destroy the originality of the video data. A slight modification can alter the meaning and intent of the video. Nowadays, many devices have gained the power of tapping or capturing digital video, and all these videos can be approved over the internet and many other unsafe channels. Therefore, the detection o of video authentication proving is a widespread and critical problem in various areas such as criminal, forensic investigations, and court cases. The preceding study proposed numerous techniques to ensure the authentication of video data and structure. This study emphasized retrieving a video structure to detect an alteration made in the video using shot boundary detection to prove authentication. The detection of shot boundary is a complicated task and is usually utilized for structured video because these techniques can identify modifications made with a fundamental shot change frequency. This study focuses on retrieving a video structure to detect an alteration made in the video by detecting shot boundary to prove authentication. The detection of shot boundary is a complicated task and is usually utilized for structured video because these techniques can identify modifications made with a regular shot change frequency. Furthermore, this study aims to develop a new model for video authentication detection using the shot boundary detection method, which is considered the practical tool to track down the originality based on their fundamental structure.

Colon cancer is cancer that is present on the inner side of colon walls or the rectum walls in the large intestine. Most of these types of cancer begin as abnormal growth of tissue called as polyp. Colonography uses low dose radiation Computed tomography (CT) scanning to obtain an interior view of the colon making use of special x-ray machine to view the large intestine for cancer and abnormal growths known as polyps. Radiologists examine these images to find polyp like structure using computer tools. As CT Colonography image contain noise such as lungs, small intestine, instruments during image capturing; segmenting colon from noise is the key task. Polyp occurrence can be detected mainly using shape feature; eliminating shapes similar to polyp is challenging. Hence, to tackle above issues, Image processing techniques are used by applying deep learning algorithm - Convolution Neural Network (CNN) and the results are compared with classical machine learning algorithm. In proposed method, each image is pre-processed to filter air filled dark region that includes colon, lungs etc. Next, each pre-processed CT Image separated into fixed number of blocks. Using pre-trained CNN, each block of ROI is classified as Type 1 (Usually Ascending and descending colon), Type 2 (Usually Traversal and sigmoidal colon) and Type3 (Noise such as lungs, instruments) to segment colon blocks by eliminating noise. Classified Blocks is further diagnosed for polyp like structure using pre-trained CNN by classifying each colon block as normal or abnormal. The experiment is setup with classical machine learning algorithms - Random Forest (RF) and k-nearest neighbor (KNN) by extracting texture feature - Local binary pattern (LBP) and shape feature - Histogram oriented gradient (HOG) for comparison. The experiment results showed the accuracy of proposed method for colon segmentation using CNN (87%) outperforms RF (85%) and KNN (83%). In, addition, the polyp detection accuracy of CNN (88%) is better than Random forest (85%) and KNN (80%). Hence, in the proposed method, there is significant accuracy improvement using deep learning algorithm compared to classical machine learning algorithms. It also provide baseline for automated colon cancer diagnosis using Deep learning algorithms for further research.

One of the most common causes of death worldwide is skin cancer and its incidence is increasing. To achieve optimal treatment and improve clinical outcomes for patients, precision skin cancer detection and classification approaches are required, which can be achieved through the application of feature extraction and machine learning algorithms. The development of such algorithms to identify important patterns from skin cancer image datasets enables early detection and more accurate classification and more effective treatment. Although previous studies have tried to detect skin cancer using feature extraction techniques such as HFF, HOG, and GLCM, some weaknesses still need to be improved. This research aims to combine various feature extraction methods such as Gray Level Co-occurrence Matrix, Histogram Oriented Gradients, and Local Binary Patterns and machine learning algorithms such as Support Vector Machine, Random Forest, and Gaussian Naïve Bayes in the classification process between Melanoma and Nevus skin cancers. In this research, the number of datasets used is 17,397 derived from the ISIC Dataset. The results showed that the Histogram Oriented Gradients method with Support Vector Machine algorithm achieved the highest accuracy of 92%. The combination of Gray Level Co-occurrence Matrix and Local Binary Patterns with Random Forest algorithm also achieved an accuracy of 92%, the combination of Gray Level Co-occurrence Matrix, Histogram Oriented Gradients, and Local Binary Patterns with Random Forest algorithm also resulted in an accuracy of 92%. These findings suggest that the combination of various feature extraction methods and machine learning algorithms can improve accuracy in skin cancer classification, which in turn can contribute to early detection and more effective treatment.

Face recognition is efficiently used in computer vision, pattern recognition, biometric, law enforcement, surveillance, criminal investigations, and missing person detection. However, face recognition is still a challenging task under variant illuminations, pose, expression, occlusion, and background. In this paper, we proposed a cascading of histogram of oriented gradients (HOG) and local binary pattern (LBP) feature extraction method on ORL face dataset, which can improve recognition rates while also addressing pose, scale, expression, and variant illumination issues. The facial recognition network was trained using various classifiers such as with KNN, SVM, and random forest (RF). The results have been shown that the accuracy rate of the combined LBP and HOG feature extraction method is better than individual LBP or HOG features for ORL database face recognition.

Palm print scanning is a widespread method for biometric identity detection which has some advantages over other methods including its simplicity and relatively lower cost. In this study, a novel methods for biometric verification and identification by contactless palm scanning technique is proposed. In the study, Ripplet-I Transform (R-IT) which is a generalized form of Curvelet Transform (CuT), have been used in addition to multi-resolution transforms which were previously used in the literature as palm print verification and identification methods such as Discrete Cosine Transform (DCT), Discrete Wavelet Transform (DWT), Contourlet Transform (CoT). In addition, Principal Component Analysis (PCA) and Local Binary Pattern (LBP) have been utilized to increase the algorithm diversity. In order to investigate the effect of classification methods on the study results and the processing times, Artificial Neural Network (ANN), Euclidean Distance (ED) and Support Vector Machine (SVM) have been used separately for matching in the verification part of study. The performance of Convolutional Neural Network (CNN) as a classifier has also been examined. Verification and identification algorithms proposed in the study have been tested using palm print images of Hong Kong Polytechnic University Contact-free 3D/2D Hand Images Database (Version 1.0). The studies, that were carried out under two main sections yielded interesting results. At the end of the study, AUC (Area Under the ROC Curve) values ranging from 0.550 (Equal Error Rate (EER)= 0.4594) to 0.9875 (EER= 0.0336) were obtained for palm print verification. The highest AUC value without using LBP was obtained as 0.9563 (EER= 0.1096) using R-IT/CuT+DCT+CNN. Study results were showed that CNN is more successful than other classifiers without using LBP. It also has pointed out that the R-IT/CuT provides better results than the DWT and CoT. Using LBP in algorithms has increased success for ED, SVM and ANN. However, it has reduced overall for CNN. The highest AUC value (0.9875 and EER= 0.0336) was provided by the LBP+DWT+ED algorithm for palm print verification. The highest Identification Rate (IR) was achieved by using the LBP+CoT+ED algorithm with 84.444% for for palm print identification.

In content-based video analysis, shot boundary detection is a common first step to segment video data into fundamental units of shots, each composing consecutive frames filmed with a single camera act. Many methods have been proposed in the literature for detection of shot boundaries. In this paper, we propose a new and effective post-refinement method on the detected shot boundaries by performing sequential detection of abrupt change in two underlying distributions. Experimental results show that the proposed method can eliminate most false detections and also recover many missed detections from the original detected shot boundaries, attaining better detection performance.

Investigation of acoustic and visual features for pig cough classification

One of the essential pre-processing steps of semantic video analysis is the video shot boundary detection (SBD). It is the primary step to segment the sequence of video frames into shots. Many SBD systems using supervised learning have been proposed for years; however, the training process still remains its principal limitation. In this paper, a multi-modal visual features-based SBD framework is employed that aims to analyze the behaviors of visual representation in terms of the discontinuity signal. We adopt a candidate segment selection that performs without the threshold calculation but uses the cumulative moving average of the discontinuity signal to identify the position of shot boundaries and neglect the non-boundary video frames. The transition detection is structurally performed to distinguish candidate segment into a cut transition and a gradual transition, including fade in/out and logo occurrence. Experimental results are evaluated using the golf video clips and the TREC2001 documentary video data set. Results show that the proposed SBD framework can achieve good accuracy in both types of video data set compared with other proposed SBD methods.

A video segmentation method is proposed in this paper. For abrupt cut detection, inter-frame similarities are computed using gray-level and edge histograms and a cut is declared when the similarities are under the predetermined threshold value. Gradual shot boundary detection is decided based on the similarities between the current frame and the previous shot boundary frame. Correlation coefficients are used to obtain universal threshold values, which are applied to various video data. Experimental results show that the proposed method provides 95% recall and 80% precision rates for abrupt cuts, and 83% recall and 54% precision rates for gradual changes.

Shot boundary detection (SBD) is the first step in video management and retrieval system. Existing SBD techniques, however, are mostly based on original frame histograms, which process too much data and are sensitive to flashes and small motions. Furthermore, they mainly perform boundary detection between each two frames, which are unreliable when there appear noises. To address these problems, we investigate a wavelet based shot boundary detection technique. It employs wavelet transform to get thumbnails of the original frames. Furthermore, it employs between cluster distances instead of adjacent distances to detect boundary and is robust to noises. Extensive experiments have been carried out on the platform of TRECVID benchmark. The experimental results show that the proposed technique outmatches some others and achieves satisfactory results.

A real-time mouse cursor control system using static gestures was designed to achieve the goal of human-computer interaction (HCI) in this paper. The system uses the computer’s own camera or external USB camera to collect video data, detect and recognize gestures of people in the video, and control the cursor movement or click in real time based on the gesture. To improve the recognition accuracy of hand gesture images detection, a method of hand gesture images detection based on PHOG + Improved LBP + K-NN was proposed in this paper. In order to improve the real-time performance of the system, the system determines whether the current frame has human hands by skin color detection. When human hands are detected, Pyramid Histogram of Oriented Gradients (PHOG) features and the improved Local Binary Pattern (LBP) features are further extracted. After fusing PHOG features and improved LBP features, k-nearest neighbor classification (K-NN) is used to implement gesture recognition. Six different gestures were tested 50 times with different angles, different lights and no skin tone in the background. The experimental results show that the system has good recognition performance.

Diabetic Retinopathy (DR) is a microangiopathic complication of diabetes mellitus that can cause visual impairment to permanent blindness. Early detection of DR is essential to prevent disease progression, but conventional methods require time, cost, and expertise that are not always available. This study aims to compare the performance of the Random Forest (RF) and Support Vector Machine (SVM) algorithms in DR classification based on texture features extracted from retinal fundus images. The dataset used consists of 3,000 retinal fundus images obtained from the Kaggle platform, divided into 2,400 training data and 600 test data. Image preprocessing includes conversion to grayscale, resizing to a resolution of 128×128 pixels, and normalization. Feature extraction is performed using a combination of Local Binary Pattern (LBP) and Gray Level Co-occurrence Matrix (GLCM) to produce a 14-dimensional feature vector. Performance evaluation uses accuracy, precision, recall, F1-score, ROC curve, and 5-fold cross-validation metrics. The results showed that Random Forest significantly outperformed SVM with an accuracy of 96% compared to 64%, an AUC value of 0.99 compared to 0.72, and an average cross-validation accuracy of 94.5% compared to 63.42%. Random Forest also showed balanced performance in both classes with precision, recall, and F1-score of 0.96, while SVM experienced classification imbalance especially in the disease class. This study proves that Random Forest is a more optimal algorithm for an automatic DR detection system based on fundus image texture features and can support increasing the accessibility of DR screening in areas with limited specialist medical personnel.