Real-Time Human Action Recognition in Video Surveillance Using Machine Learning

Human Action Recognition (HAR) is the process of understanding human actions and behavior. HAR has a broad range of applications, and it has been focused on increasing the attention in various domain of computed vision. Abnormal detection from video stream is vigorous to guarantee the security in both outside spaces with the internal. Furthermore, the abnormal actions are really infrequent and rare, which makes the supervision process more challenging and difficult. In this research, skeleton graph-based Convolutional Neural Network (CNN) is devised for human abnormal activity detection. Here, the skeleton graph-based CNN (Skeleton graph_CNN) is devised based on the concept of classical convolution and skeleton graph generation. The human action recognition classifies the human actions into normal and abnormal class. The abnormal actions from the recognized outcome are detected with Skeleton graph_CNN, which provides the various actions of human as an output. The Skeleton graph_CNNgenerates the skeleton shaped human structure by connecting the joints within the frame to consecutive frames. Moreover, the HAR is carried out using IITB-Corridor Dataset based on metrics, such as testing accuracy of 0.961, sensitivity of 0.956 and specificity of 0.960, correspondingly.

In the field of medicine, with the introduction of computer systems that can collect and analyze massive amounts of data, many non-invasive diagnostic methods are being developed for a variety of conditions. In this study, our aim is to develop a non-invasive method of classifying respiratory sounds that are recorded by an electronic stethoscope and the audio recording software that uses various machine learning algorithms.In order to store respiratory sounds on a computer, we developed a cost-effective and easy-to-use electronic stethoscope that can be used with any device. Using this device, we recorded 17,930 lung sounds from 1630 subjects.We employed two types of machine learning algorithms; mel frequency cepstral coefficient (MFCC) features in a support vector machine (SVM) and spectrogram images in the convolutional neural network (CNN). Since using MFCC features with a SVM algorithm is a generally accepted classification method for audio, we utilized its results to benchmark the CNN algorithm. We prepared four data sets for each CNN and SVM algorithm to classify respiratory audio: (1) healthy versus pathological classification; (2) rale, rhonchus, and normal sound classification; (3) singular respiratory sound type classification; and (4) audio type classification with all sound types. Accuracy results of the experiments were; (1) CNN 86%, SVM 86%, (2) CNN 76%, SVM 75%, (3) CNN 80%, SVM 80%, and (4) CNN 62%, SVM 62%, respectively.As a result, we found out that spectrogram image classification with CNN algorithm works as well as the SVM algorithm, and given the large amount of data, CNN and SVM machine learning algorithms can accurately classify and pre-diagnose respiratory audio.

This study aims to evaluate the effectiveness of the Convolutional Neural Network ( CNN ) method combined with Support Vector Machine ( SVM ) in detecting URLs.Phishing.Phishing is one of the significant cyber threats, where attackers try to trick users into providing sensitive information through fake websites.With the increasing number of phishing attacks , there is a need for effective methods to detect and prevent this threat.In this study, a dataset containing URLs phishing and non-phishing data were used to train the CNN -SVM model .The training process involved feature extraction from URLs using CNN , which is capable of capturing complex patterns in the data, followed by classification using SVM , which is known for its ability to handle high-dimensional data.Testing was conducted across nine different scenarios to evaluate the performance of the model under various conditions.The test results showed that the hybrid CNN -SVM model achieved a precision of 95%, a recall of 92%, and an F1-Score of 93%, with an overall accuracy of 94%.These results indicate that the model is not only effective in detecting URLs phishing , but also has a good balance between precision and recall.This study indicates that the combination of CNN and SVM can be an effective solution for detecting URLs phishing , making a significant contribution to the development of better cyber security systems.

Convolutional neural networks (CNNs) are being used in this paper to investigate waste classification. The study compared the categorization of three waste categories (plastic, paper, and metal) using a CNN and a Support Vector Machine (SVM). The results showed that while the SVM had an accuracy of 94.8%, the CNN's accuracy was lower at 83%. Another study divided waste into six categories and showed that the classification accuracy was 22% with a CNN, while the SVM had a test accuracy of 63%. The authors noted challenges in optimizing the hyperparameters, which prevented the CNN from being trained to its full potential. However, they concluded that the CNN should attain higher accuracy levels than the SVM once these challenges are overcome. The authors also used two popular CNN architectures, VGG16 and FastNet-34, in their proposed model for waste classification. The dataset used for the model was provided by Kaggle and consisted of 22564 waste photos divided into recyclable (R) and organic (O) categories. The results of the proposed model showed improved accuracy in waste classification compared to previous studies. The study highlights the potential for the use of CNNs in the field of waste management but highlights the importance of overcoming challenges in hyperparameter optimization for higher computer vision accuracy.

Emotion recognition plays a pivotal role in advancing Human-Computer Interaction (HCI) by enabling systems to understand and respond to human emotional states. Among various modalities, Speech Emotion Recognition (SER) stands out as a non-invasive, cost-effective, and temporally efficient approach for detecting emotions. This study leverages the RAVDESS dataset, which provides high-quality audio recordings for emotion classification. The proposed methodology involves preprocessing audio signals to remove noise, extracting temporal and spectral features in both time and frequency domains, and implementing machine learning models for multi-class emotion classification. The study evaluates and compares the performance of several classification models, including Random Forest (RF), Multilayer Perceptron (MLP), Support Vector Machine (SVM), Convolutional Neural Networks (CNN), and Decision Trees (DT). Experimental results demonstrate promising accuracy levels, highlighting the potential of these machine learning techniques in SER. This research contributes to the integration of SER within Brain-Computer Interfaces (BCI) and other emotion-aware applications, paving the way for enhanced interactive systems. Keywords – Speech Emotion Recognition -Machine Learning - Random Forest -Multilayer Perceptron - Support Vector Machine - Convolutional Neural Networks - Decision Tree - RAVDESS Dataset

Among the list of dreadful diseases, 'Brain Tumor and Brain Cancer' is one of them. According to survival rate, after the detection of cancerous Brain or Central Nervous System (CNS) tumor, 34% of men and 36% of women survive at least 5 years. Therefore, 'Early Detection of tumor' can be a savior for so many lives and artificial intelligence will make the way very accurate and appropriate. A new non-invasive approach to detect brain tumors in early-stage, cost-efficiently with the lowest risk factor is-'Liquid Biopsy'. It is a technique for analyzing non-solid biological tissue, i.e. - blood, plasma, cerebrospinal fluid (CSF). As human inspection maybe error full and inaccurate, in this paper, we have used 'k-means clustering' in 'Image Processing' as visual perception of artificial intelligence for detection of 'CTC' and we have used the technique 'Convolutional Neural Network' (CNN) for ctDNA detection and 'Support Vector Machine'(SVM) algorithm for classification of ctDNA and normal cell-free DNA (cfDNA). 'ctDNA' could provide clues for growth factor of cancerous cells, type of tumors, location, etc. Therefore, our work provides a new way to early detection and a new prospect for early cure.

Detection of brain tumor is very challenging task in today’s medical world. Nowadays, many doctors prefer ready-made methods to diagnose the tumor from given magnetic resonance imaging (MRI) images. Accurate and less time-consuming methods are used frequently to identify it. This paper introduces new techniques for finding and differentiating brain tumors. The new methods include support vector machine (SVM) and convolution neural network (CNN) with Softmax classifier. The SVM uses histogram of oriented gradients (HOGs) as a feature to label the given dataset. Further, the same feature of the test image is verified against labeled sets and classified. The SVM gives accuracy of 87.33%. In CNN, multilayer structure is used. It contains a convolution layer followed by the pooling layer and finally fully connected layer. In CNN, specifically, Alexnet is preferred for classification. In Alexnet, rectified linear unit (ReLU) is used as an activation function. At the output of it, Softmax is used as activation to classify the images. The CNN with Softmax classifier gives improved accuracy of 98.68%. In addition, the performance measures are also found out such as specificity, sensitivity, and precision. The sensitivity with SVM is 93.18%, and with CNN, it increases up to 100%. Comparing both methods with the obtained results, the CNN with Softmax classifier gives better results. Proposed method with CNN produces only one misclassified image as an advantage over the existing method, while SVM gives nine misclassified images. The methods are tested on 253 MRI images which are detected and classified correctly with Matlab.KeywordsSVMCNNHOGMRI

Understanding human behavior and human action recognition are both essential components of effective surveillance video analysis for the purpose of guaranteeing public safety. However, existing approaches such as three-dimensional convolutional neural networks (3D CNN) and two-stream neural networks (2SNN) have computational hurdles due to the significant parameterization they require. In this paper, we offer HARNet, a specialized lightweight residual 3D CNN that is built on directed acyclic graphs and was created expressly to handle these issues and achieve effective human action detection. The suggested method presents an innovative pipeline for creating spatial motion data from raw video inputs, which makes successful latent representation learning of human motions easier to accomplish. This generated input is then supplied into HARNet, which processes spatial and motion information in a single stream in an effective manner, maximizing the benefits of both types of cues. The use of traditional machine learning classifiers is done in order to further improve the discriminative capacity of the features that have been learned. To be more specific, we use the latent representations that are stored in HARNet’s fully connected layer and use them as our deep learnt features. After that, these features are entered into the Support Vector Machine (SVM) classifier in order to accomplish action recognition. In order to evaluate the HARNet-SVM method that was developed, empirical tests were run on commonly used action recognition datasets such as UCF101, HMDB51, and the KTH dataset. These tests were carried out in order to gather data for the evaluation. The experimental results show that our method is superior to other state-of-the-art approaches, achieving considerable performance increases of 2.75% on UCF101, 10.94% on HMDB51, and 0.18% on the KTH dataset. These results were obtained by running the method on each dataset separately. Our findings demonstrate the usefulness of HARNet’s lightweight design and highlight the significance of utilizing SVM classifiers with deep learnt features for the purpose of accurate and computationally efficient human activity recognition in surveillance videos. This work helps to the advancement of surveillance technology, which in turn makes video analysis in applications that take place in the real world safer and more dependable.

Recognizing different human actions from still images or videos is an important research area in the computer vision and artificial intelligence domains. It represents a key step for a wide range of applications including: human-computer interaction, ambient assisted living, intelligent driving and video surveillance. However, unless the many research works being involved, there are still many challenges ahead including: the high changes in human body shapes, clothing and viewpoint changes and the conditions of system acquisition (illumination variations, occlusions, etc.). With the emergence of new deep learning techniques, many approaches are recently proposed for Human Action Recognition (HAR). Compared with conventional machine learning methods, deep learning techniques have more powerful learning ability. The most wide-spread deep learning approach is the Convolutional Neural Network (CNN/ConvNets). It has shown remarkable achievements due to its precision and robustness. As a branch of neural network, 3D CNN is a relatively new technique in the field of deep learning. In this paper, we propose a HAR approach based on a 3D CNN model. We apply the developed model to recognize human actions of KTH and J-HMDB datasets, and we achieve state of the art performance in comparison to baseline methods.

We aimed to assess the ability of deep learning (DL) and support vector machine (SVM) to detect a nonperfusion area (NPA) caused by retinal vein occlusion (RVO) with optical coherence tomography angiography (OCTA) images. The study included 322 OCTA images (normal: 148; NPA owing to RVO: 174 [128 branch RVO images and 46 central RVO images]). Training to construct the DL model using deep convolutional neural network (DNN) algorithms was provided using OCTA images. The SVM used a scikit-learn library with a radial basis function kernel. The area under the curve (AUC), sensitivity and specificity for detecting an NPA were examined. We compared the diagnostic ability (sensitivity, specificity and average required time) between the DNN, SVM and seven ophthalmologists. Heat maps were generated. With regard to the DNN, the mean AUC, sensitivity, specificity and average required time for distinguishing RVO OCTA images with an NPA from normal OCTA images were 0.986, 93.7%, 97.3% and 176.9 s, respectively. With regard to SVM, the mean AUC, sensitivity, and specificity were 0.880, 79.3%, and 81.1%, respectively. With regard to the seven ophthalmologists, the mean AUC, sensitivity, specificity and average required time were 0.962, 90.8%, 89.2%, and 700.6 s, respectively. The DNN focused on the foveal avascular zone and NPA in heat maps. The performance of the DNN was significantly better than that of SVM in all parameters (p < 0.01, all) and that of the ophthalmologists in AUC and specificity (p < 0.01, all). The combination of DL and OCTA images had high accuracy for the detection of an NPA, and it might be useful in clinical practice and retinal screening.

&lt;p class="Normal1"&gt;Medicinal plants have been found and utilized in traditional medical practices from ancient times. Many medicinal plants play a vital role in curating many life threatening diseases. Very few of the medicinal herbs are commercially cultivated. Many plant diseases are there which destroys these medicinal plants. Early detection of plant diseases can prevent the huge loss of these medicinal plants. Here, we presented a hybrid model that makes use of SVM along with the traditional convolutional neural network (CNN) for predicting &lt;em&gt;Basil&lt;/em&gt; plants leaves diseases. We transformed the conventional CNN model by adding a classification layer Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) after feature extraction and this approach tends to perform better than traditional CNN as we make the dataset balanced by data augmentation and SVN and KNN tend to perform better in case of balanced samples. CNN is used for training, SVM/KNN is used for classification. The advantages of CNN and SVM are used in proposed the CNN and SVM and KNN model. It is assumed that such a combined model would incorporate the benefits of CNN and SVM. Here, we identified the four types of diseases that affect &lt;em&gt;basil&lt;/em&gt; plant leaves as Leaf spot, Downy mildew, Fusarium wilt, Fungal, and Healthy. Since there isn’t a standard dataset for &lt;em&gt;basil&lt;/em&gt; leaves, we created our own 803 picture data set and used various machine learning techniques to train and evaluate the model. However, over other existing algorithms, our hybrid model i.e., CNN+SVM has produced more accurate results. For five classes of &lt;em&gt;basil&lt;/em&gt; plant leaves, the proposed model produced 95.02% accuracy of for leaf diseases.&lt;/p&gt;

Image segmentation of brain low-grade glioma (LGG) magnetic resonance imaging (MRI) contributes tremendously to diagnosis, classification and treatment of the disease. A tangible, accurate, reliable and fast image segmentation technique is demanded in clinical diagnosis and research. The emerging machine learning technique has been demonstrated its unique capability in the field of medical image processing, including medical image segmentation. Support vector machine (SVM) and convolutional neural network (CNN) are two widely used machine learning methods. In this work, image segmentation tools based on SVM and CNN are developed and evaluated for brain LGG MR image segmentation studies. The segmentation performance in terms of accuracy and cost is quantitatively analyzed and compared between the SVM and CNN techniques developed. Computed on the Google CoLab, each of the 109 SVM models represents an individual patient, is trained using a single image of that patient and takes a few seconds to complete. The CNN model is trained on a drastically larger dataset of 19,760 data augmented images and takes approximately 2 hours to obtain the most optimal result. The SVM models achieved an average and median accuracy of 0.937 and 0.976 respectively, precision of 0.456 and 0.535 respectively, recall of 0.878 and 0.906 respectively, and F1 score of 0.546 and 0.662 respectively. Although the CNN model required a significantly longer calculation time, it surpassed the SVM models in performance in LGG MR image segmentation, achieving an accuracy of 0.998, a precision of 0.999, a recall of 0.999 and an F1 score of 0.999. This study shows that SVM with appropriate filtering techniques is capable of obtaining reliable and fast segmentation of brain LGG MR images with sufficient accuracy and limited image data. CNN technique outperforms SVM in the accuracy of segmentation with requirements of significantly enlarged data set, long computation time and high-performance computer.

Convolutional neural networks (CNNs) have demonstrated the state-of-the-art performances on automatic speech recognition. Softmax activation function for prediction and minimizing the cross-entropy loss is employed by most of the CNNs. This paper proposes a new deep architecture in which two heterogeneous classification techniques named as CNN and support vector machines (SVMs) are combined together. In this proposed model, features are learned using convolution layer and classified by SVMs. The last layer of CNN i.e. softmax layer is replaced by SVMs to efficiently deal with high dimensional features. This model should be interpreted as a special form of structured SVM and named as convolutional support vector machine (CSVM). Instead of training each component separately, the parameters of CNN and SVMs are jointly trained using frame level max-margin, sequence level max-margin, and state-level minimum Bayes risk criterion. The performance of CSVM is checked on TIMIT and Wall Street Journal datasets for phone recognition. By incorporating the features of both CNN and SVMs, CSVM improves the result by 13.33% and 2.31% over baseline CNN and segmental recurrent neural networks respectively.

The coronavirus COVID-19 pandemic has caused a global health crisis. According to According to the World Health Assembly, one of the best preventative measures is to wear a face mask while out outdoors (WHO). This work presents a hybrid model for face mask identification that combines deep and traditional machine learning. I have trained the proposed system, which consists of convolutional neural networks (ConNN), support vector machines (SVM), and random forests (RF), in three stages, the first stage, used ConNN, the second stage, used the same ConNN with the SVM method, and in the third stage, used ConNN and RF. This paper suggests three different kinds of masked face recognition datasets: the Incorrectly Masked Face Dataset (IMFD), the Correctly Masked Face Dataset (CMFD), and the combination for MaskedFace-Net, a worldwide masked face detection system. Two objectives are presented for the realistic masked face datasets: i) to identify individuals whose faces are covered or not covered, ii) to identify faces whose masks are put on properly or improperly (for example, at airport entrances or among crowds). The suggested model is made up of two parts. The first part is designed for feature extraction using a convolutional neural networks. In contrast, the second section is made to classify face masks using SVM and RF methods. The ConNN achieved 99.92%. and achieved for ConNN and SVM 99.94%. ConNN and RF 98.79%. Moreover,The system has been tested in real world scenarios and can recognize and classify any image selected by Google with high accuracy. we a comparison and the results aim to evaluate the proposed model.

To evaluate the feasibility of a convolutional neural network (CNN) with word embedding to identify the type and severity of patient safety incident reports. A CNN with word embedding was applied to identify 10 incident types and 4 severity levels. Model training and validation used data sets (n_type = 2860, n_severity = 1160) collected from a statewide incident reporting system. Generalizability was evaluated using an independent hospital-level reporting system. CNN architectures were examined by varying layer size and hyperparameters. Performance was evaluated by F score, precision, recall, and compared to binary support vector machine (SVM) ensembles on 3 testing data sets (type/severity: n_benchmark = 286/116, n_original = 444/4837, n_independent = 6000/5950). A CNN with 6 layers was the most effective architecture, outperforming SVMs with better generalizability to identify incidents by type and severity. The CNN achieved high F scores (> 85%) across all test data sets when identifying common incident types including falls, medications, pressure injury, and aggression. When identifying common severity levels (medium/low), CNN outperformed SVMs, improving F scores by 11.9%-45.1% across all 3 test data sets. Automated identification of incident reports using machine learning is challenging because of a lack of large labelled training data sets and the unbalanced distribution of incident classes. The standard classification strategy is to build multiple binary classifiers and pool their predictions. CNNs can extract hierarchical features and assist in addressing class imbalance, which may explain their success in identifying incident report types. A CNN with word embedding was effective in identifying incidents by type and severity, providing better generalizability than SVMs.