Sign language dactyl recognition based on machine learning algorithms

Sign language identification and recognition technique is composed by the gesture images detection and the hand gestures recognition. Gesture images detection is to locate the image part of palm and fingers from the captured pictures, and rotating them to the appropriate gesture posture. Both of them are the important pre-processing for sign language identification and recognition. Lose them, the correctness rate of the sign language recognition algorithms will be dropped down to an unacceptable level. This paper presents novel processing algorithms for the gesture images detection and recognition. In the detection process, it rotates an askew gesture to right position, and to delete the elbow and forearm parts from the captured pictures. In the recognition process, it includes two phases with the model construction and the sign language identification. In the model construction phase, the static hand gesture of sign language is constructed by the Gaussian mixture model, and the unknown gesture image is identified by Gaussian model match. Based on this presented static sign language detection and recognition algorithms, the correct recognition rate is about 94% in average.

Undernutrition among children under the age of five is a major public health concern, especially in developing countries. This study aimed to use machine learning (ML) algorithms to predict undernutrition and identify its associated factors. Secondary data analysis of the 2017 Multiple Indicator Cluster Survey (MICS) was performed using R and Python. The main outcomes of interest were undernutrition (stunting: height-for-age (HAZ) < -2 SD; wasting: weight-for-height (WHZ) < -2 SD; and underweight: weight-for-age (WAZ) < -2 SD). Seven ML algorithms were trained and tested: linear discriminant analysis (LDA), logistic model, support vector machine (SVM), random forest (RF), least absolute shrinkage and selection operator (LASSO), ridge regression, and extreme gradient boosting (XGBoost). The ML models were evaluated using the accuracy, confusion matrix, and area under the curve (AUC) receiver operating characteristics (ROC). In total, 8564 children were included in the final analysis. The average age of the children was 926 days, and the majority were females. The weighted prevalence rates of stunting, wasting, and underweight were 17%, 7%, and 12%, respectively. The accuracies of all the ML models for wasting were (LDA: 84%; Logistic: 95%; SVM: 92%; RF: 94%; LASSO: 96%; Ridge: 84%, XGBoost: 98%), stunting (LDA: 86%; Logistic: 86%; SVM: 98%; RF: 88%; LASSO: 86%; Ridge: 86%, XGBoost: 98%), and for underweight were (LDA: 90%; Logistic: 92%; SVM: 98%; RF: 89%; LASSO: 92%; Ridge: 88%, XGBoost: 98%). The AUC values of the wasting models were (LDA: 99%; Logistic: 100%; SVM: 72%; RF: 94%; LASSO: 99%; Ridge: 59%, XGBoost: 100%), for stunting were (LDA: 89%; Logistic: 90%; SVM: 100%; RF: 92%; LASSO: 90%; Ridge: 89%, XGBoost: 100%), and for underweight were (LDA: 95%; Logistic: 96%; SVM: 100%; RF: 94%; LASSO: 96%; Ridge: 82%, XGBoost: 82%). Age, weight, length/height, sex, region of residence and ethnicity were important predictors of wasting, stunting and underweight. The XGBoost model was the best model for predicting wasting, stunting, and underweight. The findings showed that different ML algorithms could be useful for predicting undernutrition and identifying important predictors for targeted interventions among children under five years in Ghana.

Sign language plays a crucial role as a communication tool for both the deaf and hard-of- hearing communities, enabling them to engage and interact effectively within their own community as well as with others.However, communication barriers arise when individuals unfamiliar with sign language engage with those who rely on it, underscoring the need for inclusive solutions. Real-time sign language interpretation systems, leveraging machine learning and computer vision technologies, present a promising approach to bridging this gap. These systems convert sign language gestures into spoken or written language by utilizing gesture recognition algorithms, neural networks, and natural language processing. By analyzing hand movements, facial expressions, and body language, the systems provide accurate, context-aware translations of various sign languages, such as American Sign Language (ASL), with minimal delay. This enables seamless, natural interactions, making such technologies essential for fostering inclusive communication in diverse settings. Key Words: Sign language recognition, real- time interpretation, machine learning, com- puter vision, gesture recognition, neural networks, natural language processing, communication barriers, inclusivity, American Sign Language (ASL).

Sign Language Recognition (SLR) targets on interpreting the sign language into text or speech, so as to facilitate the communication between deaf-mute people and ordinary people. The task has broad social impact, but is still very challenging due to the complexity and large variations in hand actions. Existing dataset for Sign Language Recognition (SLR) in Bangla Sign Language (BdSL) is based on RGB images. Recent research on sign language recognition has shown better recognition accuracy using depth-based features. In this paper, we present a complete dataset for Bangla sign digits from Zero (Shunno in Bangla) to Nine (Noy in Bangla) using MediaPipe, a cross-platform depth-map estimation framework. The proposed method can utilize hand skeleton joint points containing depth information in addition to x, y coordinates from RGB images only. To validate the effectiveness of our proposed approach, we have run MediaPipe on a benchmark American Sign Language (ASL) dataset. Running different classifiers in our proposed dataset we got 98.65% using Support Vector Machine (SVM). Moreover, we compared our dataset with the existing Bangla digit dataset Ishara Bochon using deep learning based approach and achieved significantly higher accuracy.

Sign Language Recognition is a vast domain with a variety of solutions available on the market which achieve the same results, translating hand gestures to text and/or audio. There is a plethora of sign languages used globally, but the mostreputed and commonly used sign language is the American Sign Language (ASL). ASL uses hand gestures and finger spelling to convey the English alphabets and words. The two methods of implementing sign language translation are: Image Processing and Gesture Recognition. The gesture recognition gloves available in the current market utilize expensive flex sensors to map the bend of the users’ fingers. This makes the overall cost of the gloves expensive. Through ‘‘ASL Sign Language Recognition Gloves we aim to implement gesture recognition with MEMS accelerometers that are comparatively cheaper and make the glove more affordable.

The predominant means of communication is speech; however, there are persons whose speaking or hearing abilities are impaired. Communication presents a significant barrier for persons with such disabilities. The primary objective of this work is to develop an efficient solution with machine learning for the speech and hearing impairment community with the help of AI. This study helps in the development of future technologies in the enhancement of communication accessibility. In the proposed work, a machine learning approach for the American Sign Language alphabet using image detection and processing techniques are utilized. The experiment was conducted using an American Sign Language recognition dataset obtained from Kaggle, which provides images of hand Gestures of the alphabet. The dataset was divided into training and testing subsets in the ratio of <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$80: 20$</tex>, where 80 % of the data was used in training the model and the remaining 20 % was designated for testing the model. The dataset was normalized using denoising filters and proceeded with Canny edge detection to highlight sharp edge features. From the edge detected image, Histogram of Oriented Gradient features were extracted to detect the letter and shape information. These extracted features are then fed into the classifiers: Support Vector Machine, Random Forest, and KNearest Neighbors. The study was analyzed by experimental results, which show that the Support Vector Machine classifier achieved the highest accuracy of 93.33 %, closely followed by Random Forest and K-Nearest Neighbors. The analysis confirms that applying edge-based preprocessing along with the Histogram of Oriented Gradients feature extraction enables an effective classification of American Sign Language alphabets. This Comparative study provides a solid foundation for developing low-complexity, high-accuracy sign language recognition systems.

Deaf and hard-of-hearing individuals use sign language as a means of communication. However, those around them, especially family members like the children of deaf adults, may face communication challenges if they are unfamiliar with sign language. This issue has prompted numerous researchers to conduct studies on sign language translation and recognition. However, there is currently no publicly available dataset specifically for Malaysian sign language. This article introduces an image dataset of the Malaysian Sign Language (MySL) hand gestures used in everyday situations. The dataset, named MyWSL2023, comprises 3,500 images of ten static Malaysian sign language words collected from five participants (two males and three females) aged between 20 and 21 years old. The data collection took place indoors under normal lighting conditions. The MyWSL2023 dataset, which has been made freely accessible to all researchers, serves as a valuable resource for not only investigating and developing automated systems for hearing-impaired and deaf individuals but also gesture and sign language recognition using vision-based methods. The dataset can be accessed for free at https://data.mendeley.com/datasets/zvk55p7ktd.

To construct and validate the best predictive model for 28-day death risk in patients with septic shock based on different supervised machine learning algorithms. The patients with septic shock meeting the Sepsis-3 criteria were selected from Medical Information Mart for Intensive Care-IV v2.0 (MIMIC-IV v2.0). According to the principle of random allocation, 70% of these patients were used as the training set, and 30% as the validation set. Relevant predictive variables were extracted from three aspects: demographic characteristics and basic vital signs, serum indicators within 24 hours of intensive care unit (ICU) admission and complications possibly affecting indicators, functional scoring and advanced life support. The predictive efficacy of models constructed using five mainstream machine learning algorithms including decision tree classification and regression tree (CART), random forest (RF), support vector machine (SVM), linear regression (LR), and super learner [SL; combined CART, RF and extreme gradient boosting (XGBoost)] for 28-day death in patients with septic shock was compared, and the best algorithm model was selected. The optimal predictive variables were determined by intersecting the results from LASSO regression, RF, and XGBoost algorithms, and a predictive model was constructed. The predictive efficacy of the model was validated by drawing receiver operator characteristic curve (ROC curve), the accuracy of the model was assessed using calibration curves, and the practicality of the model was verified through decision curve analysis (DCA). A total of 3 295 patients with septic shock were included, with 2 164 surviving and 1 131 dying within 28 days, resulting in a mortality of 34.32%. Of these, 2 307 were in the training set (with 792 deaths within 28 days, a mortality of 34.33%), and 988 in the validation set (with 339 deaths within 28 days, a mortality of 34.31%). Five machine learning models were established based on the training set data. After including variables at three aspects, the area under the ROC curve (AUC) of RF, SVM, and LR machine learning algorithm models for predicting 28-day death in septic shock patients in the validation set was 0.823 [95% confidence interval (95%CI) was 0.795-0.849], 0.823 (95%CI was 0.796-0.849), and 0.810 (95%CI was 0.782-0.838), respectively, which were higher than that of the CART algorithm model (AUC = 0.750, 95%CI was 0.717-0.782) and SL algorithm model (AUC = 0.756, 95%CI was 0.724-0.789). Thus above three algorithm models were determined to be the best algorithm models. After integrating variables from three aspects, 16 optimal predictive variables were identified through intersection by LASSO regression, RF, and XGBoost algorithms, including the highest pH value, the highest albumin (Alb), the highest body temperature, the lowest lactic acid (Lac), the highest Lac, the highest serum creatinine (SCr), the highest Ca2+, the lowest hemoglobin (Hb), the lowest white blood cell count (WBC), age, simplified acute physiology score III (SAPS III), the highest WBC, acute physiology score III (APS III), the lowest Na+, body mass index (BMI), and the shortest activated partial thromboplastin time (APTT) within 24 hours of ICU admission. ROC curve analysis showed that the Logistic regression model constructed with above 16 optimal predictive variables was the best predictive model, with an AUC of 0.806 (95%CI was 0.778-0.835) in the validation set. The calibration curve and DCA curve showed that this model had high accuracy and the highest net benefit could reach 0.3, which was significantly outperforming traditional models based on single functional score [APS III score, SAPS III score, and sequential organ failure assessment (SOFA) score] with AUC (95%CI) of 0.746 (0.715-0.778), 0.765 (0.734-0.796), and 0.625 (0.589-0.661), respectively. The Logistic regression model, constructed using 16 optimal predictive variables including pH value, Alb, body temperature, Lac, SCr, Ca2+, Hb, WBC, SAPS III score, APS III score, Na+, BMI, and APTT, is identified as the best predictive model for the 28-day death risk in patients with septic shock. Its performance is stable, with high discriminative ability and accuracy.

ABSTRACTAmong the focus of language policies addressing sign languages have been efforts to achieve official recognition for various national sign languages, coupled with the recognition of the language rights of d/Deaf people. The recognition of sign languages has most often taken place as a result of lobbying efforts by national Deaf communities, generally with the support of sympathetic hearing supporters. As a rule, efforts to grant official recognition to sign languages are seen as progressive undertakings, but such recognition is almost always grounded both ideologically and epistemologically in misguided views of d/Deaf people. The author provides a distinction between different kinds of language policies concerned with sign languages and suggests that policies granting official recognition to sign languages are fundamentally different in nature from language policies granting such status to spoken languages. The author argues that this difference is due to fundamentally indefensible assumptions about the legitimacy of sign languages as full and complete human languages. Finally, the implications for the language rights of sign language peoples that emerge from this unique nature of language policies for sign languages will be explored.

Air pollution in Macau has become a serious problem following the Pearl River Delta’s (PRD) rapid industrialization that began in the 1990s. With this in mind, Macau needs an air quality forecast system that accurately predicts pollutant concentration during the occurrence of pollution episodes to warn the public ahead of time. Five different state-of-the-art machine learning (ML) algorithms were applied to create predictive models to forecast PM2.5, PM10, and CO concentrations for the next 24 and 48 h, which included artificial neural networks (ANN), random forest (RF), extreme gradient boosting (XGBoost), support vector machine (SVM), and multiple linear regression (MLR), to determine the best ML algorithms for the respective pollutants and time scale. The diurnal measurements of air quality data in Macau from 2016 to 2021 were obtained for this work. The 2020 and 2021 datasets were used for model testing, while the four-year data before 2020 and 2021 were used to build and train the ML models. Results show that the ANN, RF, XGBoost, SVM, and MLR models were able to provide good performance in building up a 24-h forecast with a higher coefficient of determination (R2) and lower root mean square error (RMSE), mean absolute error (MAE), and biases (BIAS). Meanwhile, all the ML models in the 48-h forecasting performance were satisfactory enough to be accepted as a two-day continuous forecast even if the R2 value was lower than the 24-h forecast. The 48-h forecasting model could be further improved by proper feature selection based on the 24-h dataset, using the Shapley Additive Explanations (SHAP) value test and the adjusted R2 value of the 48-h forecasting model. In conclusion, the above five ML algorithms were able to successfully forecast the 24 and 48 h of pollutant concentration in Macau, with the RF and SVM models performing the best in the prediction of PM2.5 and PM10, and CO in both 24 and 48-h forecasts.

A variety of algorithms allows gesture recognition in video sequences. Alleviating the need for interpreters is of interest to hearing impaired people, since it allows a great degree of self-sufficiency in communicating their intent to the non-sign language speakers without the need for interpreters. State-of-theart in currently used algorithms in this domain is capable of either real-time recognition of sign language in low resolution videos or non-real-time recognition in high-resolution videos. This paper proposes a novel approach to real-time recognition of fingerspelling alphabet letters of American Sign Language (ASL) in ultra-high-resolution (UHD) video sequences. The proposed approach is based on adaptive Laplacian of Gaussian (LoG) filtering with local extrema detection using Features from Accelerated Segment Test (FAST) algorithm classified by a Convolutional Neural Network (CNN). The recognition rate of our algorithm was verified on real-life data.

Land-cover classification using remote sensing imagery is an important part of environmental research because it provides baseline information for ecological vulnerability and risk assessment, disaster management, landscape conservation, local and regional planning, and so on. Rural-land-cover classification is challenging for both object-based image analysis methods and classifiers. The objective of this study is to improve the object-oriented classification accuracy of rural land cover by combining two models based on high spatial resolution imagery. We apply the C5.0 algorithm in R to combine support vector machines (SVMs) and random forest (RF) to create the model RS_C5.0. The effectiveness of the model combination is assessed by comparing the classification results with the state-of-the-art machine learning algorithm, namely extreme gradient boosting (XGBoost). The comparisons are done based on the classification results of both the study area and the case area. Results show that in the classification of the study area, RF performs slightly better than SVM, and XGBoost performs worse than RF but better than SVM. However, in the classification of the case area, SVM performs slightly better than RF and both SVM and RF perform better than XGBoost. Furthermore, RS_C5.0 obtains the highest overall accuracies and kappa coefficients in the classifications of both the study area and the case area. In terms of training time, XGBoost runs the slowest in the classifications of both the study area and the case area. SVM and RF as well as the combined model (RS_C5.0) run much faster than XGBoost classifier. To summarize, the combination of SVM and RF classifiers using C5.0 algorithm is found to be a fast and effective way to improve rural-land-cover classification.

Sign Language is the main communication medium for people who have a difficulty with speaking or hearing. To communicate with other deaf or healthy people, they use sign language. Deaf and mute people of Bangladesh and India use Bangla sign language to fulfill their communication needs. But, the learning process of sign language is time consuming and arduous. Therefore, as the artificial intelligence technology advances, automatic recognition of Bangla sign language is gaining more attention from researchers. In this paper, the proposed research aims to develop an approach to automate the identification of Bangla Sign Digits comparing the efficacy of handcrafted and deep neural network features. The handcrafted feature extractors like Histogram of Oriented Gradient (HOG), Scale invariant feature transform (SIFT), and pre-trained deep neural network feature extractors such as InceptionV3, Xception, and DenseNet-121 was used on publicly available Ishara-Lipi dataset to extract features. Moreover, to recognize sign digits, we used three fine-tuned classification algorithms namely K-Nearest Neighbor (KNN), Random Forest (RF), Support Vector Machine (SVM) that were fed by extracted features. Experimental result shows that the deep neural network features outperformed the handcrafted features based approach. DenseNet-121 combined with SVM based approach achieved highest test accuracy of 99.53% on Ishara-Lipi dataset.

India is ranked 120th among 122 countries globally in WaterAid&amp;#8217;s water quality index. Regular water quality monitoring is essential to determine which inland water bodies are experiencing depreciating water quality. Long-term trends have been obtained using satellite remote sensing, necessitating multiple image analysis. The computational burden of processing numerous satellite images can be reduced using Google Earth Engine&amp;#8217;s (GEE) cloud computing capabilities. Thorough research was conducted to determine the global spatio-temporal and biochemical factors impacting surface water quality (WQ). The public availability of geospatial datasets and free access to cloud-based geo-computing platforms such as GEE are widely used for spatio-temporal mapping, global surface water monitoring, water quality parametric variation, and real-time forecasting. Many researchers have recently focused on improving data mining and machine learning algorithms to accurately deal with image classification and predictive problems for crop identification and monitoring. In the present study, we propose to define band spectral ratios, spectral band equations, and empirical models for water quality parameters. A few neural network models will be used to (i) query and pre-process satellite earth observations that coincide with the study area, (ii) extract the spectra, and (iii) use spectral band wavelength charts, time-series charts, spatial-distribution maps, and the development of an online dashboard application to visualize the results graphically upon using integrated Landsat (8,9), Sentinel-2A/B and PlanetScope satellite data for the pre-monsoon and post-monsoon seasons in 2023 in the pan-India region. MODIS-TERRA provides LST spatial-temporal monitoring. In this, we have assessed and compared the performance of CART, SVM, and RF ML algorithms. We found that RF outperforms CART and SVM algorithms in the GEE platform with PlanetScope data (80.71% overall accuracy (OA) with Kappa 0.89) and also with the integration of PlanetScope and Sentinel-2A/B data (OA = 85.53%, Kappa 0.91). But CART outperforms RF and SVM algorithms with Sentiel-2A/B data (OA = 81.59%, Kappa 0.85). The SAM technique, spectral feature fitting, continuum band removal, and other band-spectral ratio techniques are employed for quantitative hyperspectral data analysis. Specifically, the performance metrics of XGBoost and SGD for both Chl-a (R^2 = 0.818) and Turbidity (R^2 = 0.815) models exhibited robust accuracy. We have also developed a Google API-based JavaScript code that can be tested under complex coastal shores, challenging inundation and variable climatic conditions. Our method provides the end-to-end cloud computing workflow shown in this research, considering cost and computational efficiency for timely information delivery.Keywords: Classification and Regression Trees (CART), Chlorophyll-a (conc), Color dissolved organic matter (CDOM), Composite water management index (CWMI), Environmental Mapping and Analysis Program (EnMAP), Land Surface Temperature (LST), Machine Learning (ML), Random Forest (RF), Spectral Angle Mapper (SAM), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Total Suspended Solids (TSS), Water Quality (WQ), XGBoost (Extreme Gradient Boosting).

to predict vestibular schwannoma (VS) response to radiosurgery by applying machine learning (ML) algorithms on radiomic features extracted from pre-treatment magnetic resonance (MR) images. patients with VS treated with radiosurgery in two Centers from 2004 to 2016 were retrospectively evaluated. Brain T1-weighted contrast-enhanced MR images were acquired before and at 24 and 36 months after treatment. Clinical and treatment data were collected contextually. Treatment responses were assessed considering the VS volume variation based on pre- and post-radiosurgery MR images at both time points. Tumors were semi-automatically segmented and radiomic features were extracted. Four ML algorithms (Random Forest, Support Vector Machine, Neural Network, and extreme Gradient Boosting) were trained and tested for treatment response (i.e., increased or non-increased tumor volume) using nested cross-validation. For training, feature selection was performed using the Least Absolute Shrinkage and Selection Operator, and the selected features were used as input to separately build the four ML classification algorithms. To overcome class imbalance during training, Synthetic Minority Oversampling Technique was used. Finally, trained models were tested on the corresponding held out set of patients to evaluate balanced accuracy, sensitivity, and specificity. 108 patients treated with Cyberknife® were retrieved; an increased tumor volume was observed at 24 months in 12 patients, and at 36 months in another group of 12 patients. The Neural Network was the best predictive algorithm for response at 24 (balanced accuracy 73% ± 18%, specificity 85% ± 12%, sensitivity 60% ± 42%) and 36 months (balanced accuracy 65% ± 12%, specificity 83% ± 9%, sensitivity 47% ± 27%). radiomics may predict VS response to radiosurgery avoiding long-term follow-up as well as unnecessary treatment.