- Research Article
34
- 10.1016/j.imavis.2020.103925
Zero-sum game theory model for segmenting skin regions
- Apr 30, 2020
- Image and Vision Computing
- Djamila Dahmani + 2 more +2
Zero-sum game theory model for segmenting skin regions
This article presents a framework for a food intake monitoring system intended for use with persons with Alzheimer's disease and other dementias. Alzheimer's disease has a significant impact on the individual's ability to perform their daily activities including eating. Providing assistance with feeding is a major challenge for caregivers, including a significant time commitment. We present a vision-based system that tracks moving objects, such as the hand, using a combined optical flow and skin region detection algorithms. Skin detection is implemented using two different methods. Hue, saturation, and value (HSV) color space, which is on separation of the illuminance component from chrominance one as the first method and skin color information is extracted from subject's face detected using Viola-Johns algorithm for the second method. Once face and other moving skin regions are detected, bounding boxes are created and used to track all moving regions over the video frames, recognizing eating behavior or the lack of it. Based on experimental results the proposed method using optical flow and skin regions segmentation using HSV color detects the hand to mouth eating motion with 92.12% accuracy. The optical flow and skin region segmentation based on face color information achieves a higher accuracy of 94.29%.
Zero-sum game theory model for segmenting skin regions
Zero-sum game theory model for segmenting skin regions
A Non Deep Learning based Method for Detection of Alopecia Areta and Segmentation of Scalp and Hair regions.
Hair and scalp-related diseases often go unnoticed in the initial stages and patients sometimes cannot differentiate between hair loss and regular hair fall. Diagnosing hair related diseases is time-consuming as it requires professional dermatologists to perform visual and medical tests. There are some works reported in literature which perform binary classification of whether the person has alopecia or not. Often, clinicians calculate SALT, Ludwig or Norwood scores to detect the stage of alopecia. This would require a patient's scalp view from top, front, sides and back, which acts as a constraint on some datasets that only have a single view of the patient. Our proposed method of scalp detection, skin and hair region segmentation and alopecia detection can be performed on single view image. As the final deployment device is a memory constrained device, our model uses classical image processing algorithms to segment the hair and skin regions. Our method reported an accuracy of 94% on detecting alopecia on the Dermnet dataset. The lack of segmentation ground truth for hair and skin in Dermnet has motivated us to use the Figaro dataset for evaluating the performance of the proposed segmentation methodClinical relevance- Unlike other reported methods in the literature which just states whether the person has alopecia or not, the proposed method provides a complete insight into the percentage of skin and hair regions on the scalp by performing segmentation of skin and hair regions along with classification. The report generated from the method help the dermatologists to monitor the efficacy of the treatment by comparing varied dated images before and during the treatment cycle. The proposed method can be run on portable devices even with limited memory for monitoring the successfulness of alopecia treatment at home.
Read moreA Mumford-Shah level-set approach for skin segmentation using a new color space
In this paper, skin region segmentation is performed using a new color space and a level set method based on Mumford-Shah model. The fundamental idea is to divide the whole problem into two main steps according to the hierarchy of image information. We first perform a rough skin classification pixel-wise using a color coordinate deduced by principal component analysis (PCA) technique. The next step is to implementing image segmentation using a level set with Mumford-Shah model. All the regions are then traversed to calculate ratio of skin pixels to the total pixels within each individual region. Those regions whose ratio reaches the statistical amount will then be regarded as skin regions. Experimental results show that the proposed method is robust, and it could reduce false detection caused by noise or illumination variation.
Read moreDynamic assessment of visual fatigue during video watching: Validation of dynamic rating based on post-task ratings and video features
Dynamic assessment of visual fatigue during video watching: Validation of dynamic rating based on post-task ratings and video features
Read moreSelf-adaptive algorithm for segmenting skin regions
In this paper, we introduce a new self-adaptive algorithm for segmenting human skin regions in color images. Skin detection and segmentation is an active research topic, and many solutions have been proposed so far, especially concerning skin tone modeling in various color spaces. Such models are used for pixel-based classification, but its accuracy is limited due to high variance and low specificity of human skin color. In many works, skin model adaptation and spatial analysis were reported to improve the final segmentation outcome; however, little attention has been paid so far to the possibilities of combining these two improvement directions. Our contribution lies in learning a local skin color model on the fly, which is subsequently applied to the image to determine the seeds for the spatial analysis. Furthermore, we also take advantage of textural features for computing local propagation costs that are used in the distance transform. The results of an extensive experimental study confirmed that the new method is highly competitive, especially for extracting the hand regions in color images.
Read moreSkin-based privacy filter for surveillance systems
With surveillance monitoring becoming widely available with the emergence of high resolution cameras, privacy concerns have been raised. One way to achieve privacy protection is by employing a privacy preserving device that can protect persons' identity, but still provide sufficient information to detect anomalous events if necessary. The skin region is important as a Personally Identifying Information (PII) that needs to be obscured if privacy is to be protected. Thus, this paper presents skin detection techniques to conceal privacy sensitive information. However, state-of-the-art skin detection methods suffer from various problems when deployed in a surveillance system. Accordingly, we propose a solution whereby we first find a set of candidate Regions-of-Interest (RoI) and then apply skin detection to the RoI thus found so as to locate the skin. By using this strategy, skin regions can be well delineated to allow targeted privacy filtering without covering the non-RoI parts.
Read moreA novel convolutional neural network for gesture recognition
Gesture recognition, as an important means of human-computer interaction, can achieve more natural and flexible human-computer interaction, so it has been widely concerned by researchers in the field of computer vision. At present, most gesture recognition algorithms are based on monocular visual images and recognize the apparent features of hands. Most gesture image segmentation methods are carried out in color space according to skin color information. These methods are highly susceptible to interference from the external environment, such as lighting, background, etc. Convolutional neural network has the advantages of strong anti-interference and outstanding self-organization and self-learning ability. Therefore, based on the principle of convolutional neural network, a novel deep convolutional neural network dedicated to gesture recognition was designed in this paper. This network combines skin color information with finger position information for gesture recognition. Experimental results showed that the algorithm based on fingertip position information has better performance than the algorithm based solely on skin color information. Moreover, the network has simple structure and few parameters. Compared with VGG16 and other classical networks, the recognition accuracy is basically the same under the premise of fewer parameters and structural layers, and the recognition effect is better than other classical networks.
Read moreReal-Time Integration of Optical Coherence Tomography Thickness Map Overlays for Enhanced Visualization in Epiretinal Membrane Surgery: A Pilot Study.
(1) Background: The process of epiretinal membrane peeling (MP) requires precise intraoperative visualization to achieve optimal surgical outcomes. This study investigates the integration of preoperative Optical Coherence Tomography (OCT) images into real-time surgical video feeds, providing a dynamic overlay that enhances the decision-making process during surgery. (2) Methods: Five MP surgeries were analyzed, where preoperative OCT images were first manually aligned with the initial frame of the surgical video by selecting five pairs of corresponding points. A homography transformation was then computed to overlay the OCT onto that first frame. Subsequently, for consecutive frames, feature point extraction (the Shi-Tomasi method) and optical flow computation (the Lucas-Kanade algorithm) were used to calculate frame-by-frame transformations, which were applied to the OCT image to maintain alignment in near real time. (3) Results: The method achieved a 92.7% success rate in optical flow detection and maintained an average processing speed of 7.56 frames per second (FPS), demonstrating the feasibility of near real-time application. (4) Conclusions: The developed approach facilitates enhanced intraoperative visualization, providing surgeons with easier retinal structure identification which results in more comprehensive data-driven decisions. By improving surgical precision while potentially reducing complications, this technique benefits both surgeons and patients. Furthermore, the integration of OCT overlays holds promise for advancing robot-assisted surgery and surgical training protocols. This pilot study establishes the feasibility of real-time OCT integration in MP and opens avenues for broader applications in vitreoretinal procedures.
Read morePerformance based algorithm for the detection and extraction of human skin
This paper presents the comparative analysis of various color space models like RGB, HSV and YC b C r color models for detection and extraction of human skin from it. Skin detection is broadly used in applications like face detection, tracking of the body parts and hand gesture analysis, for retrieval of skin and blocking of unpleasant contents. The proposed method is performed in four phases; the effect of color space transformation on skin detection performance and finding the appropriate color space for skin detection; the role of the illuminance part of a color space; the appropriate pixel based skin color modeling technique; and finally, the effect of color fidelity algorithms on color based skin classification. The heterogeneity of RGB color space is detached by using HSV and YC b C r color space models. In this paper the input image captured from a camera is converted into three different color space models i.e. RGB, HSV and YC b C r and then performance analysis of algorithms is to be evaluated on the basis of skin detection and extraction.
Read moreDetection of optical flow from a noisy image
To obtain motion parameters from a moving object in a time‐varying image or to obtain information on a three‐dimensional structure and the collocation of an object, it is necessary to obtain the displacement from the object on the image prior to further processing. For this purpose, the gradient‐based method by which the motion of the object on the image can be detected directly form the spatio‐temporal changes of its brightness is widely used. However, in cases where the image contains noise or the conditions required for the gradient‐based method are not satisfied, a large error occurs in the estimation of the object.This paper proposes a method in which the optical flow is represented using polar coordinates, and all the conditions required for its magnitude and argument are considered when they are derived. The magnitude of the optical flow of a pixel and the correlation between its argument and neighboring pixels are examined using true motion. The method detects only the optical flow caused by true motion of an object, eliminating optical flows caused by noise, so that the gradient‐based method may be applied.
Read moreColor space selection for human skin detection using color-texture features and neural networks
Skin color is a robust cue in human skin detection. It has been widely used in various human-related image processing applications. Although many researches have been carried out for skin color detection, there is no consensus on which color space is the most appropriate for skin color detection because many researchers do not provide strict justification of their color space choice. In this paper, a comprehensive comparative study using the Multilayer Perceptron artificial neural network (MLP), which is a universal classifier, is carried out to evaluate the overall performance of different color-spaces for skin detection. It aims at determining the most optimal color space using color and color-texture features separately. The study has been carried out using images of different databases. The experimental results showed that the YIQ color space gives the highest separability between skin and non-skin pixels among the different color spaces tested using color features. Combining color and texture eliminates the differences between color spaces but leads to much more accurate and efficient skin detection.
Read moreOptical flow detection using segmentation and MDL criterion
Kanatani applied the concept of noise to optical flow calculation using the constraint equation proposed by Horn, and presented a renormalization method which estimates the flow and the noise components simultaneously. In the renormalization method, the image is segmented into blocks, and the constraint that flows of the pixels in a block remain the same is assumed. This paper applies MDL criterion to the renormalization method and proposes an optical flow estimation algorithm that segments the image self‐organizationally. It is assumed that the sender has a pair of images from time‐ordered sequence and the receiver has one of these images. In this assumption, the image segmentation is determined by using MDL criterion so that the intensity gradient vectors generated from the image pair are encoded most efficiently. Each intensity gradient vector is encoded to two components, namely, the flow vector and the error. The image segmentation and the flow vectors obtained by this procedure are defined as the estimated optical flows. As an experiment, the algorithm is applied to artificial image pairs and a real image pair and the results are presented. © 2004 Wiley Periodicals, Inc. Syst Comp Jpn, 35(9): 51–59, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.10335
Read moreRegion-based Pornographic Image Detection
Recent advantages in digital images and networks have made pornographic images more accessible than ever. Methods of detecting pornographic images have been proposed in some existing work. However, the skin detection modules adopted are all pixel-based and skin region shape features are rarely properly used. This paper presents a framework for pornographic image detection based on skin region information. Different from traditional works, our approach extracts color and texture features from arbitrary-shaped segmented regions. Then Gaussian mixture models are built for skin and non-skin region classification, and the skin map is produced based on the classification result. Finally, eigenregion features are used to describe the layout of skin regions on the whole image and pornographic images are detected according to the skin modality
Read moreA Comprehensive Survey on Human Skin Detection
Human Skin detection is one of the most widely used algorithms in vision literature which has been numerously exploited both directly and indirectly in multifarious applications. This scope has received a great deal of attention specifically in face analysis and human detection/tracking/recognition systems. As regards, there are several challenges mainly emanating from nonlinear illumination, camera characteristics, imaging conditions, and intra-personal features. During last twenty years, researchers have been struggling to overcome these challenges resulting in publishing hundreds of papers. The aim of this paper is to survey applications, color spaces, methods and their performances, compensation techniques and benchmarking datasets on human skin detection topic, covering the related researches within more than last two decades. In this paper, different difficulties and challenges involved in the task of finding skin pixels are discussed. Skin segmentation algorithms are mainly based on color information; an in-depth discussion on effectiveness of disparate color spaces is elucidated. In addition, using standard evaluation metrics and datasets make the comparison of methods both possible and reasonable. These databases and metrics are investigated and suggested for future studies. Reviewing most existing techniques not only will ease future studies, but it will also result in developing better methods. These methods are classified and illustrated in detail. Variety of applications in which skin detection has been either fully or partially used is also provided.
Read moreColor images face recognition based on multi-classification support vector machine
Skin color information plays an important role in face detection and recognition. By a large number of skin pixels statistics, the model of face skin color information is constructed in YUV and YCbCr color spaces. The Mahalanobis distance map of the image is obtained to extract features and establish Eigenfaces space. A novel Support Vector Machine method based on error-correcting codes matrix is proposed. The algorithm is loop-arranged and symmetrical divided classes of multi-classification problem, and the class of an unknown sample is obtained by the decode function based on error-correcting codes matrix. Experimental results demonstrate that using YCbCr color information and a new SVM in face recognition is effective.
Read more