Effective background modelling and subtraction approach for moving object detection

Dynamic backgrounds and sudden illumination changes are two of the major problems associated with background subtraction techniques. In this paper, we present a novel approach to background subtraction that addresses both of these challenges. In particular, we present an improved codebook background modelling and subtraction technique. We utilise image segmentation on the background image and model the background with a codebook for each pixel along with a pseudo background layer. We perceive background motion as an occlusion of one background layer by a nearby background layer. In other words, sliding of one background layer over a neighbouring layer causes background motion and will hence result in false segmentation. We present our approach of codeword spreading across layer boundaries to handle background motion. Furthermore, we present a two-step update of the background codebook to handle both sudden and gradual illumination changes.

Background subtraction is an important part of various computer vision applications that can detect the foreground objects by comparing the current pixels with a background model. The general approaches gradually update the background model according to the current status, but might fail in sudden illumination changes. An illumination‐robust background modelling method is proposed to address this problem. The method provides quick illumination compensation using two background models with different adaption rates. Experimental results show that the proposed algorithm outperforms several state‐of‐art approaches and provides low computational cost.

본 논문은 조명의 변화가 심한 영상에서 손 형태를 안정적으로 인지하는 기법에 관한 것이다. 제안한 방법은 HSI 색상공간에서 색상(Hue) 및 색상 기울기(Hue-Gradient)를 기반으로 정의된 배경모델을 구축하고, 실시간으로 입력되는 영상과의 배경차분(background subtraction)기법을 이용하여 배경과 손을 구분한다. 추출된 손의 영역으로부터 18가지의 특징요소를 추출하고 이를 기반으로 다중클래스 SVM(Support Vector Machine) 학습 기법을 사용하여 손의 형태를 인지한다. 제안 기법은 색상 기울기를 배경 차분에 적용함으로써, 조명 환경이 배경 모델의 조명과 다르게 급격한 변화가 이루어졌을 때도 안정적으로 손의 윤곽정보를 추출할 수 있도록 하였다. 또한, 실시간 처리를 저해하는 복잡한 손의 특성정보 대신, OBB의 크기에 대하여 정규화된 두 개의 고유값과 객체 기반 바운딩 박스(OBB)를 구성하는 16개 세부 영역에서의 손 윤곽픽셀의 개수를 손의 특성정보로 사용하였다. 본 논문에서는 급격한 조명 변화 상황에서 기존 RGB 색상요소를 기반으로 하는 배경차분법과 색상을 기반으로 하는 배경차분법, 본 논문에서 제안하는 색상 기울기 기반 배경 차분법의 결과를 비교함으로써 제안 기법의 안정성을 입증하였다. 6명의 실험대상자의 1부터 9까지의 수지화 2700개의 영상으로부터 손 특성 정보를 추출하고 이에 대하여 훈련을 통한 학습 모델을 생성하였다. 학습모델을 기반으로 실험자 6인의 손 형태 1620개의 데이터에 대하여 인지 실험을 실시하여 92.6%에 이르는 손 형태 인식 성공률을 얻었다. In this paper, we present a robust hand recognition approach to sudden illumination changes. The proposed approach constructs a background model with respect to hue and hue gradient in HSI color space and extracts a foreground hand region from an input image using the background subtraction method. Eighteen features are defined for a hand pose and multi-class SVM(Support Vector Machine) approach is applied to learn and classify hand poses based on eighteen features. The proposed approach robustly extracts the contour of a hand with variations in illumination by applying the hue gradient into the background subtraction. A hand pose is defined by two Eigen values which are normalized by the size of OBB(Object-Oriented Bounding Box), and sixteen feature values which represent the number of hand contour points included in each subrange of OBB. We compared the RGB-based background subtraction, hue-based background subtraction and the proposed approach with sudden illumination changes and proved the robustness of the proposed approach. In the experiment, we built a hand pose training model from 2,700 sample hand images of six subjects which represent nine numerical numbers from one to nine. Our implementation result shows 92.6% of successful recognition rate for 1,620 hand images with various lighting condition using the training model.

This paper presents a moving object detection method against sudden illumination change using improved background modeling. Initially, background model is created for every pixel from the first frame. The sample values for the model of a pixel are collected from the neighborhood of that pixel. Then the new pixel values from the new frames are compared to make background foreground decision. Conventional background modeling faces problem with change in the illumination of the scene. The proposed method frequently checks whether abrupt change of illumination take place or not and then initialize the background model from the frame that is detected with changed illumination. The illumination change is detected by obtaining the images of two frames that are taken at a suitable interval in HSV color space. Then the mean change value of each channel is calculated to make a decision. This enables the background model to start over with new sample values that are obtained in the current illumination condition and the background subtraction process can successfully detect moving object with greater accuracy even in changing illumination condition. Simulation results indicate that the proposed method gives excellent results in illumination changing condition to detect moving object whereas the conventional background modeling can not detect accurately. Comparison analysis shows that our proposed method outperforms recent methods in terms of detection accuracy.

Background modeling and subtraction is a basic component of many computer vision and video analysis applications. It has a critical impact on the performance of object tracking and activity analysis. In this paper, we propose an effective and adaptive background modeling and subtraction approach that can deal with dynamic scenes. The proposed approach uses a subspace learning method to model the background and the subspace is updated on-line with a sequential Karhunen-Loeve algorithm. A linear prediction model is also used to make the detection more robust. Experimental results show that the proposed approach is able to model the background and detect moving objects under various type of background scenarios with close to real-time performance.

In the real-time segmentation of the moving objects in a image sequence, methods based on background subtraction are used widely. Bi-polar Radial Reach Correlation (BP-RRC) has realized robust background subtraction by evaluating a local texture per pixel, suppressing the influence of brightness change. However, this method has a fault that is affected by the local illumination change of a background. This paper proposes a robust and stabilized background subtraction algorithm which can cope with texture change of various illumination changes by improving this texture background model. We verified the proposed method using the image sequence including a loose lighting change and a rapid lighting change, and adaptability higher than the conventional method on the sudden illumination changes was attained as a result of verification.

Cut set-based Dynamic Key frame selection and Adaptive Layer-based Background Modeling for background subtraction

To solve the problem of indoor surveillance, this paper is concerned about the framework that allows the detection of moving objects based on IP camera. The current background subtraction algorithms cannot correctly classify foreground and background if there are sudden illumination changes. To eliminate the influence of illumination changes, intensity flicker correction technique is employed before background subtraction in this paper. Meanwhile to reduce the false alarms further, the union of two separate detection results is employed. In the experimental results, both global illumination changes and local ones are included. The results show that the improved subtractor proposed in this paper performs better than ViBe both in the aspect of correct detection rate and false alarms.

The schooling behavior of both light- and dark-adapted Astyanax mexicanus (Fillipi) was observed under sudden changes in illumination in the range 10−7 to 100 ft-c at different times in the diel cycle. In darkness the fish were dispersed, swam slowly, and showed no signs of mutual recognition of one another. There was no simple relationship between the schooling response and the illumination, but in general the frequency, size, and durability of schools were proportional to the illumination. Schooling was maximal above 10−1 ft-c and approached zero at 10−6 ft-c. The schooling at any level of illumination varied with the testing procedures. The lowest responses were obtained with a gradual reduction of illumination in the evening. At illumination below 10−2 ft-c maximal schooling was obtained from dark-adapted fish. From 10−2 ft-c upward, it was obtained from light-adapted fish. The schooling rate (number of fish in a school) reached 100% for a few seconds at 10−3 ft-c and for longer periods at higher illumination, but was never sustained at the 100% level throughout any 4-min period. Schooling was generally enhanced by any sudden change in illumination but was never sustained at a high rate under monotonous conditions. The decline with monotony was equated with reduction of the fright situation. The decline with reduced illumination was attributed to the reduction of visual acuity and visibility, and occurred at a greater rate among faster-swimming fish. Notemigonus crysoleucas (Mitchill), swimming very slowly, exhibited high schooling rates at 10−5 ft-c. Earlier work showed that the retina of Astyanax in continuous darkness undergoes a rhythmic diel shift. The behavior showed that this retinal shift is not the classical transformation from scotopic to photopic vision. Dark-adapted during the day, the fish demonstrated rapid visual perception under sudden illumination at any value from 10−6 to 10−0.69 ft-c. Dark-adapted fish at night exhibited increasingly longer light-shock reactions with sudden illumination above 10−2 ft-c. According to schooling responses the cone threshold was about 10−3 ft-c, and the rod threshold about 10−6 ft-c. The mesopic range extended from about 10−3 to 10−2 ft-c.

In order to improve the trajectory control effect of multi‐degree‐of‐freedom industrial robots, this paper combines visual image technology to conduct research on trajectory control of multi‐degree‐of‐freedom industrial robots. Aiming at the problem of video segmentation under sudden illumination changes, this paper uses a Gaussian mixture model based on the global illumination function to adopt a variety of illumination invariant features, and proposes a scene segmentation algorithm suitable for sudden illumination changes. Moreover, this paper compares and verifies the algorithm from the subjective and objective perspectives through experiments, which shows that the algorithm in this paper can segment the scene more accurately even in the environment of sudden changes in illumination. In addition, the results of the accuracy test and the trajectory control test show that the research method of the multi‐degree‐of‐freedom industrial robot trajectory control based on the visual image proposed in this paper can effectively improve the trajectory control effect of the robot.

This paper proposes a robust method to detect and extract silhouettes of foreground objects from a video sequence of a static camera based on the improved background subtraction technique. The proposed method analyses statistically the pixel history as time series observations. The proposed method presents a robust technique to detect motions based on kernel density estimation. Two consecutive stages of the k-means clustering algorithm are utilized to identify the most reliable background regions and decrease the detection of false positives. Pixel and object based updating mechanism for the background model is presented to cope with challenges like gradual and sudden illumination changes, ghost appearance, non-stationary background objects, and moving objects that remain stable for more than the half of the training period. Experimental results show the efficiency and the robustness of the proposed method to detect and extract the silhouettes of moving objects in outdoor and indoor environments compared with conventional methods.

Background modeling methods in video analysis: A review and comparative evaluation

Robustness is an important factor for background modelling on various scenarios. Current pixel‐based adaptive segmentation method cannot effectively tackle diverse objects simultaneously. To address this problem, in this study, a background modelling method using discriminative motion representation is proposed. Instead of simple usage of intensity to construct the background model, the proposed method extracts a new local descriptor which uses a weighted combination of differential excitations for each pixel to enhance the discriminability of pixels. On the basis of this background model, different categories of objects can be quickly identified by a simple but effective classification rule and accurately be represented in background model by a smart selection of updating strategies. Therefore, the authors’ background modelling method can generate complete representation for static objects and decrease false detection caused by dynamic background or illumination variations. Extensive experiments have been conducted to demonstrate that the proposed method obtains more advantages of foreground detection than the state‐of‐the‐art methods. In addition, the proposed method provides a computational efficient algorithm for foreground detection tasks.

On the role and the importance of features for background modeling and foreground detection

This paper proposes an efficient real-time background subtraction algorithm, which is essential in many computer vision applications. Initially, histograms of the intensity values for each channel of a pixel position in a set of training framesare constructed. A background model, histogram min-max bucket, is constructed from the minimum and maximum values of contiguous non-zero frequencies of the temporal intensity histogram. A novel feature of this algorithm is the use of a single sliding window to update the system adaptively, capturing the proper background even under sudden and/or gradual illumination changes in the scene. We incorporate both local and global information with the help of the current and the previously visited pixel values for binary classification of a pixel into foreground and background. This algorithm is compared with several state-of-the-art techniques and experimental studies show that the proposed method outperforms all these methods in terms of accurate binary classification.