Moving Object Detection against Sudden Illumination Change Using Improved Background Modeling

Dynamic backgrounds and sudden illumination changes are two of the major problems associated with background subtraction techniques. In this paper, we present a novel approach to background subtraction that addresses both of these challenges. In particular, we present an improved codebook background modelling and subtraction technique. We utilise image segmentation on the background image and model the background with a codebook for each pixel along with a pseudo background layer. We perceive background motion as an occlusion of one background layer by a nearby background layer. In other words, sliding of one background layer over a neighbouring layer causes background motion and will hence result in false segmentation. We present our approach of codeword spreading across layer boundaries to handle background motion. Furthermore, we present a two-step update of the background codebook to handle both sudden and gradual illumination changes.

본 논문은 조명의 변화가 심한 영상에서 손 형태를 안정적으로 인지하는 기법에 관한 것이다. 제안한 방법은 HSI 색상공간에서 색상(Hue) 및 색상 기울기(Hue-Gradient)를 기반으로 정의된 배경모델을 구축하고, 실시간으로 입력되는 영상과의 배경차분(background subtraction)기법을 이용하여 배경과 손을 구분한다. 추출된 손의 영역으로부터 18가지의 특징요소를 추출하고 이를 기반으로 다중클래스 SVM(Support Vector Machine) 학습 기법을 사용하여 손의 형태를 인지한다. 제안 기법은 색상 기울기를 배경 차분에 적용함으로써, 조명 환경이 배경 모델의 조명과 다르게 급격한 변화가 이루어졌을 때도 안정적으로 손의 윤곽정보를 추출할 수 있도록 하였다. 또한, 실시간 처리를 저해하는 복잡한 손의 특성정보 대신, OBB의 크기에 대하여 정규화된 두 개의 고유값과 객체 기반 바운딩 박스(OBB)를 구성하는 16개 세부 영역에서의 손 윤곽픽셀의 개수를 손의 특성정보로 사용하였다. 본 논문에서는 급격한 조명 변화 상황에서 기존 RGB 색상요소를 기반으로 하는 배경차분법과 색상을 기반으로 하는 배경차분법, 본 논문에서 제안하는 색상 기울기 기반 배경 차분법의 결과를 비교함으로써 제안 기법의 안정성을 입증하였다. 6명의 실험대상자의 1부터 9까지의 수지화 2700개의 영상으로부터 손 특성 정보를 추출하고 이에 대하여 훈련을 통한 학습 모델을 생성하였다. 학습모델을 기반으로 실험자 6인의 손 형태 1620개의 데이터에 대하여 인지 실험을 실시하여 92.6%에 이르는 손 형태 인식 성공률을 얻었다. In this paper, we present a robust hand recognition approach to sudden illumination changes. The proposed approach constructs a background model with respect to hue and hue gradient in HSI color space and extracts a foreground hand region from an input image using the background subtraction method. Eighteen features are defined for a hand pose and multi-class SVM(Support Vector Machine) approach is applied to learn and classify hand poses based on eighteen features. The proposed approach robustly extracts the contour of a hand with variations in illumination by applying the hue gradient into the background subtraction. A hand pose is defined by two Eigen values which are normalized by the size of OBB(Object-Oriented Bounding Box), and sixteen feature values which represent the number of hand contour points included in each subrange of OBB. We compared the RGB-based background subtraction, hue-based background subtraction and the proposed approach with sudden illumination changes and proved the robustness of the proposed approach. In the experiment, we built a hand pose training model from 2,700 sample hand images of six subjects which represent nine numerical numbers from one to nine. Our implementation result shows 92.6% of successful recognition rate for 1,620 hand images with various lighting condition using the training model.

This study presents a hierarchical background modelling and subtraction approach for real‐time detection of moving objects. At the first level, a novel pixel‐wise background modelling method is proposed for coarse detection. The method can dynamically assign the optimal number of components for each pixel with the borrow–lend strategy. And a flexible learning rate which is variable and different for each component is presented to adapt to scene changes. Additionally, a new mechanism using a framework of finite state machine is introduced to maintain and update the background models. At the second level, in order to deal with sudden illumination changes, a block‐wise foreground validation approach is adopted for refined detection. The authors compare the proposed approach with state‐of‐the‐art methods and experimental results under various scenes demonstrate the robustness and effectiveness of the proposed approach.

We propose an edge-segment-based statistical background modelling algorithm to detect the moving edges for the detection of moving objects using a static camera. Traditional pixel intensity-based background modelling algorithms face difficulties in dynamic environments since they cannot handle sudden changes in illumination. They also bring out ghosts when a sudden change occurs in the scene. To cope with this issue, intensity and noise robust edge-based features have emerged. However, existing edge-pixel-based methods suffer from scattered moving edge pixels since they cannot utilize the shape. Moreover, traditional segment-based methods cannot handle edge shape variations and miss moving edges when they come close to the background edges. Unlike traditional approaches, our proposed method builds the background model from ordinary training frames that may contain moving objects. Furthermore, it does not leave any ghosts behind. Moreover, our method uses an automatic threshold for every background edge distribution for matching. This makes our approach robust to illumination change, camera movement and background motion. Experiments show that our method outperforms others and can detect moving edges efficiently despite the above mentioned difficulties.

In order to improve the trajectory control effect of multi‐degree‐of‐freedom industrial robots, this paper combines visual image technology to conduct research on trajectory control of multi‐degree‐of‐freedom industrial robots. Aiming at the problem of video segmentation under sudden illumination changes, this paper uses a Gaussian mixture model based on the global illumination function to adopt a variety of illumination invariant features, and proposes a scene segmentation algorithm suitable for sudden illumination changes. Moreover, this paper compares and verifies the algorithm from the subjective and objective perspectives through experiments, which shows that the algorithm in this paper can segment the scene more accurately even in the environment of sudden changes in illumination. In addition, the results of the accuracy test and the trajectory control test show that the research method of the multi‐degree‐of‐freedom industrial robot trajectory control based on the visual image proposed in this paper can effectively improve the trajectory control effect of the robot.

Background subtraction is an important part of various computer vision applications that can detect the foreground objects by comparing the current pixels with a background model. The general approaches gradually update the background model according to the current status, but might fail in sudden illumination changes. An illumination‐robust background modelling method is proposed to address this problem. The method provides quick illumination compensation using two background models with different adaption rates. Experimental results show that the proposed algorithm outperforms several state‐of‐art approaches and provides low computational cost.

The schooling behavior of both light- and dark-adapted Astyanax mexicanus (Fillipi) was observed under sudden changes in illumination in the range 10−7 to 100 ft-c at different times in the diel cycle. In darkness the fish were dispersed, swam slowly, and showed no signs of mutual recognition of one another. There was no simple relationship between the schooling response and the illumination, but in general the frequency, size, and durability of schools were proportional to the illumination. Schooling was maximal above 10−1 ft-c and approached zero at 10−6 ft-c. The schooling at any level of illumination varied with the testing procedures. The lowest responses were obtained with a gradual reduction of illumination in the evening. At illumination below 10−2 ft-c maximal schooling was obtained from dark-adapted fish. From 10−2 ft-c upward, it was obtained from light-adapted fish. The schooling rate (number of fish in a school) reached 100% for a few seconds at 10−3 ft-c and for longer periods at higher illumination, but was never sustained at the 100% level throughout any 4-min period. Schooling was generally enhanced by any sudden change in illumination but was never sustained at a high rate under monotonous conditions. The decline with monotony was equated with reduction of the fright situation. The decline with reduced illumination was attributed to the reduction of visual acuity and visibility, and occurred at a greater rate among faster-swimming fish. Notemigonus crysoleucas (Mitchill), swimming very slowly, exhibited high schooling rates at 10−5 ft-c. Earlier work showed that the retina of Astyanax in continuous darkness undergoes a rhythmic diel shift. The behavior showed that this retinal shift is not the classical transformation from scotopic to photopic vision. Dark-adapted during the day, the fish demonstrated rapid visual perception under sudden illumination at any value from 10−6 to 10−0.69 ft-c. Dark-adapted fish at night exhibited increasingly longer light-shock reactions with sudden illumination above 10−2 ft-c. According to schooling responses the cone threshold was about 10−3 ft-c, and the rod threshold about 10−6 ft-c. The mesopic range extended from about 10−3 to 10−2 ft-c.

Developmental changes in behavioral and retinomotor responses of Pacific bluefin tuna on exposure to sudden changes in illumination

This paper proposes an efficient real-time background subtraction algorithm, which is essential in many computer vision applications. Initially, histograms of the intensity values for each channel of a pixel position in a set of training framesare constructed. A background model, histogram min-max bucket, is constructed from the minimum and maximum values of contiguous non-zero frequencies of the temporal intensity histogram. A novel feature of this algorithm is the use of a single sliding window to update the system adaptively, capturing the proper background even under sudden and/or gradual illumination changes in the scene. We incorporate both local and global information with the help of the current and the previously visited pixel values for binary classification of a pixel into foreground and background. This algorithm is compared with several state-of-the-art techniques and experimental studies show that the proposed method outperforms all these methods in terms of accurate binary classification.

This paper proposes a robust method to detect and extract silhouettes of foreground objects from a video sequence of a static camera based on the improved background subtraction technique. The proposed method analyses statistically the pixel history as time series observations. The proposed method presents a robust technique to detect motions based on kernel density estimation. Two consecutive stages of the k-means clustering algorithm are utilized to identify the most reliable background regions and decrease the detection of false positives. Pixel and object based updating mechanism for the background model is presented to cope with challenges like gradual and sudden illumination changes, ghost appearance, non-stationary background objects, and moving objects that remain stable for more than the half of the training period. Experimental results show the efficiency and the robustness of the proposed method to detect and extract the silhouettes of moving objects in outdoor and indoor environments compared with conventional methods.

Moving object detection in a video plays an important role in many vision applications. Recently, moving object detection using appearance modeling based on a convolutional neural network has been actively developed. However, the CNN- based methods usually require the user’s supervision of the first frame so that it becomes highly dependent on the training dataset. In contrast, the method of finding a foreground, which models a background occupying a large proportion in an image, can detect a moving object efficiently in an unsupervised manner. However, existing methods based on background modeling in a pan-tilt-zoom (PTZ) camera suffer many false positives or loss of moving objects due to the estimation error of camera motion. To overcome the aforementioned limitations, we propose a moving object detection method for a PTZ camera through two background models. In an unsupervised way, our method builds the two background models that have different roles: 1) a coarse background model for detecting large changes, and 2) a fine background model for detecting small changes. In more detail, the coarse background model builds a block-based Gaussian model, and the fine model builds a sample consensus model. Both models are adaptively updated according to the estimated camera motion in the video recorded by a PTZ camera. Then, each foreground result from two background models is incorporated to fill the moving object region. Through experiments, the proposed method achieves better performance than the state-of-the-art methods and operates in real-time without parallel processing. In addition, we showed the effectiveness of the proposed model through improved results of moving object detection through combination with the latest supervised method.

Foreground segmentation in a video is a key process in many applications such as object detection, an object tracking, and a behavior analysis. Since the extracted foreground objects are often used in the analytical process, the quality of the foreground is a significant factor to the success of these applications. However, there are many key challenges in the foreground segmentation, including dynamic backgrounds, gradual illumination changes, sudden illumination changes, shadows, and long-term scene changes. This paper proposes a novel dynamic codebook method to address such challenges. The dynamic codebook aims to significantly improve the conventional well-known codebook technique by introducing a technique to make a dynamic boundary of each codeword. In this technique, the lab color space is used in order to make the model more resilient to the illumination change. The experimental results and comprehensive comparisons demonstrate that the proposed method can achieve very promising performance.

In the real-time segmentation of the moving objects in a image sequence, methods based on background subtraction are used widely. Bi-polar Radial Reach Correlation (BP-RRC) has realized robust background subtraction by evaluating a local texture per pixel, suppressing the influence of brightness change. However, this method has a fault that is affected by the local illumination change of a background. This paper proposes a robust and stabilized background subtraction algorithm which can cope with texture change of various illumination changes by improving this texture background model. We verified the proposed method using the image sequence including a loose lighting change and a rapid lighting change, and adaptability higher than the conventional method on the sudden illumination changes was attained as a result of verification.

Photovoltaic energy is a renewable source of clean and attractive energy compared to conventional energy sources. Photovoltaic panels (PV) have a non-linear I-V characteristic that depends on climatic conditions. In order to operate the photovoltaic modules at their maximum power point (PMM), MPPT algorithms are developing in order to extract the maximum energy. The Perturb and Observe (P & O) technique is widely used in photovoltaic systems because of its simplicity but remains vulnerable to sudden changes in weather conditions. In this paper, a new multi-objective MPPT algorithm combining three techniques: MPPT type (P & O), fractional short-circuits current (FSCC) and fractional open circuit voltage technique (FOCV) is proposed. This multi-objective algorithm improves the performance of conventional MPPT (P & O). A variable pitch perturbation and detection of sudden changes in illumination and / or temperature levels allows better stabilization of the duty cycle once the PPM is reaching. The proposed algorithm is testing by Matlab/Simulink and the results obtained are compared with experimental results using Arduino Uno microcontroller and appropriate sensors.

Vision-based vehicle detection and segmentation in intelligent transportation systems, particularly under outdoor illuminations, camera vibration, cast shadows and vehicle variations is still an area of active research for analysis and processing of traffic data. This paper proposes an effective scheme that improves Gaussian mixture model (GMM) for non-stationary temporal distributions through dynamically updating the learning rate at each pixel. In this proposed technique, sleeping foreground pixels and slow moving vehicles cannot become the part of background model that also does not lead to extra computational cost as compare to other methods that are proposed in the literature. Sudden illumination change is also captured in this technique. Vision based system cannot be efficient without fixing of camera vibration, so movement of camera is adjusted based on clues from background model. At the end, shadows are removed from detected vehicles through applying a new recursive method in dark regions. Experimental results demonstrate the robustness and high level performance of the proposed adaptive foreground extraction algorithm under illumination variations compared to state-of-the-art methods.