Investigating the angular distortion impact on vehicular optical camera communication (OCC) systems

Data rate and communication distance are two important criteria for measuring the performance of optical camera communication (OCC) systems. Intensive researches have been made to find possible solutions to improve these two performance indicators. However, most existing literature either provides solutions which closely related to the experimental parameters of their own designed OCC systems or provides models which are suitable for visible light communication (VLC) and cannot be directly used in OCC. Motivated by this, we propose a simplified system model for OCC in this paper. By jointly applying Lambertian model for the transmitter light-emitting diode (LED), channel direct current (DC) gain for free space channel, and mathematical descriptions for the imaging process of the camera receiver, the proposed model provides the relationship between the optical transmission power and the final pixel values on the image sensor. We specifically explore the parameters of the transmission distance and the exposure time based on the proposed model. Simulation results qualitatively and quantitatively explore the influences of these two parameters on the final pixel values. Our proposed model can provide guidance for the design of a generalized OCC system as well as the selection of demodulating threshold, thus it can help to realize a highperformance OCC system.

To enable a higher transmission rate in optical camera communication (OCC) systems, severe inter-symbol interference (ISI) occurs owing to the reduction of the number of pixel-row-per-bit (PPB). Therefore, those pixels representing data bit 0 or 1 may have same gray scale values, significantly deteriorating the bit decision when using the conventional thresholding scheme. In this Letter, a simple yet efficient scheme, referred to as nearest neighbor bit assisted decision (NNBAD) scheme, is proposed and experimentally demonstrated for signal decision in OCC systems. NNBAD leverages the nearest neighbor bit to jointly assist bit decision for pixels with severe ISI. Experimental results show that, for OCC systems with on-off keying (OOK) modulation, those pixels with severe ISI cannot be distinguished by the conventional thresholding scheme. Yet, the NNBAD scheme exhibits strong robustness against ISI, remarkably improving the bit error rate (BER) performance. The proposed scheme can achieve a throughput of 8.2 kbps with OOK modulation under an illuminance of 600 lx.

In order to increase the data rate of the optical camera communication (OCC) system, the 8-composite-amplitude-shift-keying modulation (8CASK) OCC system is used in this work. However, if the static decision thresholds are employed to demodulate multi-level ASK signal, uneven illumination of LED lamps and LED light-emitting instability lead to the fluctuation of the gray range in the picture and degrade the bit-error-rate (BER) performance. In this work, we propose and demonstrate a demodulation scheme, using the uneven illumination compensation algorithm, the pixel matrix threshold overall update algorithm and the secondary decision algorithm, to mitigate the impact of illumination unevenness and LED light-emitting instability. The BER performance is evaluated and compared with other demodulation schemes. The experimental results demonstrate that the communication rate of our proposed scheme can reach 9kbit/s at a distance of 250 cm where the illumination is 135lux, and the BER is 8.01 × 10−5.

Nowadays, underwater activities are becoming more and more important. As the number of underwater sensing devices grows rapidly, the amount of bandwidth needed also increases very quickly. Apart from underwater communication, direct communication across the water–air interface is also highly desirable. Air-to-water wireless transmission is crucial for sending control information or instructions from unmanned aerial vehicles (UAVs) or ground stations above the sea surface to autonomous underwater vehicles (AUVs). On the other hand, water-to-air wireless transmission is also required to transmit real-time information from AUVs or underwater sensor nodes to UAVs above the water surface. Previously, we successfully demonstrated a water-to-air optical camera-based OWC system, which is also known as optical camera communication (OCC). However, the reverse transmission (i.e., air-to-water) using OCC has not been analyzed. It is worth noting that in the water-to-air OCC system, since the camera is located in the air, the image of the light source is magnified due to diffraction. Hence, the pixel-per-symbol (PPS) decoding of the OCC pattern is easier. In the proposed air-to-water OCC system reported here, since the camera is located in the water, the image of the light source in the air will be diminished in size due to diffraction. Hence, the PPS decoding of the OCC pattern becomes more difficult. In this work, we propose and experimentally demonstrate a wide field-of-view (FOV) air-to-water OCC system using CUDA Deep-Neural-Network Long-Short-Term-Memory (CuDNNLSTM). Due to water turbulence and air turbulence affecting the AUV and UAV, a precise line-of-sight (LOS) between the AUV and the UAV is difficult to achieve. OCC can provide wide FOV without the need for precise optical alignment. Results revealed that the proposed air-to-water OCC system can support a transmission rate of 7.2 kbit/s through a still water surface, and 6.6 kbit/s through a wavy water surface; this satisfies the hard-decision forward error correction (HD-FEC) bit-error-rate (BER).

As mobile payments become increasingly popular, the security of the transaction process should be taken more seriously. Many mobile phones are equipped with complementary metal-oxide-semiconductor (CMOS) cameras, which can be used as visible light communication (VLC) receivers. An optical camera communication (OCC) system is a special VLC system that uses an optical camera as a receiver. OCC offers acceptable security, but challenges remain. In this paper, we propose an OCC system that uses an optical camera with a rolling shutter as a receiver and a light-emitting diode (LED) panel light as a transmitter. The feature of an LED panel light serving as a surface light source reduces the possibility of overexposure and avoids the blooming effect of the camera. The rolling shutter effect of the CMOS camera is used to increase the data rate, which is numerically much higher than the frame rate. Finally, the results of a symbol error rate (SER) test show that the VLC system exhibits error-free performance. The data rate is approximately 4.2kb/s, while the net data rate is approximately 2.46kb/s due to the redundancy of the 3-9 code bar code and the redundant cycle. This data rate is sufficient for mobile payments, which require only 60bits of data at a time.

Mitigation of PAM4 rolling shuttered pattern grayscale ambiguity in demodulation utilizing long short term memory neural network (LSTM-NN) in optical wireless communication systems

Optical wireless communication (OWC) has received increasing attention recently. One application of OWC uses image sensor as optical receiver, which is known as optical camera communication (OCC). Rolling shutter mode in OCC allows data rate higher than the camera frame-rate operation. However, the row by row exposure delay will create decoding challenge, and high inter-symbol interference (ISI) can be observed in the rolling shutter pattern. In this work, we propose and demonstrate an OCC system employing pixel-per-bit (PPB) as label for the deep neural network (PPB-NN). Besides, two rolling shutter patterns emitted by two LED light panels can be decoded simultaneously. The proposed PPB-NN is also compared with other decoding schemes in the literature, and the experimental results revealed that the proposed scheme can achieve a better bit-error ratio (BER) performance.

This paper presents a method for performing traffic light detection using computer vision. Reliable traffic light detection and classification is crucial for automated driving in urban environments. By using big data and artificial intelligence, a complex dataset belonging to an urban area in China is preprocessed to determine the level of vehicular congestion, and then different machine learning algorithms are applied to a dataset of traffic light images in order to validate them in the urban environment to be studied, this process is explained step by step. The models obtained in this work can be applied in optical camera communication (OCC) systems, and also in intelligent transportation systems (ITS), using tracking channels for visible light communication (VLC). The two optical channels, VLC and OCC, are simulated in terms of the quality of information received in order to apply the previously generated datasets. In this work, a traffic light feature dataset has been generated from images and two traffic light classification models present in images and video frames have been generated from their features, obtaining a maximum accuracy of 94.52 %.

In this work, we propose a multiple inputs multiple outputs (MIMO) non-line-of-sight (NLOS) optical camera communication (OCC) system with multi-level pulse width modulation (MPWM) and difference-based pulse width recognition (DBPWR) schemes. The MPWM signals transmitted over a NLOS link are recovered using the DBPWR algorithm. Compared with the conventional threshold-based demodulation scheme, the proposed DBPWR scheme has lower complexity, higher reliability, and improved sampling frequency offset tolerance. A total data rate of 3.6 kb/s is experimentally demonstrated for more than 2 m NLOS link using the proposed MIMO OCC system, which is sufficient in many Internet of things applications.

Real-time implementation of OFDM modulation for an OCC system: UNet-based equalizer for signal denoising and BER optimization

Optical camera communication (OCC), a branch of optical wireless communication (OWC), enables data transmission using LEDs and reception via cameras. This technology offers benefits such as a broad spectrum, low cost, high efficiency, and resistance to electromagnetic interference. However, OCC faces challenges in medium access management, which necessitates the development of effective medium access control (MAC) protocols. The IEEE 802.15.7 standard proposes MAC protocols tailored for various OCC modes and simplifies frame structures. In this study, we develop and test a MAC protocol based on carrier sense multiple access with collision avoidance (CSMA/CA) and integrate a novel transform alignment technique aimed at optimizing the bit error rate (BER) performance. By addressing the inherent medium access challenges in OCC, such as signal interference and access contention, the new protocol significantly boosts data transmission efficiency and enhances communication reliability.

In this work, a new Time Difference of Arrival (TDoA) scheme for distance measurement based on Optical Camera Communication (OCC) systems is proposed. It relies on the use of optical pulses instead of radio-frequency signals as the time reference triggers, and the introduction of a rolling shutter camera, whose characteristics allows substituting the timer modules used in conventional TDoA techniques by image processing of the illuminated area in the picture. This processing on the camera’s images provides time measurements and implies and specific analysis, which is presented in this work. The system performance and properties, such as resolution and range, mainly depends on the camera characteristics, such as the frames capture rate and the image quality. This new technique is suitable to be implemented in smartphones or other Commercial Off-The-Shelf (COTS) devices equipped with a camera and speakers.

This paper experimentally investigates the performance of visible light based optical camera communications (OCC) link with motion detection (MD) for the optical Internet of things applications. This efficient MD can be considered another functionality of OCC in addition to traditional features of vision, illumination data communications and sensing. The experiments were conducted in an indoor static downlink OCC system employing a mobile phone front camera is employed as the receiver and an $8\times 8$ red, green, and blue (RGB) light-emitting diode array as the transmitter. The motion is detected by observing the user's finger movement in the form of centroid through the OCC link via a camera. The experiment results demonstrate that, the proposed scheme can detect all considered motions accurately with acceptable bit error rate (BER) performances at a transmission distance of up to 80 cm. We show a BER of $1.7\times 10^{-3}$ below the forward error correction limit of $3.8\times 10^{-3}$ over a transmission distance of up to 1 m. The proposed neuron based MD combined together with OCC can be considered an efficient system, which provides illumination, communications, and motion detection in a convenient smart home environment.

Red, green, and blue (RGB) light-emitting diodes (LEDs) are widely used in everyday illumination, particularly where color-changing lighting is required. On the other hand, digital cameras with color filter arrays over image sensors have been also extensively integrated in smart devices. Therefore, optical camera communications (OCC) using RGB LEDs and color cameras is a promising candidate for cost-effective parallel visible light communications (VLC). In this paper, a single RGB LED-based OCC system utilizing a combination of undersampled phase-shift on–off keying (UPSOOK), wavelength-division multiplexing (WDM), and multiple-input–multiple-output (MIMO) techniques is designed, which offers higher space efficiency (3 bits/Hz/LED), long-distance, and nonflickering VLC data transmission. A proof-of-concept test bed is developed to assess the bit-error-rate performance of the proposed OCC system. The experimental results show that the proposed system using a single commercially available RGB LED and a standard 50-frame/s camera is able to achieve a data rate of 150 bits/s over a range of up to 60 m.

Radio frequency (RF) waveforms are widely used in wireless technologies, such as mobile system, smart factory, and smart home systems. Due to its simplicity of installation, wireless communication is better than wire communication. However, the use of high frequencies for data transmission can be harmful to human health. To replace RF waveform for communication system, Optical Wireless Communication (OWC), which deploys visible light waveform for communication, was researched widely by researchers around the world. Visible Light Communication (VLC), Light Fidelity (LiFi), and Optical Camera Communication (OCC) are the three candidates for replacing RF system. In this research, we present an multiple-input multiple-output (MIMO) modulation system based on on-off keying (OOK) modulation in the time domain and a light-emitting diode (LED) array. By adjusting the exposure time, focal length, forward error correction, and Deep learning for object detection, it is still possible to implement this technique with 10 links in various locations at a distance of 20 m with a velocity of 2 m/s.