Comparative study of sensor fusion methods for hybrid positioning systems

A Map aided Pedestrian Dead Reckoning (PDR) algorithm is proposed to mitigate the drift errors and step detection limitations of pedestrian dead reckoning algorithm with handheld sensors in indoor and outdoor spaces. Specific to this context is the changing lever-arm between the handheld device and the pedestrian center of mass that introduces a misalignment between the inertial sensors and the walking directions. To address these challenges, an adaptive routing graph is built based on possible pedestrian's motions, which depend on personal mobility profile and surroundings. An adaptive decision process is also developed to fuse map data with GNSS positions and PDR outputs in a particle filter. The performance is assessed with 1km walk experiments. Main contributions are (1) the calibration of the PDR step length model using both GNSS and map data during straight line travels with miss/over-detected steps modeled by the particle filter; (2) the estimation of angular misalignment between the walking and the handheld unit pointing directions in geometrically constrained areas; (3) a dynamic choice of opportune periods and measurements to calibrate the PDR outputs and improve the positioning process.

Indoor localization using the magnetic fingerprint collected by the embedded sensors of smartphone has been under constant improvement with the widespread popularity of the smartphone. Most of the current systems rely on the Particle Filter (PF) or the Kalman Filter (KF) to combine the Pedestrian Dead Reckoning (PDR) with the magnetic or WiFi fingerprint for improving their accuracy. In this paper, a system using the PDR and the magnetic fingerprint is proposed for indoor localization, which is based on the combination of the Particle Filter (PF) and the Extend Kalman Filter (EKF). The system includes the Pedestrian Dead Reckoning (PDR) module and the magnetic fingerprint matching module. In particular, the hybrid indoor positioning algorithm which combines the Particle Filter (PF) and the Extend Kalman Filter (EKF) is proposed in the magnetic fingerprint matching module for the fusion of the results of the Pedestrian Dead Reckoning module and the magnetic fingerprint. This hybrid indoor positioning algorithm is the key component which can reduce the computation of the Particle Filter effectively and solve the inherent blindness and particles degeneration problem. The obtained results in the real scenarios show that our fusion system achieves better results than the widely adopted system in which the Particle Filter (PF) or the Kalman Filter (KF) is used. The evaluation shows the system achieves a localization accuracy about 1-2m on average in a large building.

Automatic lecture recording is an appealing alternative approach to manually recording lectures in the process of online course making as it can to a large extent save labor cost. The key of the automatic recording system is lecturer tracking, and the existing automatic tracking methods tend to lose the target in the case of lecturer’s rapid movement. This article proposes a lecturer tracking system based on MobileNet-SSD face detection and Pedestrian Dead Reckoning (PDR) technology to solve this problem. First, the particle filter algorithm is used to fuse the PDR information with the rotation angle information of the Pan-Tilt camera, which can improve the accuracy of detection under the tracking process. In addition, to improve face detection performance on the edge side, we utilize the OpenVINO toolkit to optimize the inference speed of the Convolutional Neural Networks (CNNs) before deploying the model. Further, when the lecturer is beyond the camera’s field of view, the PDR auxiliary module is enabled to capture the object automatically. We built the entire lecture recording system from scratch and performed the experiments in the real lectures. The experimental results show that our system outperforms the systems without a PDR module in terms of the accuracy and robustness.

In this paper, we propose a surface correlation based fingerprinting method in sparse Wi-Fi environment. The proposed method can estimate location even with very few Wi-Fi APs by using accumulated spatial RSS pattern. We verify performance of the proposed method through several tests in a building with complex paths. Many studies have developed localization technologies that use measurements such as RSS (Received Signal Strength) or RTT (Round Trip Time) for Wi-Fi signal. All RF have signal noise and distortion problems as well as multipath problem in indoor environments. As the distance from the RF signal source increases, the discrimination of the RSS decreases due to RF signal noise and distortion. Therefore, ambiguity of RSS increases as the distance increases, the performance deteriorates. The conventional RF based localization method have tried to maintain dense RF environment to guarantee stable and accurate performance. However, in order to maintain the dense RF environment, it is becoming a barrier to commercialization of localization technology due to high cost of constructing RF infrastructure and maintenance difficulty. In this paper, we propose a Surface Correlation (SC) based fingerprinting technique to maintain high positioning performance even with few Wi-Fi APs. The surface is the accumulated RSS pattern data during the movement of a pedestrian, which means the spatial RSS pattern. Conventional fingerprinting methods using kNN (k-Nearest Neighbors) and WkNN (Weighted kNN) are very vulnerable to signal noise and distortion because they utilize instantaneous RSS data. The performance of Particle Filter (PF) based localization technology is also degraded in areas where Wi-Fi AP is sparsely distributed. However, the proposed method is very robust against signal noise and distortion because it compares the spatial RSS pattern with the reference RSS pattern on the fingerprinting database. This increases localization accuracy and availability for Wi-Fi coverage. For localization, the proposed method conduct correlation process for the spatial RSS pattern of a pedestrian with reference RSS pattern of database. So, the reference RSS pattern should be extracted from a reference trajectory that matches a pedestrian`s walking path. The proposed method utilize a database of ‘link-node’ structure to dynamically generate a reference trajectory in indoor environment with complicated path. It generate candidate reference trajectories using only MAC address and turn event of Pedestrian Dead-Reckoning (PDR). The proposed method fix a reference trajectory between these candidate trajectories through correlation process of measured RSS pattern with each reference RSS pattern. A reference point on the fixed reference having most similar RSS pattern to a pedestrian`s is considered as a current location. In order to improve performance at a fork where RSS ambiguity increases, the proposed method estimates preferentially for a reference trajectory matching with PDR turn event. The turn event can be wrong due to various motion of a pedestrian. The proposed method selects a correct reference trajectory by continuously performing correlation process on candidate reference trajectories. In order to verify the performance of the proposed surface correlation based fingerprinting method, we conducted several tests in a three-story building. Before the tests, we conducted a survey of Wi-Fi environment to construct fingerprinting database in the building. As a result of the survey, 170 APs are distributed in the building. We reduced the number of APs by 20% from 170 to 17, and analyzed performance of the proposed and conventional localization methods. The test results show that the performance of the conventional localization methods degrade as the number of applied APs decreases. The proposed fingerprinting method shows a 3 meter localization error even with very few Wi-Fi APs, and unlike the conventional fingerprinting method, the localization error is bounded to be within 5m due to the use of spatial RSS pattern. In this paper, we presented the fingerprinting method using the surface correlation in sparse Wi-Fi environment. The proposed fingerprinting method accumulates Wi-Fi RSS during movement of a pedestrian. The proposed method compares the spatial RSS pattern, which is accumulated RSS data, with reference RSS patterns of fingerprinting database. By comparing the RSS patterns, the proposed method greatly improves accuracy as well as stability. In addition, it can be effectively applied in a sparse Wi-Fi environment by improving the availability of ambiguous areas of Wi-Fi coverage. Through these results, we expect to be able to provide accurate and reliable location information even in indoor weak RF environment.

To solve the problem of time-consuming, laborious, and low accuracy in magnetic map construction, a trajectory guided 2-D magnetic map construction method is proposed in this article. The absolute displacement calculated by the inertial navigation system is mapped to the real trajectory to construct the magnetic map. The precision of the constructed magnetic map can reach 0.1141 m, and the mapping efficiency is greater than 1800 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\text{m}^{\mathbf {2}}$ </tex-math></inline-formula> /h. Moreover, the cost of sensor is only <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\$ $ </tex-math></inline-formula> 15.4. To deal with the instability problem that the traditional particle filter (PF) in pedestrian dead reckoning (PDR) suffers from, this article proposes an integrated PF (IPF) algorithm. The algorithm uses two assumptions: 1) all noises obey Gaussian distribution and 2) the initial position and the results obtained from IPF are reliable enough. The particle distribution in the case of infinite particles is simulated, and similar particles are integrated. The algorithm breaks through the limit of particle number of PF and greatly reduces the randomness of PF algorithm. The real-world experiments show that the proposed positioning method can achieve an average positioning error of 0.32 m.

Commonly used Global Navigation Satellite Systems (GNSS) are inappropriate as Location Based Services (LBS) in indoor environment. Therefore research teams are developing different systems, which can be used as a suitable alternative. One of options is to use Inertial Navigation System (INS) which consists of inertial sensors and mathematic procedures. This concept has been known for a long time, but with arrival of Microelectro Mechanical System (MEMS) INS found wide use. Smartphones with inertial sensors, such as accelerometers and gyroscopes, allow us to use them as input devices for Pedestrian Dead Reckoning (PDR). In this paper we present PDR by using smartphone sensors. They can be classified as low-cost Inertial Measurement Unit (IMU), and have been compared with more precise and expensive Xsens IMU. Accuracy of inertial sensors has increased in the past few years, but they still cannot alone provide proper accuracy because of many negative effects, such as heading drift due to gyroscope bias. Particle Filter (PF) has been successfully used with map constraints to increase the accuracy of proposed location system. Presented results show that low-cost smartphone IMU combined with PF can be applicable as proper navigation system.

Pedestrian dead reckoning (PDR) is the critical component in indoor pedestrian tracking and navigation services. While most of the recent PDR solutions exploit in-built inertial sensors in smartphones for next step estimation, due to measurement errors and sensing drift, the accuracy of walking direction, step detection, and step length estimation cannot be guaranteed, leading to large accumulative tracking errors. In this paper, we propose a radar-assisted PDR scheme, called RadarPDR, which integrates a frequency-modulation continuous-wave (FMCW) radar to assist the inertial sensors-based PDR. We first establish a segmented wall distance calibration model to deal with the radar ranging noise caused by irregular indoor building layouts and fuse wall distance estimation with acceleration and azimuth signals measured by the inertial sensors of a smartphone. We also propose a hierarchical particle filter(PF) together with an extended Kalman filter for position and trajectory adjustment. Experiments have been conducted in practical indoor scenarios. Results demonstrate that the proposed RadarPDR is efficient and stable and outperforms the widely used inertial sensors-based PDR scheme.

Sensors-based and radio frequency (RF)-based indoor localization technology is one of the keys in location-based services. The IEEE 802.11-2016 introduced the Wi-Fi fine timing measurement (FTM) protocol, which provides a new approach for Wi-Fi-based indoor localization. However, Wi-Fi signals are susceptible to complex indoor environments. To improve the positioning accuracy and stability, an enhanced particle filter (PF) with two different state update strategies, a new criterion for divergence monitoring and rapid re-initialization is proposed to integrate the advantages of pedestrian dead reckoning (PDR) and Wi-Fi FTM. In addition, an adaptive tilt compensation is proposed to improve real-time heading estimation of conventional PDR, and the Wi-Fi FTM outliers are detected by displacement estimation of the PDR. The experimental results show that the proposed PF has better localization performance than the single source positioning methods in a typical indoor scenario. The accuracy of final localization is within 1 m in 86.7% of the dynamic cases and the average calculation time is less than 0.5 s when the number of particles is 2000.

This paper provides a hybrid approach between Wi-Fi and pedestrian dead reckoning (PDR) for the iPhones in indoor environments, and addresses the following two problems. First, since Apple Inc. no longer provides public information about currently-connected Wi-Fi (e.g., service set identifier, received signal strength and channel), Wi-Fi based pedestrian tracking apps that run on the iPhones are more restricted compared to other ones on the Android platforms. Second, even the PDR approach provides such a great way for self-localization, it suffers from accumulated errors of inertial sensors embedded in the smartphones. We propose a conversion function from a Wi-Fi status value to a proximity for the localization purpose. Then, a mobile iPhone collects mobility information from inertial measurements unit (IMU), inputs to the PDR, and combines with Wi-Fi proximity in order to perform accurate self-localization and tracking. Moreover, we improve the PDR by reducing drifting effects caused by the IMU biases. Experiment results show that the proposed scheme is effective and has low complexity, while bringing the benefits from smartphone IMU.

Indoor positioning is usually based on individual technologies that provide estimates of the trajectory of the person, or measures the ranges or angles between the user and known positions. Each technique has its advantages and problems, and a common way to overcome the drawbacks of single-technology solutions is to fuse the information from several system, but due to their non linear measurements, there is no optimal linear solution. We propose the use of a particle filter to fuse foot mounted inertial measurements with any additional Radio Frequency (RF) measurement. The information fusion is achieved propagating the position of the particles using the relative step displacements obtained from foot mounted Pedestrian Dead Reckoning (PDR), and updating the weights of the particles according to the RF measurements. In our experiments the inertial unit was located in the foot of the user, and the RF system consisted in a Radio Frequency Identification (RFID) receiver in the waist, and an Ultra Wide band (UWB) tag in the chest, but the scheme can be used in any sensor configuration. As the UWB measurements have a significant amount of outliers due to non line of sight conditions generated by the position of the tag in the body, received reflections, etc., we propose a new outlier rejection algorithm based on the compatibility of groups of measurements. The fusion was tested evaluating the inclusion of each of the RF systems and varying the number RFID tags used. The proposed method is able to locate a person with less than 2 m of error (for 90 % of the obtained estimations) in the studied trajectory. This particle filter scheme offers robust indoor positioning with 100 % availability and smooth trajectory estimation thanks to the PDR and limited error due to the RF measurements.

Currently, pedestrian dead reckoning (PDR) is widely used in indoor positioning. Its principle is to recursively update the location of pedestrians by using the step count, step length and heading. To estimate the pedestrian heading, a common method in PDR is to utilize magnetometer measurements to estimate the heading of a smartphone. However, magnetometer is extremely vulnerable to magnetic interferences in indoor environments, resulting that magnetometer measurements are unreliable for heading estimation. Moreover, there is an offset angle between the device heading and the pedestrian heading, and the device heading may continuously change while the pedestrian heading keeps fixed. Therefore, the pedestrian heading cannot be simply replaced by the device heading. In this paper, we propose a step-wise method to accurately estimate the heading of a pedestrian who carries a smartphone at different positions. To be specific, the proposed method fuses the signals from the accelerometer, gyroscope and magnetometer of the smartphone to transform the device reference frame to the Earth reference frame, and then utilizes the horizontal angular velocities to establish an optimization problem, the analytical solution of which is obtained. Extensive simulations are carried out and confirm that the proposed method is more robust and more accurate than the existing algorithms.

As the global navigation satellite system (GNSS) faces the problems of signals blocked by various objects and absorbed by many materials in indoor environments, many indoor positioning methods based on smartphones' inertial measurement unit (IMU) become increasingly applicable. Pedestrian dead reckoning (PDR) as one of the most universal methods, several algorithms with high accuracy have been proposed based on it. However, many algorithms are only applicable to scenes where pedestrians are in the “going forward” state. When the pedestrian's motions include complex patterns such as sidestepping and walking backward, PDR will not work normally as the estimated result is far from the real trajectory. In this paper, we design a deep learning model assisted PDR algorithm to recognize the pedestrian's complex motion patterns (going forward, walking backward, left sidestepping, right sidestepping) from the smartphones' IMU. We firstly employ one combined model of trained convolution neural network (CNN) and long short-term memory (LSTM) neural network to determine the correction angle for different motion patterns. Then, we estimate the pedestrian's motion direction by adding the correction angle to the attitude estimated by the inertial navigation system (INS) mechanization. Finally, the position can be computed by the estimated stride length and the corrected motion direction. Compared with different algorithms, the experimental results have proved that our algorithm can effectively process data in complex motion patterns.

Many methods of indoor navigation for smartphones are augmented with Pedestrian Dead Reckoning (PDR) to improve accuracy and to reduce latency. PDR requires an accurate estimate of the device orientation. From the pitch and roll angles the sensor readings can be rotated to the horizontal plane, and with the yaw angle the direction of movement can be determined. While a simple implementation using only accelerometer and magnetometer is possible, more accurate results may be obtained by also including the gyroscope measurements. The approach in this paper uses a Kalman filter to fuse gyroscope with accelerometer and magnetometer readings. The system equation uses random walk on straight trajectories and additional gyroscope readings on turns. Turns are detected using a statistical test on the innovation of the Kalman filter as well as a condition on the estimated yaw-rate from the gyroscope. A second Kalman filter separates gravity from specific force by processing acceleration measurements. The estimated gravity is used in the orientation filter to determine pitch and roll. The filter has been tested using trajectories with known ground truth taken with off the shelf mobile devices in corridor and office environments. The outer heading accuracy approaches 10°, dominated by systematic effects, largely due to magnetic disturbances. The achieved inner accuracy for the heading is 4°.

In this paper, a simultaneous localization and mapping algorithm for tracking the motion of a pedestrian with a foot-mounted inertial measurement unit is proposed. The algorithm uses two maps, namely, a motion map and a magnetic field map. The motion map captures typical motion patterns of pedestrians in buildings that are constrained by e.g. corridors and doors. The magnetic map models local magnetic field anomalies in the environment using a Gaussian process model and uses them as position information. These maps are used in a Rao-Blackwellized particle filter to correct the pedestrian position and orientation estimates from the pedestrian dead-reckoning. The pedestrian dead-reckoning is computed using an extended Kalman filter with zero-velocity updates. The algorithm is validated using experimental sequences and the results show the efficacy of the algorithm in localizing pedestrians in indoor environments.

Location estimation is significant in mobile and ubiquitous computing systems. The complexity and smaller scale of the indoor environment impose a great impact on location estimation. The key of location estimation lies in the representation and fusion of uncertain information from multiple sources. The improvement of location estimation is a complicated and comprehensive issue. A lot of research has been done to address this issue. However, existing research typically focuses on certain aspects of the problem and specific methods. This paper reviews mainstream schemes on improving indoor location estimation from multiple levels and perspectives by combining existing works and our own working experiences. Initially, we analyze the error sources of common indoor localization techniques and provide a multilayered conceptual framework of improvement schemes for location estimation. This is followed by a discussion of probabilistic methods for location estimation, including Bayes filters, Kalman filters, extended Kalman filters, sigma-point Kalman filters, particle filters, and hidden Markov models. Then, we investigate the hybrid localization methods, including multimodal fingerprinting, triangulation fusing multiple measurements, combination of wireless positioning with pedestrian dead reckoning (PDR), and cooperative localization. Next, we focus on the location determination approaches that fuse spatial contexts, namely, map matching, landmark fusion, and spatial model-aided methods. Finally, we present the directions for future research.