Collaborative indoor navigation for emergency services personnel

Abstract. Typically, in situations where Global Navigation Satellite System (GNSS) signals are unavailable, navigation systems rely on integrating GNSS and inertial navigation system (INS) data. While such integration can provide accurate positioning during short GNSS signal outages, it cannot sustain prolonged GNSS outages. The reason for this is that the system's performance depends solely on the INS and can result in significant errors over time. To address this issue, additional onboard sensors are necessary. This study proposes a navigation system that integrates INS and LiDAR simultaneous localization and mapping (SLAM) using an extended Kalman filter (EKF). The system was tested using the raw KITTI dataset in various outdoor driving scenarios without GNSS signals. It is shown that the proposed system significantly outperformed the INS-only system, with an average RMSE improvement of around 93% and 58% in the horizontal and the up directions, respectively.

As the global navigation satellite system (GNSS) faces the problems of signals blocked by various objects and absorbed by many materials in indoor environments, many indoor positioning methods based on smartphones' inertial measurement unit (IMU) become increasingly applicable. Pedestrian dead reckoning (PDR) as one of the most universal methods, several algorithms with high accuracy have been proposed based on it. However, many algorithms are only applicable to scenes where pedestrians are in the “going forward” state. When the pedestrian's motions include complex patterns such as sidestepping and walking backward, PDR will not work normally as the estimated result is far from the real trajectory. In this paper, we design a deep learning model assisted PDR algorithm to recognize the pedestrian's complex motion patterns (going forward, walking backward, left sidestepping, right sidestepping) from the smartphones' IMU. We firstly employ one combined model of trained convolution neural network (CNN) and long short-term memory (LSTM) neural network to determine the correction angle for different motion patterns. Then, we estimate the pedestrian's motion direction by adding the correction angle to the attitude estimated by the inertial navigation system (INS) mechanization. Finally, the position can be computed by the estimated stride length and the corrected motion direction. Compared with different algorithms, the experimental results have proved that our algorithm can effectively process data in complex motion patterns.

Commonly used Global Navigation Satellite Systems (GNSS) are inappropriate as Location Based Services (LBS) in indoor environment. Therefore research teams are developing different systems, which can be used as a suitable alternative. One of options is to use Inertial Navigation System (INS) which consists of inertial sensors and mathematic procedures. This concept has been known for a long time, but with arrival of Microelectro Mechanical System (MEMS) INS found wide use. Smartphones with inertial sensors, such as accelerometers and gyroscopes, allow us to use them as input devices for Pedestrian Dead Reckoning (PDR). In this paper we present PDR by using smartphone sensors. They can be classified as low-cost Inertial Measurement Unit (IMU), and have been compared with more precise and expensive Xsens IMU. Accuracy of inertial sensors has increased in the past few years, but they still cannot alone provide proper accuracy because of many negative effects, such as heading drift due to gyroscope bias. Particle Filter (PF) has been successfully used with map constraints to increase the accuracy of proposed location system. Presented results show that low-cost smartphone IMU combined with PF can be applicable as proper navigation system.

In this paper, we develop a novel method to detect Global Navigation Satellite Systems (GNSS) spoofing for an Automatic Dependent Surveillance-Broadcast (ADS-B) equipped aircraft. The Federal Aviation Administration (FAA) has mandated [18] all civil aircraft to be ADS-B Out equipped by January 1, 2020. The ADS-B Out broadcast sent to Air Traffic Control (ATC) consists of the aircraft's position, velocity, and other aircraft-specific information, all of which being unencrypted, poses a serious integrity threat. With readily available ADS-B trackers [19], [20], a spoofer can accurately track an aircraft to generate a spoofed trajectory that can go undetected [11]. We propose a novel method to modulate the ADS-B Out position broadcast such that a spoofed trajectory generated using the modulated ADS-B will be detectable by comparing Inertial Navigation System (INS) positions against those obtained using the spoofed GNSS signal. The amplitude of ADS-B modulation is selected to exceed the nominal INS error covariance so that spoofing is observable. In this work, we analytically quantify the magnitude of ADS-B modulation that will be sufficient for spoofing detection. During scenarios of GNSS signal jamming and spoofing, reauthentication of a reacquired GNSS signal is necessary to maintain integrity. During a GNSS outage, given enough time, the INS solution drift will grow large enough such that the spoofed GNSS solution might be within the INS error covariance envelope and go undetected. For GNSS outage scenarios we propose continuous modulation of ADS-B position and analytically quantify the magnitude such that spoofing of the GNSS signal is detectable after signal is re-acquired.

With the rapid development of high-speed trains in the world, how to quickly collect train operation data becomes a significant issue. The paper uses Global Navigation Satellite System (GNSS), Inertial Navigation System (INS), and Driver Machine Interface (DMI) information fusion to obtain the position and speed information of the train more accurately. Among these information sources, GNSS and INS can carry out the collection of train position and speed information with and without obstructions, respectively. When the train is running in the open and unobstructed, GNSS can directly obtain train operation information. When the train passes through an environment with obstructions, GNSS and INS work simultaneously to obtain train operation information. The DMI on the train has the timely speed and kilometer mark information of the train. During the measurement, as we can not access to the onboard equipment. The camera is applied to collect the DMI interface. The image is processed to obtain the train data information. In this paper, the train data collected by GNSS/INS equipment is corrected by the Kalman filtering method. The data collected by DMI is filtered by the kinematics theorem and the least square method. What is more, a centralized fusion structure is used to process the DMI, GNSS, and INS data. This result can provide more accurate train time, speed, and kilometer mark information for the train during the operation test.

Conventional global navigation satellite system (GNSS)/micro-electromechanical strapdown inertial navigation system (MEMS-SINS) tight integration encounters some major limitations in GNSS-challenged areas. It is GNSS signal impairments due to the complex environment surrounding GNSS antenna, that plagues the acquired integration performance, resulting in significant accuracy degradation of MEMS-based inertial navigation. To improve the overall performance of GNSS/MEMS-SINS tightly-coupled (TC) system, this paper proposes the following three-tier approach at different levels without either additional sensors or GNSS base stations: 1) improving the stochastic modeling for both MEMS sensors and GNSS receiver clock errors using Allan variance (AV) analysis and satellite-differencing (SD) at the dynamics level, 2) enhancing the integration by augmenting unambiguous time-differenced carrier phase (TDCP) into Kalman filter at the measurement level, and 3) eliminating the adverse effects of GNSS outliers by devising innovation-based test statistics at the information fusion level. The field test results indicate that the proposed algorithm could improve the overall navigation accuracy by about 42.14% (position), 38.96% (velocity) and 33.56% (attitude) with immunity to both GNSS outliers and cycle slips, compared with conventional TC counterpart. Moreover, it can also significantly reduce the coasting errors and improve the relative position accuracy during relatively long outages. The results demonstrate the effectiveness of the proposed algorithm in reducing the growth of MEMS-SINS error.

As the Global Satellite Navigation Systems (GNSS) signals are received and processed by the GNSS receivers with an extremely low power, they are vulnerable to non-intentional and intentional interference. In particular, the intentional transmission of Radio Frequency interference, known as jamming, can completely prevent the operation of GNSS receivers. The integration of measurements from multiple sensors with complementary error characteristics offers a possible countermeasure against jamming and, therefore, it can provide a position solution that has sufficient accuracy for the applications. This paper shows how a Deeply Coupled (DC) integration of GNSS with Inertial Navigation Systems (INS) and visual sensors enhances the robustness of the navigation system in presence of jamming. In particular, the effect of DC integration for jamming mitigation is investigated for a dynamic scenario where jamming signals have been added to a pre-recorded GNSS scenario by using the record and replay approach, emulating different interference levels. The results presented in this paper show that the deep coupling of GNSS with INS and visual sensors can sustain the navigation in presence of high power jamming, although such a strong interference completely masks the GNSS signal denying the navigation of a GNSS stand-alone system. Moreover, the test procedures suitability of the record and replay approach for the jamming scenario generation and combination with real datasets are discussed and analyzed.

Navigation applications and location-based services are currently becoming standard features in smart phones with built-in GPS receivers. However, a ubiquitous navigation solution which locates a mobile user anytime anywhere is still not available, especially in Global Navigation Satellite System (GNSS) degraded and denied environments. Different motion sensors and angular sensors have been adopted for augmenting the positioning solutions for such environments. An electromyography (EMG) sensor, which measures electrical potentials generated by muscle contractions from human body, is employed in this paper to detect the muscle activities during human locomotion and captures the human walking dynamics for motion recognition and step detection in a Pedestrian Dead Reckoning (PDR) solution. The work presented in this paper is a consecutive step of our pilot studies in developing a novel and robust PDR solution using wearable EMG sensors. The PDR solution includes standing and walking identification, step detection, stride length estimation, and a position calculation with a heading angular sensor. A situation of standing still is identified from the EMG signals collected from a walking process, which has standing and walking dynamics, via a hidden Markov model classifier fed by sample entropy features. Such pre-classified processing reduces the misdetection rate of step detection. After step detection, two stride length estimation methods are investigated for the PDR solution. Firstly, a linear stride length estimation method based on statistic models is investigated to improve the accuracy of the PDR solution. Secondly, five different walking motions are recognized by a motion recognition algorithm based on some particular EMG features, and a fixed stride length is then set for each walking motion to propagate the position. To validate the effectiveness and practicability of the methods mentioned above, some field tests were conducted by a few testers. The test results indicate that the performance of the proposed PDR solution is comparable to that of a commercial GPS receiver in outdoor test under an open-sky environment.

Ship navigation requires accurate positioning, navigation and timing (PNT) data. PNT data from a single source has uncertainties and potential risks. Wrong PNT data has a huge impact on ship maneuvering, and at the same time, it may cause huge losses to national assets and national security. This chapter proposes a data fusion algorithm based on single-frequency global navigation satellite system (GNSS) and inertial navigation system (INS) to obtain PNT data, which can improve the availability, accuracy, reliability, continuity, and robustness. The experimental results show that the data fusion method combining median filtering and Kalman filtering can improve the system's ability to acquire PNT data. When blocking GNSS acquisition of PNT data, relying on INS, you can still obtain PNT data, which can make up for the ability to obtain PNT data from GNSS.

Abstract. Multisensor systems are essential for autonomous navigation applications to achieve reliable accuracy. Integrating the Global Navigation Satellite System (GNSS) and the Inertial Navigation System (INS) is the most common integration scheme. However, this integration is unreliable in different scenarios since the GNSS signal may deteriorate in downtown areas or suffer from a blockage in underground and indoor areas. Therefore, other sensors are integrated with INS to compensate for GNSS outages. This paper proposes a novel algorithm for radar/INS tightly-coupled integration for autonomous navigation applications. This algorithm is applied in multiple steps. Radar data analysis is the first and most crucial step to remove the noisy data and the outliers and keep the useful objects. Then, data association is done to match the detected objects between radar frames. The tightly-coupled integration is performed at the measurement level through an Extended Kalman Filter (EKF), where the distance between the INS and the detected objects can be predicted from the INS and measured from the radar. Real data was collected from four Frequency Modulated Continuous Wave (FMCW) radar units in Calgary's suburban areas and Toronto's downtown area. The proposed algorithm was tested and assessed by introducing simulated GNSS single outages with different durations. The results show an enhancement in the vehicle's position by about 94% to 96%.

A method is presented to synchronize and aid the absolute navigation solutions of the members of a swarm by means of relative inter-swarm measurements. Moreover, the operational benefits thereof are discussed. Collaborative operation of vehicles, especially of unmanned aerial vehicles in close formation, requires accurate relative and absolute navigation. A novel method for collaborative multi-sensors fusion of relative and absolute navigation information is presented designed to cope with GNSS-denied environment. Relative inter-swarm measurements and absolute navigation means cannot be fused straight away as they are defined in fundamental different frames. Moreover, the sensor fusion has to fulfill two objectives – firstly, restoring the relative geometry of the swarm, and secondly, determining the absolute positions of each vehicle in an optimal way for the overall swarm. Key for collaborative navigation is to establish a common knowledge within the swarm which is achieved by exchanging the absolute state estimations, the state uncertainties and the relative measurements. Based on the common knowledge the “Consistent INS Drift Algorithm” computes for each vehicle a new position which is statistically optimal for the overall swarm. Simultaneously, these new positions represent the actual geometry of the swarm by essentially resampling the relative measurements. By fusing these new positions the navigation filters are synchronized and the relative measurements are implicitly used to aid the absolute navigation solutions. This reveals several operational benefits: the absolute navigation solutions are consistent – the whole swarm drifts consistently as only the Inertial Navigation Systems (INS) may remain as absolute navigation means, and hence, the naming “Consistent INS Drift Algorithm”. Moreover, the drift is statistically slower than the best individual INS. Having at least one vehicle equipped with a drift-free navigation mean such as Terrain Referenced Navigation stops the swarm to drift. Therefore, heterogeneous navigation systems are natively supported enabling true collaboration.

Accuracy assessment of integrated GNSS measurements with LIDAR mobile mapping data in urban environments

The sidewalk is often located in complex environments such as buildings or covered by dense trees. Satellite navigation systems are susceptible to the surrounding environment, resulting in multipath effects, resulting in reduced positioning accuracy. Therefore, the global satellite navigation system (GNSS) and inertial navigation system (INS) based on kalman filter (KF) algorithm are studied, and the navigation algorithm and system model suitable for pedestrians are given. Considering that the pedestrian speed is low, the satellite navigation system obtains the carrier orientation information (heading angle), which also produces a large error. Therefore, the pedestrian dead reckoning (PDR) correction method is adopted to make the positional accuracy of the integrated navigation continuously stable. This paper proposes a pedestrian navigation system solution based on a single navigation device.

In the near future, multi-sensor fusion will be the core component to navigate the autonomous driving platforms. This paper proposes new strategies to cope with the integration of an inertial navigation system (INS), a global navigation satellite system (GNSS), and light detection and ranging (LIDAR) to achieve simultaneous localization and mapping (INS/GNSS/LiDAR SLAM) especially in GNSS challenging environments where GNSS signals are blocked or contaminated with reflected signals. The proposed strategies implement a high level of integration with various information received from multiple sensors to collectively compensate for the specific drawbacks of those sensors included in the integrated system. The first strategy is to solve the divergence and drift problems of SLAM using the initial pose information from INS and the proposed refreshing process using an INS/GNSS integrated system. In addition, an updated mechanization is designed to qualify those received measurements based on cross validation of separate types of data. This mechanization is to ensure all measurements are reliable for the Extended Kalman Filter (EKF) update process. Moreover, the SLAM-derived information plays a major role to recognize the vehicle movement which assists the system to accurately apply those appropriate vehicle motion constraint models. The preliminary results presented in this study illustrate that proposed algorithm performs superior than the traditional INS/GNSS integration scheme and provides absolute navigation accuracy of 2 meters and 0.6% of distance traveled in GNSS-denied as well as 1.2 meters in GNSS-hostile environments, respectively.

During the past few decades, the presence of global navigation satellite systems (GNSSs) such as GPS, GLONASS, Beidou and Galileo has facilitated positioning, navigation and timing (PNT) for various outdoor applications. With the rapid increase in the number of orbiting satellites per GNSS, enhancements in the satellite-based augmentation systems (SBASs) such as EGNOS and WAAS, as well as commissioning new GNSS constellations, the PNT capabilities are maximized to reach new frontiers. Additionally, the recent developments in precise point positioning (PPP) and real time kinematic (RTK) algorithms have provided more feasibility to carrier-phase precision positioning solutions up to the third-dimensional localization. With the rapid growth of internet of things (IoT) applications, seamless navigation becomes very crucial for numerous PNT dependent applications especially in sensitive fields such as safety and industrial applications. Throughout the years, GNSSs have maintained sufficiently acceptable performance in PNT, in RTK and PPP applications however GNSS experienced major challenges in some complicated signal environments. In many scenarios, GNSS signal suffers deterioration due to multipath fading and attenuation in densely obscured environments that comprise stout obstructions. Recently, there has been a growing demand e.g. in the autonomous-things domain in adopting reliable systems that accurately estimate position, velocity and time (PVT) observables. Such demand in many applications also facilitates the retrieval of information about the six degrees of freedom (6-DOF - x, y, z, roll, pitch, and heading) movements of the target anchors. Numerous modern applications are regarded as beneficiaries of precise PNT solutions such as the unmanned aerial vehicles (UAV), the automatic guided vehicles (AGV) and the intelligent transportation system (ITS). Hence, multi-sensor fusion technology has become very vital in seamless navigation systems owing to its complementary capabilities to GNSSs. Fusion-based positioning in multi-sensor technology comprises the use of multiple sensors measurements for further refinement in addition to the primary GNSS, which results in high precision and less erroneous localization. Inertial navigation systems (INSs) and their inertial measurement units (IMUs) are the most commonly used technologies for augmenting GNSS in multi-sensor integrated systems. In this article, we survey the most recent literature on multi-sensor GNSS technology for seamless navigation. We provide an overall perspective for the advantages, the challenges and the recent developments of the fusion-based GNSS navigation realm as well as analyze the gap between scientific advances and commercial offerings. INS/GNSS and IMU/GNSS systems have proven to be very reliable in GNSS-denied environments where satellite signal degradation is at its peak, that is why both integrated systems are very abundant in the relevant literature. In addition, the light detection and ranging (LiDAR) systems are widely adopted in the literature for its capability to provide 6-DOF to mobile vehicles and autonomous robots. LiDARs are very accurate systems however they are not suitable for low-cost positioning due to the expensive initial costs. Moreover, several other techniques from the radio frequency (RF) spectrum are utilized as multi-sensor systems such as cellular networks, WiFi, ultra-wideband (UWB) and Bluetooth. The cellular-based systems are very suitable for outdoor navigation applications while WiFi-based, UWB-based and Bluetooth-based systems are efficient in indoor positioning systems (IPS). However, to achieve reliable PVT estimations in multi-sensor GNSS navigation, optimal algorithms should be developed to mitigate the estimation errors resulting from non-line-of-sight (NLOS) GNSS situations. Examples of the most commonly used algorithms for trilateration-based positioning are Kalman filters, weighted least square (WLS), particle filters (PF) and many other hybrid algorithms by mixing one or more algorithms together. In this paper, the reviewed articles under study and comparison are presented by highlighting their motivation, the methodology of implementation, the modelling utilized and the performed experiments. Then they are assessed with respect to the published results focusing on achieved accuracy, robustness and overall implementation cost-benefits as performance metrics. Our summarizing survey assesses the most promising, highly ranked and recent articles that comprise insights into the future of GNSS technology with multi-sensor fusion technique.