A Visual Odometry Artificial Intelligence‐Based Method for Trajectory Learning and Tracking Applied to Mobile Robots

Developing an autonomous indoor mobile robot navigation system from scratch is very difficult and it takes a long time. It requires a series of complex tasks such as handling given sensor inputs, calculating all the information needed for autonomous navigation, and controlling actuators required for movement. In this paper, an autonomous navigation system for indoor mobile robots is introduced mainly based on open source provided by the robot operating system. The presented system is capable of autonomously navigating an unstructured indoor environment avoiding collision with static or dynamic objects. To this end, the system consists of three main modules: mapping, localization, and planning. The mapping module builds a global map for an unknown environment by means of a simultaneous localization and mapping algorithm based on laser scanner data. The localization module estimates the mobile robot’s pose within the prebuilt map by way of an adaptive Monte Carlo localization approach. The planning module builds a local cost map for collision avoidance, generates collision-free trajectories to reach a goal pose based on the cost map, and produces control commands to follow the trajectories. The presented system has been tested not only in simulation environments built in the Gazebo simulator but also in real environments utilizing the Jackal mobile robot, to validate its performance for autonomous navigation including collision avoidance.

The obstacle avoidance and navigation are important tasks for a mobile robot in applications such as industry, military, exploration and automated vehicles. This paper presents an implementation of mapping and navigation of autonomous mobile robot using Robot Operating System (ROS) and Orbbec Astra camera. In recent days, Lidar is used for the mapping and navigation problem by sensing the objects which are above floor level by using only a single horizontal scanning line and this may result in inaccurate generation of map leads to collision during autonomous navigation of mobile robots. In order to overcome limitation of Lidar, Orbbec Astra (Kinect) camera is used for mapping of indoor environment which can detect objects which are above and below the floor level and navigation of mobile robot from start to target location without colliding with obstacles. Experimental results show the map of the indoor environment generated using Orbbec Astra camera is matched with real indoor environment, and generated map is tested experimentally to navigate the mobile robot from start to target location without collision with obstacles.KeywordsMobile robotsMappingNavigationOrbbec Astra cameraROS

Research on mobile robots began in the late sixties with the Stanford Research Institute’s pioneering work. Two versions of SHAKEY, an autonomous mobile robot, were built in 1968 and 1971. The main purpose of this project was “to study processes for the realtime control of a robot system that interacts with a complex environment” 〈NIL 69〉. Indeed, mobile robots were and still are a very convenient and powerful support for research on artificial intelligence oriented robotics. They possess the capacity to provide a variety of problems at different levels of generality and difficulty in a large domain including perception, decision making, communication, etc., which all have to be considered within the scope of the specific constraints of robotics: on-line computing, cost considerations, operating ability, and reliability.

Aiming at the navigation of indoors autonomous mobile service robots, we propose a mobile robot coordinate positioning solution based on ultrasonic navigation with environment map. With the low cost sensor and simple algorithm, the service robot can obtain higher accuracy current position coordinate, and then reach the working position. This paper introduces the positioning principle and implementation of this method in detail.

High-precision indoor localization and tracking are essential requirements for the safe navigation and task execution of autonomous mobile robots. Despite the growing importance of mobile robots in various areas, achieving precise indoor localization remains challenging due to signal interference, multipath propagation, and complex indoor layouts. In this work, we present the first comprehensive study comparing the accuracy of Bluetooth low energy (BLE), WiFi, and ultra wideband (UWB) technologies for the indoor localization of mobile robots under various circumstances. In the performed experiments, the error margin of the WiFi-based systems reached 608.7 cm, which is not tolerable for most applications. As a commonly used technology in the existing tracking systems, the accuracy of BLE-based systems is at least 44.12% better than that of WiFi-based systems. The error margin of the BLE-based system in tracking static and mobile robots was 191.7 cm and 340.1 cm, respectively. The experiments showed that even with a limited number of UWB anchors, the system provides acceptable accuracy for tracking the mobile robots. Using only four UWB beacons in an environment of about 431 m2 area, the maximum error margin of detected positions by the UWB-based tracking system remained below 13.1 cm and 28.9 cm on average for the static and mobile robots, respectively. This error margin is 88.05% lower than that of the BLE-based system and 93.27% lower than that of the WiFi-based system on average. The high tracking precision, the need for a lower number of anchors, and the decreasing hardware costs point out that UWB will be the dominating technology in indoor tracking systems in the near future.

Robot navigation and obstacle avoidance are from the most important problems in mobile robots, especially in unknown environments. The autonomous navigation of mobile robots has attracted a number of researchers over the years. A wide variety of approaches and algorithms have been proposed to tackle this complex problem. There are many successful localization methods that can determine the robot's position relative to a map using sonar, laser and camera data; however, most localization methods fail under common environmental conditions. In this paper we present a novel method for navigation of autonomous mobile robots in several indoor environments that optimize our old navigation approach, using fuzzy Kalman filter based on extracted lines and fusing data from laser scanner sensors. In this approach, the sonar data and laser measurement are combined using the fuzzy Kalman filter. Finally, the simulation results show that the proposed algorithm offers advantages over previous methods and has improved performance.

Increase of effectiveness of navigation in the case of autonomous mobile robots with limited sensory systems integrated that operate in different types of production facilities is considered in this research work. The challenge is to define a reliable solution in a cost-effective design. The research methodology integrates TRIZ within the framework of voice-of-use-table-performance function deployment (VOUT-PFD) design planning framework. The key user requirements and engineering specifications defined with VOUT-PFD have been analyzed in terms of correlations. For the identified sets of negative correlations, TRIZ Contradiction Matrix has been considered to formulate the generic areas for inventive problem-solving. Using the method of weighted analysis of interdependencies (AIDA), the compatible TRIZ vectors have been selected for guiding the design of the artificial intelligence (AI) algorithm. These vectors have been introduced in the framework of Complex System Design Technique (CSDT) in relation with generic modules of the AI system (algorithm, related inputs from the sensors and mechanical limitations of the robotic system) in order to design the navigation solution. In this article eight areas of possible improvements using AI algorithms have been found and the first area of research, which represents the robot construction is further detailed. The major result of this paper is that it shows a structured way in which inventive problem-solving thinking can lead to possible improvement areas regarding navigation of autonomous mobile robots (AMRs) in industrial environment.

A novel approach for landmark recognition based on the perception, reasoning, action, and expectation (PREACTE) paradigm is presented for the navigation of autonomous mobile robots. PREACTE uses expectations to predict the appearance and disappearance of objects, thereby reducing computational complexity and locational uncertainty. It uses an innovative concept called dynamic model matching (DMM), which is based on the automatic generation of landmark description at different ranges and aspect angles and uses explicit knowledge about maps and landmarks. Map information is used to generate an expected site model (ESM) for search delimitation, given the location and velocity of the mobile robot. The landmark recognition vision system generates 2-D and 3-D scene models from the observed scene. The ESM hypotheses are verified by matching them to the image model. Experimental results that verify the performance of the PREACTE and DMM algorithms for real imagery are also presented.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Accurate energy prediction is essential for energy-aware planning and navigation of autonomous mobile robots (AMRs). This study investigates whether a compact feed-forward neural network (FFNN) can predict relative energy consumption from operational variables with high accuracy and interpretability. Using a curated dataset of controlled translation and rotation trials on a KUKA KMP 1500P, energy demand is expressed as the per-trial reduction in battery state of charge (SoC), defined as N1%. For unit-free reporting, it is also considered the normalized SoC consumed per trial, defined as E=1/N1%. Model development followed a two-stage optimization pipeline, (i) systematic feature-subset screening and (ii) cross-validated architecture and regularization search with early stopping, assessed by a composite of MSE, MAE, R2, and the 68th-percentile absolute error (∆X68) as the prediction precision index. The selected FFNN (ReLU multilayer perceptron with L2 weight decay) achieved strong generalization on the independent test set (MAE = 0.9954, MSE = 4.5512, R2 = 0.9795, ∆X68 = 0.0193). Post hoc explainability methods (SHAP and input perturbation) identified angular velocity and linear acceleration as the dominant predictors, with payload mass exerting secondary effects. These results demonstrate that a compact, regularized FFNN provides accurate, repeatable, and interpretable energy predictions suitable for integration into digital twin platforms and downstream industrial scheduling.

Aiming at the problem of positioning and navigation of mobile robots indoors, this paper designs and implements related functions based on Robot Operating System and laser radar. The core controller of the robot adopts an industrial computer, and is equipped with a laser radar to acquire information about the surrounding environment and develop related algorithms on the Robot Operating System. Realize Simultaneous Localization and Mapping function based on Cartographer algorithm, path planning based on optimal path algorithm and navigation function based on particle filter algorithm. The real machine experiment proves that the system can efficiently perform real-time synchronous positioning and map construction and navigation functions.

Localization of a vehicle is a key component for driving assistance or autonomous navigation. In this work, we propose a visual positioning system (VPS) for vehicle or mobile robot navigation. Different from general landmark-based or model-based approaches, which rely on some predefined known landmarks or a priori information about the environment, no assumptions on the prior knowledge of the scene are made. A stereo-based vision system is built for both extracting feature correspondences and recovering 3-D information of the scene from image sequences. Relative positions of the camera motion are then estimated by registering the 3-D feature points from two consecutive image frames. Localization of the vehicle is finally given by the reference to its initial position. I. INTRODUCTION Localization and tracking of a vehicle are major compo- nents for providing positions, directions and travel informa- tion to the driver. They also serve as key technologies for building autonomous navigation systems. Many approaches have been proposed for locating a mobile robot or a ve- hicle based on various techniques. The most commonly used methods include dead-reckoning techniques, navigation using active beacons, landmark-based navigation, map-based navigation, global positioning system (GPS), and vision- based positioning. Dead-reckoning is a procedure for determining the present location of a vehicle by advancing some previous position through known path and velocity information over a given period of time. Since an odometer and optical sensors for wheel direction detection are easily installed on a vehicle, dead-reckoning is usually a less expensive method for vehicle localization. However, the integration of incremental motion information over time will lead to accumulation of errors. In the case of long distance travel, accumulation of orientation error will make position errors diverge as the increase of driving time. Active beacons such as laser, sonar or radio can be used as media for vehicle or mobile robot navigation. These approaches use triangulation to measure the distance between a number of beacons and the mobile platform and then deter- mine the current location. The problems associated with this technique are the inaccuracy of the distance measurement caused by time-delay of the signals, and the installation and maintenance cost of a large number of beacons required for an area. Satellite based differential global positioning system (DGPS) is probably the most advanced and accurate method for identifying the position and orientation of an object. However, DGPS does not work well if the satellite signals are blocked. This situation commonly happens in the indoor environments, or urban areas with tall buildings, etc. In this work, we propose a visual positioning system (VPS) for vehicle or mobile robot navigation. Different from general landmark-based or model-based approaches which rely on some predefined known landmarks or ap rioriinfor- mation about the environment (e.g., 3-D models of buildings, objects, etc.), no assumptions on the prior knowledge of the scene are made. A stereo-based vision system is built for both extracting feature correspondences and recovering 3- D information of the scene from image sequences. A robust feature tracking method based on simultaneously considering the inter-frame images from the same camera and the stereo image pair from different cameras at a fixed time instant is developed. The relative position of the camera motion is then estimated by registering the 3-D feature points from two consecutive image frames. Our system includes the following basic modules:

This paper proposes an end-to-end method for training convolutional neural networks for autonomous navigation of a mobile robot. Traditional approach for robot navigation consists of three steps. The first step is extracting visual features from the scene using the camera input. The second step is to figure out the current position by using a classifier on the extracted visual features. The last step is making a rule for moving the direction manually or training a model to handle the direction. In contrast to the traditional multi-step method, the proposed visuo-motor navigation system can directly output the linear and angular velocities of the robot from an input image in a single step. The trained model gives wheel velocities for navigation as outputs in real-time making it possible to be implanted on mobile robots such as robotic vacuum cleaner. The experimental results show an average linear velocity error of 2.2 cm/s and average angular velocity error of 3.03 degree/s. The robot deployed with the proposed model can navigate in a real-world environment by only using the camera without relying on any other sensors such as LiDAR, Radar, IR, GPS, IMU.

The key to effective autonomous mobile robot navigation is accurate self-localization. Without self-localization or with inaccurate self-localization, any non-holonomic autonomous mobile robot is blind in a navigation environment. The KCLBOT [1] is a nonholonomic two wheeled mobile robot that is built around the specifications for ‘Micromouse Robot’ and the ‘RoboCup’ competition. These specifications contribute to the mobile robot’s form factor and size. The mobile robot holds a complex electronic system to support on-line path planning, self-localization, and even simultaneous localization and mapping (SLAM), which is made possible by an onboard sensor array. The mobile robot is loaded with eight Robot-Electronics SRF05 [2] ultrasonic rangers, and its drive system is supported by Nubotics WC-132 [3] WheelCommander Motion Controller and two WW-01 [4] WheelWatcher Encoders. The motors for robot are modified continuous rotation servo motors, which are required for the WheelCommander Motion Controller. The rotation of the mobile robot is measured by Robot-Electronics CMPS03 [5] Compass Module. These two modules make the double compass configuration, which supports the self-localization theory presented in this paper. Each individual module provides the bearing of the mobile robot relative to the magnetic field of the earth. The central processing for the mobile robot is managed by a Savage Innovations OOPic-R microcontroller. The OOPic-R has advanced communication modules to enable data exchange between the sensors and motion controller. Communication is managed via a serial bus and an 2 I C bus. The electronics are all mounted on two aluminium bases, which make the square structure of the mobile robot. To support the hardware requirements of the novel localisation methodology, the cutting edge technology of a 200 MHz 32-bit ARM 9 processor on a GHI ChipworkX module [6] is employed. The software architecture is based on the Microsoft .NET Micro Framework 4.1 using C# and the Windows Presentation Foundation (WPF). The combination of hardware electronics and drive mechanics, makes the KCLBOT, as represented in Fig. 1, a suitable platform for autonomous self-localization. Many different systems have been considered for self-location, from using visual odometry [7] to using a GPS method. While all of these have benefits and detriments, the solution

-By using the two methods of Lyapunov exponent and power spectra analysis, it is tested and verified that Chaotic phenomenon exists in time sequence of distance information that autonomous mobile robot has got from sensors between robots and obstacles. The complexity of path planning for autonomous mobile robot through sensors is explained under dynamic environments by use of chaotic phenomenon. The existence of chaotic phenomenon makes the path planning for autonomous mobile robot under dynamic environments NP-hard and also lays the foundation for revealing why navigation of autonomous mobile robot under dynamic environments is NP-hard.

The construction of a smart autonomous mobile robot system that can operate in an anonymous environment can be difficult. Building an autonomous mobile robot requires collecting data from sensors and cameras in order to recognize the surrounding environment, get knowledge of existing landmarks, and figure out its position and orientation. Many research studies have been carried out in recent years providing algorithms for achieving autonomous motion of mobile robot systems and object detection. The most common platform utilized for robot motion design is ROS (Robot Operating System) and for object detection YOLO (You Only Look Once) is a common choice. Additionally, the autonomous system needs motion planning in a systematic way to avoid obstacles by using LIDAR or other sensing methods generating the feedback signals required for control of motion around occupied spaces. One of the most effective and versatile feedback systems for mobile robot control can be constructed using visual feedback, which relies on a high-resolution camera that processes the image in real-time and the result is fed back to the control system for decision making. Visual feedback can be employed alone without sensors for feedback control of autonomous mobile robots, and it can be used for multiple tasks like path planning, obstacle avoidance, object detection, object recognition in addition to motion control. In this research, results of design and construction of an autonomous mobile rescue robot for finding victims through video data are presented. It is aimed to find victims via applying video as a data collection and feedback generation tool in the autonomous mobile robot control system. The visual feedback and YOLO v3 are used not only for finding victims but also for motion control. Our autonomous mobile robot is designed to move smoothly to the victim's direction and avoids obstacles by using ROS Global Planner. The robot is tested in multiple scenarios in different locations, various obstacle and victim numbers, and satisfactory results with good performances are obtained.