ORB-SLAM based humanoid robot location and navigation system

Recently, stereovision has appeared in robotics as a source of information for real-time mapping and path planning. In this paper, an intelligent motion system for mobile robots is designed and implemented using stereovision. The proposed system uses stereovision as a primary method for sensing the environment, and the system is able to navigate intelligently in an indoor environment with varying degrees of obstacle complexity. It creates noiseless and high-confidence 3D point clouds and uses these point clouds as an input for the mapping and path-planning modules. The proposed system was built by developing, enhancing, and integrating various techniques, modules and algorithms. The Stereovision-based Path-planning module is the integration of three main enhanced techniques: (1) the multi-baseline multi-view stereovision filter (MMSVF), (2) accurate floor detection and segmentation (AFDS), and (3) the intelligent gazing module (IGM). This Stereovision-based Path planning (MMSVF, IGM, and AFDS) was integrated with the Fuzzy Logic Motion Controller (FLMC). All techniques, modules and algorithms are implemented using a multi-threaded and client---server-based architecture. To prove the viability and robustness of our proposed system, we have integrated all components of the system into a fully functional mobile robot navigation system. We compared the performance of the main modules with that of similar modules in the literatures, and showed that our modules had better performance. Testing the whole system is more important than just testing each module individually. To the best of our knowledge, the literatures lack such testing. Hence, in this paper we present the performance of our complete integrated system in different environments using different parameters and different architectures.

One of the technologies in the industrial world that utilizes robots is the delivery of goods in warehouses, especially in the goods distribution process. This is very useful, especially in terms of resource efficiency and reducing human error. The existing system in this process usually uses the line follower concept on the robot's path with a camera sensor to determine the destination location. If the line and destination are not detected by the sensor or camera, the robot's navigation system will experience an error. it can happen if the sensor is dirty or the track is faded. The aim of this research is to develop a robot navigation system for efficient goods delivery in warehouses by integrating odometry and Dijkstra's algorithm for path planning. Holonomic robot is a robot that moves freely without changing direction to produce motion with high mobility. Dijkstra's algorithm is added to the holonomic robot to obtain the fastest trajectory. by calculating the distance of the node that has not been passed from the initial position, if in the calculation the algorithm finds a shorter distance it will be stored as a new route replacing the previously recorded route. the distance traversed by the djikstra algorithm is 780 mm while a distance of 1100 mm obtains the other routes. The time for using the Djikstra method is proven to be 5.3 seconds faster than the track without the Djikstra method with the same speed. Uneven track terrain can result in a shift in the robot's position so that it can affect the travel data. The conclusion is that odometry and Dijkstra's algorithm as a planning system and finding the shortest path are very efficient for warehouse robots to deliver goods than ordinary line followers without Dijkstra, both in terms of distance and travel time.

Aiming at the problem of positioning and navigation of mobile robots indoors, this paper designs and implements related functions based on Robot Operating System and laser radar. The core controller of the robot adopts an industrial computer, and is equipped with a laser radar to acquire information about the surrounding environment and develop related algorithms on the Robot Operating System. Realize Simultaneous Localization and Mapping function based on Cartographer algorithm, path planning based on optimal path algorithm and navigation function based on particle filter algorithm. The real machine experiment proves that the system can efficiently perform real-time synchronous positioning and map construction and navigation functions.

Mobile robot, especially wheeled mobile robot, with its simple mechanical structure and inherent agility, has attracted significant attentions for dynamic environment applications in the last two decades (Pin et al. 1994 and Purwin 2006). A general mobile robot Guidance, Navigation and Control (GNC) system is illustrated in the following figure. The main function of guidance system is to generate a feasible trajectory command, usually in multiple dimension of freedom (DOF) to achieve a robot task. The objective of control system is to drive the mobile robot following the commanded trajectory with acceptable tracking errors and stability margin. The function of robot navigation system is to provide accurate position, velocity and/or orientation information for the control system and guidance system. A stable and accurate navigation system is the bridge between the guidance system and control system of mobile robots, which ultimately determines the robot performance.

Localization of a vehicle is a key component for driving assistance or autonomous navigation. In this work, we propose a visual positioning system (VPS) for vehicle or mobile robot navigation. Different from general landmark-based or model-based approaches, which rely on some predefined known landmarks or a priori information about the environment, no assumptions on the prior knowledge of the scene are made. A stereo-based vision system is built for both extracting feature correspondences and recovering 3-D information of the scene from image sequences. Relative positions of the camera motion are then estimated by registering the 3-D feature points from two consecutive image frames. Localization of the vehicle is finally given by the reference to its initial position. I. INTRODUCTION Localization and tracking of a vehicle are major compo- nents for providing positions, directions and travel informa- tion to the driver. They also serve as key technologies for building autonomous navigation systems. Many approaches have been proposed for locating a mobile robot or a ve- hicle based on various techniques. The most commonly used methods include dead-reckoning techniques, navigation using active beacons, landmark-based navigation, map-based navigation, global positioning system (GPS), and vision- based positioning. Dead-reckoning is a procedure for determining the present location of a vehicle by advancing some previous position through known path and velocity information over a given period of time. Since an odometer and optical sensors for wheel direction detection are easily installed on a vehicle, dead-reckoning is usually a less expensive method for vehicle localization. However, the integration of incremental motion information over time will lead to accumulation of errors. In the case of long distance travel, accumulation of orientation error will make position errors diverge as the increase of driving time. Active beacons such as laser, sonar or radio can be used as media for vehicle or mobile robot navigation. These approaches use triangulation to measure the distance between a number of beacons and the mobile platform and then deter- mine the current location. The problems associated with this technique are the inaccuracy of the distance measurement caused by time-delay of the signals, and the installation and maintenance cost of a large number of beacons required for an area. Satellite based differential global positioning system (DGPS) is probably the most advanced and accurate method for identifying the position and orientation of an object. However, DGPS does not work well if the satellite signals are blocked. This situation commonly happens in the indoor environments, or urban areas with tall buildings, etc. In this work, we propose a visual positioning system (VPS) for vehicle or mobile robot navigation. Different from general landmark-based or model-based approaches which rely on some predefined known landmarks or ap rioriinfor- mation about the environment (e.g., 3-D models of buildings, objects, etc.), no assumptions on the prior knowledge of the scene are made. A stereo-based vision system is built for both extracting feature correspondences and recovering 3- D information of the scene from image sequences. A robust feature tracking method based on simultaneously considering the inter-frame images from the same camera and the stereo image pair from different cameras at a fixed time instant is developed. The relative position of the camera motion is then estimated by registering the 3-D feature points from two consecutive image frames. Our system includes the following basic modules:

This study introduces an enhanced ORB-SLAM3 algorithm to address the limitations of traditional visual SLAM systems in feature extraction and localization accuracy within the challenging terrains of open-pit mining environments. It also tackles the issue of sparse point cloud maps for mobile robot navigation. By combining point-line features with a Micro-Electro-Mechanical System (MEMS) Inertial Measurement Unit (IMU), the algorithm improves the feature matching’s reliability, particularly in low-texture areas. The method integrates dense point cloud mapping and an octree structure, optimizing both navigation and path planning while reducing storage demands and improving query efficiency. The experimental results using the TUM dataset and conducting tests in a simulated open-pit mining environment show that the proposed algorithm reduces the absolute trajectory error by 44.33% and the relative trajectory error by 14.34% compared to the ORB-SLAM3. The algorithm generates high-precision dense point cloud maps and uses an octree structure for efficient 3D spatial representation. In simulated open-pit mining scenarios, the dense mapping outperforms at reconstructing complex terrains, especially in low-texture gravel and uneven surfaces. These results highlight the robustness and practical applicability of the algorithm in dynamic and challenging environments, such as open-pit mining.

Path planning aims to find a safe and efficient path from a starting point to an end point, and it has been well developed in fields such as robot navigation, autonomous driving, and intelligent decision systems. However, traditional path planning faces challenges in an uncertain rescuing environment due to limited sensing range and a lack of accurate obstacle information. In order to address this issue, this paper proposes an improved two-stage Theta* algorithm for handling multi-probability obstacle scenarios in unstructured rescue environments. First, a global probability raster map is constructed by integrating historical maps and expert prediction maps with probability weights quantifying the uncertainty in the spatial and temporal distribution of obstacles. Second, a probability-sensitive heuristic function (PSHF) is designed, and a Sigmoid function is used to map the probability field of obstacles, thereby enabling limited penetration in low-risk areas and enforced avoidance in high-risk areas. Furthermore, a multi-stage line-of-sight detection optimization mechanism is proposed, which combines probability soft threshold penetration and backtracking verification to improve the noise robustness. Finally, a hierarchical planning architecture is constructed to separate global probabilistic guidance from local strict obstacle avoidance, ensuring both the global optimality and local adaptability of the path. Extensive simulation results in mine rescue scenarios demonstrate that the proposed method achieves lower path cost and fewer path nodes compared to traditional A*, Dijkstra, and Theta* algorithms, while significantly reducing local replanning overhead and maintaining stable performance across multiple uncertain environments.

People generally find themselves lost while visiting a new indoor location because they are unaware of the building’s architecture, especially when it is a large one or a shopping mall. The Global Position System (GPS) does not work properly in the indoor environment because of the satellite signal attenuation. In this paper, to assist people in finding their path, a Li-Fi (Light-Fidelity) based Indoor Positioning System (IPS) is proposed. A framework is developed based on a Li-Fi LED lamp transmitter and a dongle receiver connected to an Android smartphone to decode the received sequence. The pathfinding graph-based algorithm is proceeded in a REST architecture by a Web service consulting the graph-path database both installed on a Raspberry pi 4. The proposed solution is a low cost and does not require any additional infrastructure. It is easy to implement in most indoor environments like hospitals, buildings, and campuses. A short survey of techniques and algorithms for indoor positioning and navigation with the help of smartphones is also presented.

This paper presents a 3D vision-based autonomous navigation system for wheeled mobile robots equipped with an RGB-D camera. The system integrates SLAM (simultaneous localization and mapping), motion planning, and obstacle avoidance to operate in both static and dynamic environments. A real-time pipeline is developed to construct sparse and dense maps for precise localization and path planning. Navigation meshes (NavMeshes) derived from 3D reconstructions facilitate efficient A* path planning. Additionally, a dynamic “U-map” generated from depth data identifies obstacles, enabling rapid NavMesh updates for obstacle avoidance. The proposed system achieves real-time performance and robust navigation across diverse terrains, including uneven surfaces and ramps, offering a comprehensive solution for 3D vision-guided robotic navigation.

Robot navigation allows robot mobility. Therefore, mobility is an area of robotics that has been actively investigated since robots were first developed. In recent years, interest in personal service robots for homes and public facilities has increased. As a result, robot navigation within the home environment, which is an indoor environment, is being actively investigated. However, the problem with conventional navigation algorithms is that they require a large computation time for their building mapping and path planning processes. This problem makes it difficult to cope with an environment that changes in real-time. Therefore, we propose a humanoid robot navigation algorithm consisting of an image processing and optimization algorithm. This algorithm realizes navigation with less computation time than conventional navigation algorithms using map building and path planning processes, and can cope with an environment that changes in real-time.

Mandibular tumor surgery necessitates precise osteotomies based on tumor boundaries; however, conventional osteotomies often lack accuracy in predicting osteotomy positions and planes, potentially leading to excessive resection of normal bone tissues or residual tumors, thus compromising postoperative quality of life and clinical outcomes. Robotic-assisted surgery (RAS) augmented with artificial intelligence (AI) offers precise localization capabilities, aiding surgeons in achieving accurate osteotomy positioning. This study aimed to evaluate the feasibility and accuracy of a robotic magnetic navigation system for positioning and osteotomy in an intraoral surgical trial of a mandibular tumor model. Patient computed tomography (CT) imaging data of mandibular chin and body tumors were utilized to create 3D printed models, serving as study subjects for mandibular tumor resection. Ten pairs of models were printed for the experimental and control groups. The experimental group (EG) underwent osteotomy using a robot-assisted surgical navigation system, performing osteotomy under robotic navigation following alignment based on preoperative design. The control group (CG) underwent traditional surgery, estimating osteotomy position empirically according to preoperative design. Postoperative CT scans were conducted on both models, and actual postoperative results were compared to preoperative design. Osteotomy accuracy was evaluated by positional and angular errors between preoperatively designed and actual osteotomy planes. For ten randomly selected spots on the left and right sides, respectively, the EG group had mean distance errors of 0.338mm and 0.941mm. These values were obtained from the EG group. In the EG group, on the left side, the mean angular errors were 14.741 degrees, while on the right side, they were 13.021 degrees. For the 10 randomly selected spots on the left and right sides, respectively, the CG had mean distance errors of 1.776mm and 2.320mm. This is in contrast to the results obtained by the EG. It was determined that the left side had a mean angle error of 16.841 degrees, while the right side had an error of 18.416 degrees in the CG group. The above results indicated significantly lower point errors of bilateral osteotomy planes in the experimental group compared to the control group. This study demonstrates the feasibility of electromagnetic navigation robot-assisted intraoral osteotomy for mandibular tumors and suggests that this approach can enhance the precision of clinical surgery.

In this paper, two modules of map modeling and path planning in robot navigation system are studied. Firstly, the indoor environment scene is obtained by monocular camera. Secondly, an adaptive K-means obstacle segmentation algorithm is proposed to obtain the location information of obstacles and construct a real-time two-dimensional environment map. Finally, a fast guided sampling RRT* algorithm (FD-RRT*) is proposed. Based on RRT*, target gravity combined with adaptive step size is used to improve node expansion efficiency, and B-spline curve is used to fit path points. Simulation results show that FD-RRT* algorithm has shorter search time and path length than RRT* algorithm. Based on monocular vision system, the effectiveness of indoor environment modeling and path obstacle avoidance for mobile robots is verified experimentally.KeywordsEnvironment mappingPath planningRRT*Target gravity

This research proposes a multi-layer navigation system for indoor mobile robots when they share space with vulnerable individuals. The primary objectives are increasing or maintaining safety measures and curtailing operational costs, emphasizing reducing reliance on intricate sensor technologies and computational resources. The developed system employs a three-tiered control approach, with each layer playing a pivotal role in the navigation process. The "online" control layer integrates a human-in-the-loop strategy, where the human operator detects missing obstacles or approaching danger through a user interface and sends a trigger to the robot's controller. This trigger enables the system to estimate the coordinates of the danger and update the robot's navigation path in real time, minimizing reliance on complex sensor systems. The "semi-online" control layer generates dynamic virtual barriers to restrict the robot's navigation in specific areas during specific times. This ensures the robot avoids hazardous zones that could pose temporary risks to the human or robot. For example, areas with temporary obstructions or potential danger, such as kids' play zones or during cleaning, are temporarily restricted from the robot's path, ensuring safe navigation without relying solely on real-time sensor data. The "offline" control layer centers around the use of semantic information to control the robot's behavior according to user-defined space management and safety requirements. By leveraging Building Information Models (BIM) as digital twins, this layer combines semantic and geometric data to comprehensively understand the environment. It enables the robot to navigate according to precise user requirements, utilizing the semantic context for path planning and behavior control. This layer obviates the need for a real-time sensor mapping process, making the system more efficient and adaptable to user needs. This research represents a significant step forward in enhancing the navigational capabilities of robots within human-centric indoor environments, with a core focus on safety, adaptability, and cost-effectiveness.

Advanced robot's navigation system based on GPS/INS is established in order to meet its working surroundings and taskpsilas demand. Centralized open-loop Kalman filter is applied in the navigation system. GPS/INS devices' output difference is the filter's input. The position-velocity integrated measurement equation is deduced based on the robotpsilas locomotion performance and measurement demand. Simulation experiments are conducted under MATLAB software environment. The experiment results show that the systempsilas noise is retained and the navigation precision is improved effectively.

Mobile robot navigation has become as a challenging problem over the last few decades. Despite the significant advances in this field, mobile robot researchers have yet to reach a comfortable level of satisfaction and yet still finding an improved algorithm for robot's navigation. In this paper, we proposed investigate the cognitive mapping algorithm that is been implemented to the mobile robot. This mobile robot will be given some inputs which are horizontal and vertical value and start and goal point and a task which is to move from start point to goal point. Some obstacles are also located in the arena and the mobile robot must be able to avoid any given obstacles to reach the goal point. The performance of the cognitive mapping algorithm is compared with an edge follower navigation algorithm, which is an algorithm for a mobile robot to navigate by following the edges or the wall. Based on the experiments that have been performed the cognitive mapping algorithm can be an alternative way for the robot's navigation systems.