Quantitative Identification of Sandstone Lithology Based On Thin-Section Micrographs Using the U-net and U-net++ Semantic Segmentation Network

Unravelling hinterland and offshore palaeogeography from pre-to-syn-orogenic clastic sequences of the Betic Cordillera (Sierra Espuña), Spain

Semantic segmentation has been proposed as a tool to accelerate the processing of natural history collection images. However, developing a flexible and resilient segmentation network requires an approach for adaptation which allows processing different datasets with minimal training and validation. This paper presents a cross-validation approach designed to determine whether a semantic segmentation network possesses the flexibility required for application across different collections and institutions. Consequently, the specific objectives of cross-validating the semantic segmentation network are to (a) evaluate the effectiveness of the network for segmenting image sets derived from collections different from the one in which the network was initially trained on; and (b) test the adaptability of the segmentation network for use in other types of collections. The resilience to data variations from different institutions and the portability of the network across different types of collections are required to confirm its general applicability. The proposed validation method is tested on the Natural History Museum semantic segmentation network, designed to process entomological microscope slides. The proposed semantic segmentation network is evaluated through a series of cross-validation experiments designed to test using data from two types of collections: microscope slides (from three institutions) and herbarium sheets (from seven institutions). The main contribution of this work is the method, software and ground truth sets created for this cross-validation as they can be reused in testing similar segmentation proposals in the context of digitization of natural history collections. The cross-validation of segmentation methods should be a required step in the integration of such methods into image processing workflows for natural history collections.

A Unified Architecture of Semantic Segmentation and Hierarchical Generative Adversarial Networks for Expression Manipulation

Processes controlling the hydrochemical composition of geothermal fluids in the sandstone and dolostone reservoirs beneath the sedimentary basin in north China

Linear feature extraction is crucial for special objects in semantic segmentation networks, such as slot marking and lanes. The objects with linear characteristics have global contextual information dependency. It is very difficult to capture the complete information of these objects in semantic segmentation tasks. To improve the linear feature extraction ability of the semantic segmentation network, we propose introducing the dilated convolution with vertical and horizontal kernels (DVH) into the task of feature extraction in semantic segmentation networks. Meanwhile, we figure out the outcome if we put the different vertical and horizontal kernels on different places in the semantic segmentation networks. Our networks are trained on the basis of the SS dataset, the TuSimple lane dataset and the Massachusetts Roads dataset. These datasets consist of slot marking, lanes, and road images. The research results show that our method improves the accuracy of the slot marking segmentation of the SS dataset by 2%. Compared with other state-of-the-art methods, our UnetDVH-Linear (v1) obtains better accuracy on the TuSimple Benchmark Lane Detection Challenge with a value of 97.53%. To prove the generalization of our models, road segmentation experiments were performed on aerial images. Without data argumentation, the segmentation accuracy of our model on the Massachusetts roads dataset is 95.3%. Moreover, our models perform better than other models when training with the same loss function and experimental settings. The experiment result shows that the dilated convolution with vertical and horizontal kernels will enhance the neural network on linear feature extraction.

The phenotypic parameters of crop plants can be evaluated accurately and quickly using an unmanned aerial vehicle (UAV) equipped with imaging equipment. In this study, hundreds of images of Chinese cabbage (Brassica rapa L. ssp. pekinensis) germplasm resources were collected with a low-cost UAV system and used to estimate cabbage width, length, and relative chlorophyll content (soil plant analysis development [SPAD] value). The super-resolution generative adversarial network (SRGAN) was used to improve the resolution of the original image, and the semantic segmentation network Unity Networking (UNet) was used to process images for the segmentation of each individual Chinese cabbage. Finally, the actual length and width were calculated on the basis of the pixel value of the individual cabbage and the ground sampling distance. The SPAD value of Chinese cabbage was also analyzed on the basis of an RGB image of a single cabbage after background removal. After comparison of various models, the model in which visible images were enhanced with SRGAN showed the best performance. With the validation set and the UNet model, the segmentation accuracy was 94.43%. For Chinese cabbage dimensions, the model was better at estimating length than width. The R2 of the visible-band model with images enhanced using SRGAN was greater than 0.84. For SPAD prediction, the R2 of the model with images enhanced with SRGAN was greater than 0.78. The root mean square errors of the 3 semantic segmentation network models were all less than 2.18. The results showed that the width, length, and SPAD value of Chinese cabbage predicted using UAV imaging were comparable to those obtained from manual measurements in the field. Overall, this research demonstrates not only that UAVs are useful for acquiring quantitative phenotypic data on Chinese cabbage but also that a regression model can provide reliable SPAD predictions. This approach offers a reliable and convenient phenotyping tool for the investigation of Chinese cabbage breeding traits.

Semantic segmentation plays an increasingly important role in the field of computer vision. The current semantic segmentation algorithms are mainly based on full convolutional network downsampling for feature extraction, however, the reduction of image resolution due to downsampling will inevitably lead to the loss of image information and the process is irreversible. Although features can be reused to compensate for the loss, the problem of lost pixel correlation and inaccurate segmentation results still occur. In order to solve these problems, the attention mechanism and the generative adversarial network are fused into the semantic segmentation network, and a semantic segmentation network is proposed. The attention mechanism is added to the generator and discriminator modules and trained successively, then the generator module with rich information and global information is extracted, and its output is fused with the feature graph sampled above, in order to reduce the loss of local information and complete the task of image segmentation, an interpolation method based on image edge is introduced to sample the image, which improves the bilinear interpolation edge blur. Experiments on Cityscapes dataset show that the proposed network model is effective and reliable.

In remote-sensing image (RSI) semantic segmentation, the dependence on large-scale and pixel-level annotated data has been a critical factor restricting its development. In this letter, we propose an unsupervised semantic segmentation network embedded with geometry consistency (UGCNet) for RSIs, which imports the adversarial-generative learning strategy into a semantic segmentation network. The proposed UGCNet can be trained on a source-domain dataset and achieve accurate segmentation results on a different target-domain dataset. Furthermore, for refining the remote-sensing target geometric representation such as densely distributed buildings, we propose a geometry-consistency (GC) constraint that can be embedded in both image-domain adaptation process and semantic segmentation network. Therefore, our model could achieve cross-domain semantic segmentation with target geometric property preservation. The experimental results on Massachusetts and Inria buildings datasets prove that the proposed unsupervised UGCNet could achieve a very comparable segmentation accuracy with the fully supervised model, which validates the effectiveness of the proposed method.

Semantic segmentation network is able to detect multi-scale traffic sign effectively. However, probabilities that different scale features participate in decision are equal in the network. In this work, we propose a local multi-scale attention module based on channel-attention, which extracts local features generated by dilated convolution and weights scale features. We demonstrate that adopting local multi-scale attention module on a semantic segmentation network achieves a better performance for locating multi-scale traffic signs than state-of-art convolutional networks by the experimental results on a Chinese traffic sign dataset.

Vision-based perception is an import link in driverless technology, and semantic segmentation is one of the mostly uses atrous convolution with a large amount of computation and high memory consumption to extract high-resolution feature maps. As a result, the current mainstream semantic segmentation network lacks the segmentation speed and cannot be effectively applied in driverless technology. To solve this problem, a semantic segmentation network with better real-time performance is proposed. Firstly, a lightweight convolutional neural network is used as the encoder, and stride convolution and regular convolution are used to replace the time-consuming and memory-consuming atrous convolution. Secondly, in order to obtain the feature map similar to Deeplab v3+, a new joint upsampling module, Multi-scale Feature Map Joint Pyramid Upsamping(MJPU), is proposed. By fusing multiple feature maps in the encoder, a high resolution feature map with richer semantic information is generated. Experments on the Cityscapes dataset show that, compared with the popular semantic segmentation network Deeplab V3+, the proposed network can improve the segmentation speed to 31.4 FPS/s without losing a lot of performance(mIoU of 44.03%). Therefore, the network proposed in this paper has better real-time performance and is more suitable for driverless scenes.

Detrital mode and geochemical constraints on the provenance, paleoweathering and tectonic setting of the Surma sediments of Chittagong-Tripura fold belt, Tripura, India

The lane line detection methods based on semantic segmentation networks have achieved remarkable results in recent years. However, the semantic segmentation networks are aimed at the pixel level. These methods have a large amount of computation, which can reduce the real-time performance. To reduce the calculation, we propose a Light-weight Lane line detection Network (LLNet). A new sub-layer is established. We also adopt a jumping structure between two sub-layers to enhance the supervisory role of ground truth. Furthermore, we adopt two branches, including instance segmentation and embeddable branch. The combination of two branches can filter out the wrongly detected pixels and further improve the accuracy of detection. Experimental results in the Tusimple dataset show that the detection accuracy of the proposed network is comparable with LaneNet. Meanwhile, it has good real-time performance, and the processing time of a single image is 10.285 ms, which is about one-half of LaneNet.

Semantic segmentation of high-resolution optical remote sensing images is an important but challenging task. To solve the problem that many semantic segmentation networks fail to efficiently utilize global and local context information to improve the segmentation performance, this paper proposes a semantic segmentation network based on sparse self-attention (SDANet) to model the global context dependencies. Specifically, the feature maps are first divided into four regions in spatial and channel dimensions, respectively, and the divided feature maps are rearranged to form new regions. Second, the position and channel self-attention operations are performed on the rearranged regions. Third, the feature maps are restored to the original combination and the position together with channel self-attention operations are performed again to obtain the output feature maps. Finally, semantic segmentation is completed based on the output feature maps. Extensive experiments conducted on the ISPRS Vaihingen dataset demonstrate that the proposed method is superior to self-attention-based DANet, CCNet, and other general semantic segmentation networks, such as FCN, Deeplabv3+, HRNet, etc.

High-precision cloud detection for remote sensing image is of great significance for applications in agriculture, environment, meteorology and other fields. Cloud detection in bright surface environments and thin clouds identification have always been a challenge in cloud detection research. Aiming at this problem, a cloud detection method for remote sensing images based on difference features and semantic segmentation network is proposed in this paper. Cloudy and cloudless images of the same area are used to obtain difference features, and cloudless images are used as the surface reference. The multi-band cloud detection network based on U-network (U-net) fully learns the difference feature between clouds and the surface, and combines the feature information of the shallow and deep layers to accurately identify the cloud and the surface. Experiments were conducted on the Landsat 8 validation dataset. The results show that the proposed method achieves good performance. It improves the detection accuracy and reduces the misclassification over the bright surface underlying compared with the method based on top of atmosphere reflectance (TOA).

Neuronal soma segmentation plays a crucial role in neuroscience applications. However, the fine structure, such as boundaries, small-volume neuronal somata and fibers, are commonly present in cell images, which pose a challenge for accurate segmentation. In this paper, we propose a 3D semantic segmentation network for neuronal soma segmentation to address this issue. Using an encoding-decoding structure, we introduce a Multi-Scale feature extraction and Adaptive Weighting fusion module (MSAW) after each encoding block. The MSAW module can not only emphasize the fine structures via an upsampling strategy, but also provide pixel-wise weights to measure the importance of the multi-scale features. Additionally, a dynamic convolution instead of normal convolution is employed to better adapt the network to input data with different distributions. The proposed MSAW-based semantic segmentation network (MSAW-Net) was evaluated on three neuronal soma images from mouse brain and one neuronal soma image from macaque brain, demonstrating the efficiency of the proposed method. It achieved an F1 score of 91.8% on Fezf2-2A-CreER dataset, 97.1% on LSL-H2B-GFP dataset, 82.8% on Thy1-EGFP-Mline dataset, and 86.9% on macaque dataset, achieving improvements over the 3D U-Net model by 3.1%, 3.3%, 3.9%, and 2.3%, respectively.