- Research Article
229
- 10.1016/j.inffus.2020.10.008
Image retrieval from remote sensing big data: A survey
- Oct 14, 2020
- Information Fusion
- Yansheng Li + 2 more +2
Image retrieval from remote sensing big data: A survey
Nowadays, our ability to acquire remote sensing data has been improved to an unprecedented level.[...]
Loading PDF
Image retrieval from remote sensing big data: A survey
Image retrieval from remote sensing big data: A survey
A deep learning approach for forecasting non-stationary big remote sensing time series
Remote sensing (RS) data are undergoing an explosive growth. In fact, RS data are regarded as RS big data which generates several challenges such as data storage, analysis, applications, and methodologies. In this paper, a suitable method to forecast the Normalized Difference Vegetation Index (NDVI) time series (TS) from RS big data is introduced. In fact, we propose a non-stationary NDVI TS forecasting model by combining big data system, wavelet transform (WT), long short-term memory (LSTM) neural network. In the first step, the MapReduce algorithm was investigated for RS data storage and NDVI TS extraction. Then, the WT was used to decompose the TS into different components. Finally, LSTM was used for NDVI TS forecasting. Additionally, we have compared the forecasting results using only LSTM, recurrent neural network (RNN), and WT-RNN. Our results show that the proposed methodology using WT-LSTM model provides us an efficient method for forecasting NDVI TS in terms of root mean square error (RMSE) and Pearson correlation coefficient (R). Finally, we have evaluated the performance of the big data model.
Read moreDiscussion on Remote Sensing Big Data to Promote the Development of Smart City
<p>With the development and application of Internet technology, cloud computing, big data technology, Internet of things technology and other new generation information technology, smart city has gradually become the focus of global urban development. Remote sensing technology big data is the combination of remote sensing technology and big data technology. Remote sensing technology has the characteristics of long-distance, non-contact detection and wide coverage. And the data information collected by remote sensing equipment is analyzed by using big data technology to improve the application value of remote sensing technology. This paper first describes the characteristics of remote sensing big data and the connotation of smart city, and that the remote sensing big data technology can promote the intelligent supervision of urban pollution, urban planning, urban traffic intelligent response, and construction more reasonable and humanized, then it can help realize the development of urban traffic intelligent.</p>
Read moreA novel decision support system for the interpretation of remote sensing big data
Applications of remote sensing (RS) data cover several fields such as: cartography, surveillance, land-use planning, archaeology, environmental studies, resources management, etc. However, the amount of RS data has grown considerably due to the increase of aerial and satellite sensors. With this continuous increase, the necessity of having automated tools for the interpretation and analysis of RS big data is clearly obvious. The manual interpretation becomes a time consuming and expensive task. In this paper, a novel tool for interpreting and analyzing RS big data is described. The proposed system allows knowledge gathering for decision support in RS fields. It helps users easily make decisions in many fields related to RS by providing descriptive, predictive and prescriptive analytics. The paper outlines the design and development of a framework based on three steps: RS data acquisition, modeling, and analysis & interpretation. The performance of the proposed system has been demonstrated through three models: clustering, decision tree and association rules. Results show that the proposed tool can provide efficient decision support (descriptive and predictive) which can be adapted to several RS users’ requests. Additionally, assessing these results show good performances of the developed tool.
Read moreState of the Art: High-Performance and High-Throughput Computing for Remote Sensing Big Data
In recent years, with the increasing number of Earth observation satellites and the popularization and application of various sensors, remote sensing data have shown a rapid growth trend and present typical big data characteristics. The continuous enrichment of remote sensing data has provided large information resources for Earth science research and promoted the wide application of remote sensing technology in resources, ecology, environment, energy, health, urban management, and so on. However, mining information from multisource heterogeneous remote sensing big data, which requires a large amount of computing power, has many challenges in terms of generality, security, and timeliness. In this article, we summarize the existing research on high-performance computing (HPC) and high-throughput computing (HTC) technologies toward improving the processing efficiency of remote sensing big data. We also analyze the problems and challenges of HPC/HTC technologies in the storage, computation, and analysis of remote sensing big data. Finally, we predict the trend of remote sensing big data processing in the direction of HPC/HTC.
Read moreGlobal water cycle and remote sensing big data: overview, challenge, and opportunities
ABSTRACTThe Earth’s water cycle involves energy exchange and mass movement in the hydrosphere and thus sustains the dynamic balance of global hydrologic cycle. All water cycle variables on the Earth are closely interconnected with each other through the process of energy and water circulation. Observing, understanding and predicting the storage, movement, and quality of water remains a grand challenge for contemporary water science and technology, especially for researches across different spatio-temporal scales. The remote sensing observing platform has a unique advantage in acquiring complex water information and has already greatly improved observing, understanding, and predicting ability of the water cycle. Methods of obtaining comprehensive water cycle data are also expanded by new remote sensing techniques, and the vast amount of data has become increasingly available and thus accelerated a new Era: the Remote Sensing Big Data Study of Global Water Cycle. The element inversion, time and space reconstruction, and scale conversion are three key scientific issues for remote sensing water cycle in such Era. Moreover, it also presents a huge opportunity of capitalizing the combinations of Remote Sensing and Big Data to advance and improve the global hydrology and water security research and development, and uncork the new bottlenecks.
Read moreThe challenges of image segmentation in big remotely sensed imagery data
With the increase in spatial, spectral and temporal resolutions of Earth observing systems, geospatial and remote sensing (RS) image research is shifting towards a big data paradigm. One of the most important challenges in RS big data is image segmentation, which is defined as a process to group pixels together by a predefined criteria. Image segmentation allows for the extraction of features such as roads or habitats or buildings. Image segmentation is rendered more difficult with big data because the computing power on single platforms cannot keep pace with the size and velocity of new data. Big data sets must be decomposed for the analysis in distributed and parallel computing platforms. Decomposition through techniques like slicing by spatial extent obscures the geometric and topological information in geospatial data, for example generating fake artefacts. To address these challenges, we propose a geospatial cyberinfrastructure (GCI) that coordinates cloud computing, MapReduce framework, image segmentation algorithms, a spatial extent splitting method and a recomposing technique using moving window. This GCI is evaluated on cloud computing to identify features in a 312.07 GB high-resolution colour aerial photo with Hadoop. K-means-based image segmentation is selected as the case study. We deploy the architecture in private cloud and public cloud implementation, respectively. The results demonstrate the benefits of the decomposing and recomposing methods in segmenting images, removing fake artefacts and reducing information distortion. More general problems in big data are revealed, among them I/O problems, particularly in the amount of preprocessing and post-processing that will be required in any analysis of big imagery data. We conclude with implications for scalability and suggestions to speed up decomposition and recomposition.
Read moreToward Developing an African Earth Open Portal of Remote Sensing Data Processing for Environmental Monitoring Applications
&#160;&#160;&#160; Morocco has become one of the most industrialized feet, not only in Africa but also in the world. This mutation benefits the country's development; however, these industrial activities directly or indirectly impact the impairment grade environment. Remote Sensing (RS) data offer consideration from government projects and commercial applications to academic fields from free-open access data centers. The EUMETSAT NASA, NOAA, ESA, Copernicus, etc., deliver RS data with numerous satellites flying on geostationary and polar orbits. The provided data are massive (Terabytes daily) for environmental monitoring, disaster management, and other applications. RS products are measured with various instruments, for instance, radiometer, spectrometer, hyperspectral, sounder, altimeter, and optical. Wide spectral bands are employed, such as infrared, visible, radar, microwave, etc. The proliferation of RS data also increases the RS data's velocity (thousands of files daily), the data's diversity (NetCDF, HDF5, BUFR, binary, etc.), and higher dimensionality characteristics. Accordingly, RS data can be regarded as Big Data (BD). Thus, it is challenging to acquire, ingest, process, store, query, and visualize RSBD proficiently due to the data and computing-intensive challenges and limitations. As a result, an incredible deal of attention in the field of BD and its analysis has increased, most ambitious from a vast number of research challenges powerfully related to RS applications, such as modeling, pre-processing, analyzing, querying, and mining, in distributed and scalable clusters.&#160;&#160;&#160; This project aims to design and develop an African Earth Open Portal (AfEOP) as a platform for the automatic acquisition, ingestion, processing, and visualization of the massive stream of RS datasets from multiples satellites sensors, ground stations, drones, etc. The proposed platform will solve many environmental issues, notably: (1) supervising the weather parameters in Africa, including the temperature, humidity, pressure, and wind speed, etc. (2) drought assessment, evapotranspiration estimation, water drainage monitoring, and food yield and crop forecasting 3) agriculture and fertilization optimization using Artificial Intelligence (AI) algorithms helping in decision making 4) water use reduction using RS data, AI, and physical models.&#160;&#160;&#160; In this project, we perform BD Analytics by (1) presenting a brief survey of the used data sources and describing the nature of the used satellite sensors' data for environmental applications. (2) designing and developing an ingestion framework for RSBD in a distributed platform for RS data storage and query. (3) incorporating cloud computing and parallel programming techniques to optimize processing. (4) visualizing the results in demand in interactive maps and dashboards. Accordingly, this led us to the following questions: Is the designed architecture of RS data pre-processing efficient to extract only helpful information in a short execution time? Is it possible to make the RS data-friendly with the distributed framework for more processing? Are RS techniques efficient for environmental applications for Africa and notably Morocco?
Read moreRecent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing
This article gives a survey of state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations on diverse popular high-performance computing platforms. The pros/cons of these approaches are discussed in terms of capability, scalability, reliability, and ease of use. Among existing distributed computing platforms, cloud computing is currently the most promising solution to efficient and scalable processing of remotely sensed big data due to its advanced capabilities for high-performance and service-oriented computing. We further provide an in-depth analysis of state-of-the-art cloud implementations that seek for exploiting the parallelism of distributed processing of remotely sensed big data. In particular, we study a series of scheduling algorithms (GSs) aimed at distributing the computation load across multiple cloud computing resources in an optimized manner. We conduct a thorough review of different GSs and reveal the significance of employing scheduling strategies to fully exploit parallelism during the remotely sensed big data processing flow. We present a case study on large-scale remote sensing datasets to evaluate the parallel and distributed approaches and algorithms. Evaluation results demonstrate the advanced capabilities of cloud computing in processing remotely sensed big data and the improvements in computational efficiency obtained by employing scheduling strategies.
Read moreHigh Spatial Resolution Remote Sensing Data Classification Method Based on Spectrum Sharing
Existing remote sensing data classification methods cannot achieve the sharing of remote sensing image spectrum, leading to poor fusion and classification of remote sensing data. Therefore, a high spatial resolution remote sensing data classification method based on spectrum sharing is proposed. A page frame recovery algorithm (PFRA) is introduced to allocate the wireless spectrum resources in low-frequency band, and a dynamic spectrum sharing mechanism is designed between the primary and secondary users of remote sensing images. Based on this, D-S evidence theory is used to fuse high spatial resolution remote sensing data and correct the pixel brightness of the fused multispectral image. The initial data are normalized, the feature of spectral image is extracted, the convolution neural network classification model is constructed, and the remote sensing image is segmented. Experimental results show that the proposed method takes shorter time and has higher accuracy for high spatial resolution image segmentation. High spatial resolution remote sensing data classification is more efficient, and the accuracy of data classification and remote sensing image fusion are more ideal.
Read moreMapping Urban Functional Zones by Integrating Very High Spatial Resolution Remote Sensing Imagery and Points of Interest: A Case Study of Xiamen, China
Fine-scale, accurate intra-urban functional zones (urban land use) are important for applications that rely on exploring urban dynamic and complexity. However, current methods of mapping functional zones in built-up areas with high spatial resolution remote sensing images are incomplete due to a lack of social attributes. To address this issue, this paper explores a novel approach to mapping urban functional zones by integrating points of interest (POIs) with social properties and very high spatial resolution remote sensing imagery with natural attributes, and classifying urban function as residence zones, transportation zones, convenience shops, shopping centers, factory zones, companies, and public service zones. First, non-built and built-up areas were classified using high spatial resolution remote sensing images. Second, the built-up areas were segmented using an object-based approach by utilizing building rooftop characteristics (reflectance and shapes). At the same time, the functional POIs of the segments were identified to determine the functional attributes of the segmented polygon. Third, the functional values—the mean priority of the functions in a road-based parcel—were calculated by functional segments and segmental weight coefficients. This method was demonstrated on Xiamen Island, China with an overall accuracy of 78.47% and with a kappa coefficient of 74.52%. The proposed approach could be easily applied in other parts of the world where social data and high spatial resolution imagery are available and improve accuracy when automatically mapping urban functional zones using remote sensing imagery. It will also potentially provide large-scale land-use information.
Read moreCloud-based storage and computing for remote sensing big data: a technical review
The rapid growth of remote sensing big data (RSBD) has attracted considerable attention from both academia and industry. Despite the progress of computer technologies, conventional computing implementations have become technically inefficient for processing RSBD. Cloud computing is effective in activating and mining large-scale heterogeneous data and has been widely applied to RSBD over the past years. This study performs a technical review of cloud-based RSBD storage and computing from an interdisciplinary viewpoint of remote sensing and computer science. First, we elaborate on four critical technical challenges resulting from the scale expansion of RSBD applications, i.e. raster storage, metadata management, data homogeneity, and computing paradigms. Second, we introduce state-of-the-art cloud-based data management technologies for RSBD storage. The unit for manipulating remote sensing data has evolved due to the scale expansion and use of novel technologies, which we name the RSBD data model. Four data models are suggested, i.e. scenes, ARD, data cubes, and composite layers. Third, we summarize recent research on the application of various cloud-based parallel computing technologies to RSBD computing implementations. Finally, we categorize the architectures of mainstream RSBD platforms. This research provides a comprehensive review of the fundamental issues of RSBD for computing experts and remote sensing researchers.
Read moreIn Memorium: Thomas Hilker
Dr. Thomas Hilker left us on 4 September 2016 following a sudden cardiac arrest.[...]
Towards Building a Distributed Data Management Architecture to Integrate Multi-Sources Remote Sensing Big Data
Recent advances in sensor technologies have led to the significant growth of remote sensing data in terms of its volume, velocity, and variety. Remote sensing data are recognized as the big data, which pose the urgent need for new technologies to integrate and manage heterogeneous remote sensing big data. In this paper, a scalable, efficient, distributed data management system is proposed for heterogeneous remote sensing big data integration and management across the distributed environment. In the system, the remote sensing data are stored as NetCDF files. Meanwhile, the corresponding remote sensing metadata are standardized according to the ISO 19115-2:2009 based metadata template. In this way, a unified view of heterogeneous remote sensing data is formed. Two organization models are designed to store massive remote sensing data and its metadata in HDFS and HBase, respectively. Besides, an Elasticsearch-based secondary index is built for HBase to provide users with query ability of metadata contents.
Read moreIntegration of Remote Sensing and Big Data to Study Spatial Distribution of Urban Heat Island for Cities with Different Terrain
Urban microclimate has posed a detrimental effect on the life of the urban population. This research drives with an aim of identifying environmentally conscious factor vis-a-vis urban planning which leads to the vicious cycle of urban climate change. The vicious cycle is inclusive of many urban dynamics’ parameters, which are complicated to understand. This research emphasizes on using Remote Sensing Big Data on Google Earth Engine as an advancement to study Climate Vulnerability leading to Urban Climate Gentrification. Temporal data of Landsat for the past 30 years has been taken into consideration for the study. Three cities with diverse geographical and terrain characteristics have been selected for the study, to understand the modern decisive planning is in coherence with the Sustainable Development Goals. Understanding spatial and temporal information of Urban hotspots using High-Resolution Satellite data is just not enough to suffice the need to decrease the temperature by 2- 3°C. The present study is a toll on how the reasons for microclimate change vary along with the terrain, spatial location, and urban growth pattern of the city.
Read more