Initialisation using high spatial, temporal and spectral resolution satellite observations

A Geostationary Imaging Fourier Transform Spectrometer (GIFTS) has been selected for the NASA New Millennium Program (NMP) Earth Observing-3 (EO-3) mission. Our paper will discuss one of the key GIFTS measurement requirements, Field of View (FOV) stability, and its impact on required system performance. The GIFTS NMP mission is designed to demonstrate new and emerging sensor and data processing technologies with the goal of making revolutionary improvements in meteorological observational capability and forecasting accuracy. The GIFTS payload is a versatile imaging FTS with programmable spectral resolution and spatial scene selection that allows radiometric accuracy and atmospheric sounding precision to be traded in near real time for area coverage. The GIFTS sensor combines high sensitivity with a massively parallel spatial data collection scheme to allow high spatial resolution measurement of the Earth's atmosphere and rapid broad area coverage. An objective of the GIFTS mission is to demonstrate the advantages of high spatial resolution (4 km ground sample distance - gsd) on temperature and water vapor retrieval by allowing sampling in broken cloud regions. This small gsd, combined with the relatively long scan time required (approximately 10 s) to collect high resolution spectra from geostationary (GEO) orbit, may require extremely good pointing control. This paper discusses the analysis of this requirement.

Spaceborne infrared atmospheric sounders measure the spectrum of the upwelling radiance in the infrared with ultra-high spectral resolution. The resolution is sufficient to measure absorption features of atmospheric constituents enabling retrieval of atmospheric temperature and water vapor profiles, surface emission and atmospheric constituents. The Atmospheric Infrared Sounder (AIRS) on Aqua launched in May of 2002 was the first hyperspectral grating-based infrared sounder designed for this purpose and is still operational today. AIRS has been followed by the Infrared Atmospheric Sounding Interferometer (IASI) on MetOp A and B, and the Cross-track Infrared Sounder (CrIS) on Suomi NPP and JPSS. All instruments are operating well improving weather forecast and providing a wealth of information about the atmosphere. Additional CrIS and IASI instruments are expected to be launched providing data of this type into the late 2030’s. AIRS, CrIS and IASI are all Low Earth Orbit (LEO) instruments with nominal spatial resolutions of 14km. Future IR sounders must achieve higher spatial and temporal resolution to match improvements in forecast models and be less costly to match anticipated future budget pressures. Higher temporal resolution can be achieved in several ways including operation in Geostationary Earth Orbit (GEO) or in constellations of LEO satellites. Higher spatial resolution can be achieved using larger format focal plane assemblies in the instruments and larger aperture telescopes. Grating spectrometers are well suited to large format FPAs by allowing a wide field of view in a compact package. They also provide long life and are easy to operate. Concepts for next generation grating spectrometer IR sounders that have been developed over the years at JPL are presented along with technology advancements made to enable these concepts to achieve their stated goals.

Widely used MRI methods show brain morphology both in vivo and ex vivo at very high resolution. Many of these methods (e.g., T2*-weighted imaging, phase-sensitive imaging, or susceptibility-weighted imaging) are sensitive to local magnetic susceptibility gradients produced by subtle variations in tissue composition. However, the spectral resolution of commonly used methods is limited to maintain reasonable run-time combined with very high spatial resolution. Here, the authors report on data acquisition at increased spectral resolution, with 3-dimensional high spectral and spatial resolution MRI, in order to analyze subtle variations in water proton resonance frequency and lineshape that reflect local anatomy. The resulting information compliments previous studies based on T2* and resonance frequency. The proton free induction decay was sampled at high resolution and Fourier transformed to produce a high-resolution water spectrum for each image voxel in a 3D volume. Data were acquired using a multigradient echo pulse sequence (i.e., echo-planar spectroscopic imaging) with a spatial resolution of 50 × 50 × 70 μm(3) and spectral resolution of 3.5 Hz. Data were analyzed in the spectral domain, and images were produced from the various Fourier components of the water resonance. This allowed precise measurement of local variations in water resonance frequency and lineshape, at the expense of significantly increased run time (16-24 h). High contrast T2*-weighted images were produced from the peak of the water resonance (peak height image), revealing a high degree of anatomical detail, specifically in the hippocampus and cerebellum. In images produced from Fourier components of the water resonance at -7.0 Hz from the peak, the contrast between deep white matter tracts and the surrounding tissue is the reverse of the contrast in water peak height images. This indicates the presence of a shoulder in the water resonance that is not present at +7.0 Hz and may be specific to white matter anatomy. Moreover, a frequency shift of 6.76 ± 0.55 Hz was measured between the molecular and granular layers of the cerebellum. This shift is demonstrated in corresponding spectra; water peaks from voxels in the molecular and granular layers are consistently 2 bins apart (7.0 Hz, as dictated by the spectral resolution) from one another. High spectral and spatial resolution MR imaging has the potential to accurately measure the changes in the water resonance in small voxels. This information can guide optimization and interpretation of more commonly used, more rapid imaging methods that depend on image contrast produced by local susceptibility gradients. In addition, with improved sampling methods, high spectral and spatial resolution data could be acquired in reasonable run times, and used for in vivo scans to increase sensitivity to variations in local susceptibility.

There is an increasing demand for satellite remote sensing data with both high spatial and temporal resolution in many applications. But it still is a challenge to simultaneously improve spatial resolution and temporal frequency due to the technical limits of current satellite observation systems. To this end, much R&D efforts have been ongoing for years and lead to some successes roughly in two aspects, one includes super resolution, pan-sharpen etc. methods which can effectively enhance the spatial resolution and generate good visual effects, but hardly preserve spectral signatures and result in inadequate analytical value, on the other hand, time interpolation is a straight forward method to increase temporal frequency, however it increase little informative contents in fact. In this paper we presented a novel method to simulate high resolution time series data by combing low resolution time series data and a very small number of high resolution data only. Our method starts with a pair of high and low resolution data set, and then a spatial registration is done by introducing LDA model to map high and low resolution pixels correspondingly. Afterwards, temporal change information is captured through a comparison of low resolution time series data, and then projected onto the high resolution data plane and assigned to each high resolution pixel according to the predefined temporal change patterns of each type of ground objects. Finally the simulated high resolution data is generated. A preliminary experiment shows that our method can simulate a high resolution data with a reasonable accuracy. The contribution of our method is to enable timely monitoring of temporal changes through analysis of time sequence of low resolution images only, and usage of costly high resolution data can be reduces as much as possible, and it presents a highly effective way to build up an economically operational monitoring solution for agriculture, forest, land use investigation, environment and etc. applications.

Hyperspectral (HS) images obtained from space are useful for monitoring different natural phenomena on regional to global scales. The Environmental Mapping and Analysis Program (EnMAP) is a satellite recently launched by Germany to monitor the environment and explore the capabilities of hyperspectral sensors in the 420 and 2450 nm range of the spectrum. However, the data captured by the EnMAP mission have a ground sampling distance (GSD) of 30 m. This limits the use of the data for some applications that require higher spatial resolution (<10 m). This study examines the potential for improving the resolution of hyperspectral data using high resolution multispectral (MS) data obtained by Cubesats. Specifically, this work uses the data captured by the PlanetScope constellation, which has more than 150 CubeSats in low Earth orbit, with a high spatial and temporal resolution. The approach adopted leverages (1) the spectral capability of the hyperspectral EnMAP sensor, with a bandwidth of 6.5 nm in the visible and near infrared (VNIR) range (420–1000 nm) and 10 nm in the SWIR range (900–2450 nm), and (2) the spatial capability of the multispectral PlanetScope data, with a GSD of 3 meters, to enable significant spatial improvements due to its high spatial resolution. The main components of this work include: (i) area of interest clipping (ii) data co-registration, (iii) HS-MS data fusion, and (iv) quality assessments using the Jointly Spectral and Spatial Quality Index (QNR). In this study, a 2 km x 2 km area of interest was selected in the Malaucene region of France, where six state-of-the-art HS-MS fusion methods were evaluated: (1) fast multi-band image fusion algorithm (FUSE), (2) coupled nonnegative matrix factorization (CNMF), (3) smoothing filtered-based intensity modulation (SFIMHS), (4) maximum a posteriori stochastic mixing model (MAPSMM), (5) Hyperspectral Superresolution (HySure), and (6) generalized laplacian pyramid hypersharpening (GLPHS). Quality assessments of the enhanced data showed that high spectral and spatial fidelity are maintained, with the best performing fusion method being FUSE with a QNR of 0.625 followed by the MAPSMM method with a QNR of 0.604. Overall, this study advocates the benefits associated with the fusion of hyperspectral and multispectral data to obtain enhanced EnMAP data at 3 m GSD. 

Parameterization of air temperature in high temporal and spatial resolution from a combination of the SEVIRI and MODIS instruments

While data like HJ-1 CCD images have advantageous spatial characteristics for describing crop properties, the temporal resolution of the data is rather low, which can be easily made worse by cloud contamination. In contrast, although Moderate Resolution Imaging Spectroradiometer (MODIS) can only achieve a spatial resolution of 250 m in its normalised difference vegetation index (NDVI) product, it has a high temporal resolution, covering the Earth up to multiple times per day. To combine the high spatial resolution and high temporal resolution of different data sources, a new method (Spatial and Temporal Adaptive Vegetation index Fusion Model [STAVFM]) for blending NDVI of different spatial and temporal resolutions to produce high spatial–temporal resolution NDVI datasets was developed based on Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM). STAVFM defines a time window according to the temporal variation of crops, takes crop phenophase into consideration and improves the temporal weighting algorithm. The result showed that the new method can combine the temporal information of MODIS NDVI and spatial difference information of HJ-1 CCD NDVI to generate an NDVI dataset with both high spatial and high temporal resolution. An application of the generated NDVI dataset in crop biomass estimation was provided. An average absolute error of 17.2% was achieved. The estimated winter wheat biomass correlated well with observed biomass (R 2 of 0.876). We conclude that the new dataset will improve the application of crop biomass estimation by describing the crop biomass accumulation in detail. There is potential to apply the approach in many other studies, including crop production estimation, crop growth monitoring and agricultural ecosystem carbon cycle research, which will contribute to the implementation of Digital Earth by describing land surface processes in detail.

Most modern satellites can provide two types of images: 1) panchromatic (PAN) image and 2) multispectral (MS) image. The former has high spatial resolution and low spectral resolution, while the latter has high spectral resolution and low spatial resolution. To obtain images with both high spectral and spatial resolution, pansharpening has emerged to fuse the spatial information of the PAN image and the spectral information of the MS image. However, most pansharpening methods fail to preserve spatial and spectral information simultaneously. In this article, we propose a framelet-based convolutional neural network (CNN) for pansharpening which makes it possible to pursue both high spectral and high spatial resolution. Our network consists of three subnetworks: 1) feature embedding net; 2) feature fusion net; and 3) framelet prediction net. Different from conventional CNN methods directly inferring high-resolution MS images, our approach learns to predict their framelet coefficients from available PAN and MS images. The introduction of multilevel feature aggregation and hybrid residual connection makes full use of spatial information of PAN image and spectral information of MS image. Quantitative and qualitative experiments at reduced- and full-resolution demonstrate that the proposed method achieves more appealing results than other state-of-the-art pansharpening methods. The source code and trained models are available at https://github.com/TingMAC/FrMLNet.

Due to the limitations of hardware technology, satellite sensors cannot obtain images with high temporal, spatial, and spectral resolutions at the same time. Current spatiotemporal fusion methods try to solve the contradiction between temporal resolution and spatial resolution, which cannot achieve good reconstruction accuracy partly because the data sources are from heterogeneous platforms with long chains difficult to be modeled. Different from the crossing-platform fusion, this work proposes to improve the spatial and temporal resolutions on a single platform. For the 2-m panchromatic images, 8-m multispectral images, and 16-m wide-field-view images captured by the Gaofen-1 satellite, our goal is to produce 2-m multispectral images with high temporal resolutions. Two convolutional neural networks are built to solve this spatiotemporal-spectral fusion issue with pansharpening and spatiotemporal fusion in serial. In the validation stage, the 2-m multispectral images are built and evaluated with the panchromatic images and 8-m multispectral images. The digital and visual evaluations show that our method can produce visually acceptable fusion quality, which may enhance the feasibility of the Gaofen-1 data.

The accurate measurement of airflow patterns at high spatial and temporal resolutions is of great importance for building design and operation. Microelectromechanical Systems (MEMS) technology can be used to develop miniaturized airflow sensors capable of detecting both airflow speed and direction at high temporal resolution. Wireless sensor networks (WSNs) are used extensively for large-scale monitoring at high spatial resolution. Thus, the integration of MEMS and WSN technologies enables the measurement of airflow patterns at high spatial and temporal resolution. In this work, we developed a prototype MEMS-based airflow sensor network and deployed it in a building environment.

Abstract. The ability to detect convective regions and to add latent heating to drive convection is one of the most important additions to short-term forecast models such as National Oceanic and Atmospheric Administration's (NOAA's) High-Resolution Rapid Refresh (HRRR) model. Since radars are most directly related to precipitation and are available in high temporal resolution, their data are often used for both detecting convection and estimating latent heating. However, radar data are limited to land areas, largely in developed nations, and early convection is not detectable from radars until drops become large enough to produce significant echoes. Visible and infrared sensors on a geostationary satellite can provide data that are more sensitive to small droplets, but they also have shortcomings: their information is almost exclusively from the cloud top. Relatively new geostationary satellites, Geostationary Operational Environmental Satellite-16 and Satellite-17 (GOES-16 and GOES-17), along with Himawari-8, can make up for this lack of vertical information through the use of very high spatial and temporal resolutions, allowing better observation of bubbling features on convective cloud tops. This study develops two algorithms to detect convection at vertically growing clouds and mature convective clouds using 1 min GOES-16 Advanced Baseline Imager (ABI) data. Two case studies are used to explain the two methods, followed by results applied to 1 month of data over the contiguous United States. Vertically growing clouds in early stages are detected using decreases in brightness temperatures over 10 min. For mature convective clouds which no longer show much of a decrease in brightness temperature, the lumpy texture from rapid development can be observed using 1 min high spatial resolution reflectance data. The detection skills of the two methods are validated against Multi-Radar/Multi-Sensor System (MRMS), a ground-based radar product. With the contingency table, results applying both methods to 1-month data show a relatively low false alarm rate of 14.4 % but missed 54.7 % of convective clouds detected by the radar product. These convective clouds were missed largely due to less lumpy texture, which is mostly caused by optically thick cloud shields above.

In many fluid experiments, we can only obtain low-spatial high-temporal resolution flow images and high-spatial low-temporal resolution flow images due to the limitation of high-speed imaging systems. To solve this problem, we proposed a degradation and super-resolution attention model (D-SRA) using unsupervised machine learning to super-resolution reconstruct high resolution (HR) time-resolved fluid images from coarse data. Unlike the prior research to increase the resolution of coarse data artificially generated by simple bilinear down-sampling, our model that consists of a degradation neural network and a super-resolution neural network aims to learn the mappings between experimental low-resolution data and corresponding HR data. What is more, channel and spatial attention modules are also adopted in D-SRA to facilitate the restoration of abundant and critical details of flow fields. The proposed model is validated by two high-speed schlieren experiments of under-expanded impinging supersonic jets. The comprehensive capability of D-SRA is statistically analyzed based on the synthetic unpaired schlieren images. The spatial-resolution of coarse images can be successfully augmented by 42 times and 82 times with most physical details recovered perfectly, which outperforms the existing method. The D-SRA also exhibits considerable generalization and robustness against unknown-degenerated schlieren images. Moreover, the practicability of the proposed method is also further explored on real unpaired jets schlieren images. It is convincingly demonstrated that the present study successfully surpasses the performance limitations of high-speed cameras and has significant applications in various fluid experiments to obtain flow images with high spatial and temporal resolution.

In many fluid experiments, we can only obtain low-spatial high-temporal resolution flow images and high-spatial low-temporal resolution flow images due to the limitation of high-speed imaging systems. To solve this problem, we proposed a degradation and super-resolution attention model (D-SRA) using unsupervised machine learning to super-resolution reconstruct high resolution (HR) time-resolved fluid images from coarse data. Unlike the prior research to increase the resolution of coarse data artificially generated by simple bilinear down-sampling, our model that consists of a degradation neural network and a super-resolution neural network aims to learn the mappings between experimental low-resolution data and corresponding HR data. What is more, channel and spatial attention modules are also adopted in D-SRA to facilitate the restoration of abundant and critical details of flow fields. The proposed model is validated by two high-speed schlieren experiments of under-expanded impinging supersonic jets. The comprehensive capability of D-SRA is statistically analyzed based on the synthetic unpaired schlieren images. The spatial-resolution of coarse images can be successfully augmented by 42 times and 82 times with most physical details recovered perfectly, which outperforms the existing method. The D-SRA also exhibits considerable generalization and robustness against unknown-degenerated schlieren images. Moreover, the practicability of the proposed method is also further explored on real unpaired jets schlieren images. It is convincingly demonstrated that the present study successfully surpasses the performance limitations of high-speed cameras and has significant applications in various fluid experiments to obtain flow images with high spatial and temporal resolution.

STF-Trans: A two-stream spatiotemporal fusion transformer for very high resolution satellites images

To design a more accurate and reproducible technique for the measurement of blood-brain barrier (BBB) permeability in gadolinium-enhancing multiple sclerosis (MS) lesions. Four MS patients were scanned using a new dynamic contrast-enhanced (DCE)-magnetic resonance imaging (MRI) protocol based on an uninterrupted two-part acquisition consisting of an initial part at high temporal and low spatial resolutions and a second part at low temporal and high spatial resolutions. The method preserves both the high spatial resolution needed for the often small size of lesions and the high temporal resolution required during the first minute after injection to sufficiently sample the first-pass bolus. Simulations compared the performance of this new protocol with the conventional one at low temporal and high spatial resolutions throughout. The BBB permeability estimates changed by up to 33% between the two protocols. The new protocol led to simulated error on K(trans) of 7%-10%, versus 7%-30% with the conventional protocol, and was more robust with respect to offsets between acquisition and injection start times, differences in shape of the first-pass peak, and permeability values. The dual-temporal resolution protocol produces improved BBB permeability estimates and provides a more complete view of active inflammatory MS lesion pathology.