Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap

Many advanced ground-based solar telescopes improve the spatial resolution of observation images using an adaptive optics (AO) system. As any AO correction remains only partial, it is necessary to use post-processing image reconstruction techniques such as speckle masking or shift-and-add (SAA) to reconstruct a high-spatial-resolution image from atmospherically degraded solar images. In the New Vacuum Solar Telescope (NVST), the spatial resolution in solar images is improved by frame selection and SAA. In order to overcome the burden of massive speckle data processing, we investigate the possibility of using the speckle reconstruction program in a real-time application at the telescope site. The code has been written in the C programming language and optimized for parallel processing in a multi-processor environment. We analyze the scalability of the code to identify possible bottlenecks, and we conclude that the presented code is capable of being run in real-time reconstruction applications at NVST and future large aperture solar telescopes if care is taken that the multi-processor environment has low latencies between the computation nodes.

NVST chromosphere data interference fringes removal based on NSCT and PCA

This paper is devoted to the primary spectro-polarimetric observation performed at the New Vacuum Solar Telescope (NVST) of China since 2017, and our aim is to precisely evaluate the real polarimetric accuracy and sensitivity of this polarimetry by using full Stokes spectro-polarimetric observations of the photospheric line Fe I 532.4 nm. In the work, we briefly describe the salient characteristic of the NVST as a polarimeter in terms of technology and then characterize its instrumental polarization based on the operation in 2017 and 2019. It is verified that the calibration method utilizing the instrumental polarization calibration unit (ICU) is stable and credible. The calibration accuracy can reach up to 3 × 10−3. Based on the scientific observation of NOAA Active Region 12645 on 2017 April 5, we estimate that the residual cross-talk from Stokes I to Stokes Q, U and V, after the instrumental polarization calibration, is about 4 × 10−3 on average, which is consistent with the calibration accuracy and close to the photon noise. The polarimetric sensitivity (i.e., the detection limit) for polarized light is of the order of 10−3 with an integration time over 20 s. Slow modulation rate is indeed an issue for the present system. The present NVST polarimeter is expected to be integrated with a high-order adaptive optics system and a field scanner to realize 2D vector magnetic field measurements in the following instrumentation update.

In this paper we illustrate the technique used by the New Vacuum Solar Telescope (NVST) to increase the spatial resolution of two-dimensional (2D) solar spectroscopy observations involving two dimensions of space and one of wavelength. Without an image stabilizer at the NVST, large scale wobble motion is present during the spatial scanning, whose instantaneous amplitude can reach 1.3″ due to the Earth’s atmosphere and the precision of the telescope guiding system, and seriously decreases the spatial resolution of 2D spatial maps composed with scanned spectra. We make the following effort to resolve this problem: the imaging system (e.g., the TiO-band) is used to record and detect the displacement vectors of solar image motion during the raster scan, in both the slit and scanning directions. The spectral data (e.g., the Hα line) which are originally obtained in time sequence are corrected and re-arranged in space according to those displacement vectors. Raster scans are carried out in several active regions with different seeing conditions (two rasters are illustrated in this paper). Given a certain spatial sampling and temporal resolution, the spatial resolution of the composed 2D map could be close to that of the slit-jaw image. The resulting quality after correction is quantitatively evaluated with two methods. A physical quantity, such as the line-of-sight velocities in multiple layers of the solar atmosphere, is also inferred from the re-arranged spectrum, demonstrating the advantage of this technique.

<p>In this report, we present a prominence observed by New Vacuum Solar Telescope (NVST) in Hα wavelength.  We use morphological approach to identify the rising or descending knots in the prominence. The rising knots are often found on the top of the prominence, while more knots are seen to descend from anywhere of the prominence.</p><p>The optical flow, referring to the apparent proper motion of a feature across the image plane, may be used to determine the velocity field from two images. The technique of local correlation tracking (LCT) optical flow has been widely used in the solar research. The Demon algorithm, which has been  used to match medical image, performs image-to-image matching by determining the optical flow between two images. We have examined the performance of the two methods applying the Hα images, and we noted that the Demon algorithm outperforms traditional LCT  methods.</p><p>The result of Demon optical flow allows us to estimate the velocity and acceleration of the moving knots. The descending speed of the knots near the solar surface is higher than that far away from the solar surface. This indicate that most of knots are more possible to descend across the horizontal magnetic field.</p>

Ellerman bombs (EBs) are believed to be small-scale reconnection events occurring around the temperature minimum region in the solar atmosphere. They are often identified as significant enhancements in the extended Hα wings without obvious signatures in the Hα core. Here we explore the possibility of using the 1700 Å images taken by the Atmospheric Imaging Assembly (AIA) onboard the Solar Dynamics Observatory (SDO) to study EBs. From the Hα wing images obtained with the New Vacuum Solar Telescope (NVST) on 2015 May 2, we have identified 145 EBs and 51% of them clearly correspond to the bright points (BPs) in the AIA 1700 Å images. If we resize the NVST images using a linear interpolation to make the pixel sizes of the AIA and NVST images the same, some previously identified EBs disappear and about 71% of the remaining EBs are associated with BPs. Meanwhile, 66% of the compact brightenings in the AIA 1700 Å images can be identified as EBs in the Hα wings. The intensity enhancements of the EBs in the Hα wing images reveal a linear correlation with those of the BPs in the AIA 1700 Å images. Our study suggests that a significant fraction of EBs can be observed with the AIA 1700 Å filter, which is promising for large-sample statistical study of EBs as the seeing-free and full-disk SDO/AIA data are routinely available.

Timed solar eclipses in Chinese records and the secular changes in the Earth's rotation before the 8th century: Zhang Pei-yu & Han Yan-benPurple Mountain Observatory, Nanjing 210008

The AO progresses for astronomy in the Key Laboratory of Adaptive Optics, Chinese Academy of Sciences are reported in this presentation. For night-time astronomical observations, the recent AO technological developments, such as Laser Guide Star, Pyramid Sensor and Deformable Secondary Mirror, are introduced. The solar AO researches are also presented for day-time astronomical observations. Furthermore, we will show the on-sky high resolution observational results in the 1.8m telescope at Gaomeigu site, Yunnan Observatory and the 1-m New Vacuum Solar Telescope (NVST) at Fuxian Lake Solar Observatory respectively.

Studying solar filament dynamical evolutions is an important approach to reveal the driving mechanism of solar eruptions, which seriously impact on the Sun–Earth system and could cause disastrous space weather. To better understand the evolution process of solar filaments, here we investigate an active-region filament by employing observations from the New Vacuum Solar Telescope (NVST), Solar Dynamics Observatory, and Interface Region Imaging Spectrograph. The high-resolution NVST Hα images show that the northern footpoint of the filament gradually moved northward. Near the northern footpoint, there is an arch filament system (AFS). Between adjacent footpoints of the filament and the AFS, transient brightening, underlying magnetic cancellation, and bidirectional flows were detected, which jointly imply that it could be the magnetic reconnection between the filament and the AFS that changes the connection of filament threads and drives its footpoint to move northward. In addition, during the footpoint evolution, the filament with highly twisted structure underwent several untwisting motions. Meanwhile, transient brightenings were also observed and appeared as bright knots around several positions where filament threads might braid with each other. And some bright blobs were also detected to propagate outward from the brightening region. These observations suggest that magnetic reconnection might be responsible for the untwisting motion. This work exposes us to a dynamical scenario of the filament evolution driven by magnetic reconnection, which will promote our understanding of the formation and eruption of the filaments.

In this paper, we review the file formats for data storage in radio astronomy. As a standard format used in astronomy, Flexible Image Transport System (FITS) is discussed firstly. Random Group FITS File (UVFITS) and FITS Interferometry Data Interchange (FITS-IDI) based on FITS are highlighted. And VOTable promoted by the development of Virtual Observatory (VO) is also briefly reviewed. We all know that the Common Astronomy Software Applications package (CASA) is a science data analysis package for the Atacama Large Millimeter/sub millimeter Array (ALMA). As the fundamental format of CASA, Measurement Set (MS) is emphatically reviewed. Also, a new Science Data Model (SDM) designed to be used in ALMA telescope during the observing process and offline in the ALMA science data archive is expected to play an important role in the format of radio astronomy data storage. In the end, we present a study about the imports and exports of the formats to show the advantage and disadvantage on storage space of each format. Meanwhile, a conclusion has been made.

ImageJ is a graphical user interface (GUI) driven, public domain, Java-based, software package for general image processing traditionally used mainly in life sciences fields. The image processing capabilities of ImageJ are useful and extendable to other scientific fields. Here we present AstroImageJ (AIJ), which provides an astronomy specific image display environment and tools for astronomy specific image calibration and data reduction. Although AIJ maintains the general purpose image processing capabilities of ImageJ, AIJ is streamlined for time-series differential photometry, light curve detrending and fitting, and light curve plotting, especially for applications requiring ultra-precise light curves (e.g., exoplanet transits). AIJ reads and writes standard Flexible Image Transport System (FITS) files, as well as other common image formats, provides FITS header viewing and editing, and is World Coordinate System aware, including an automated interface to the astrometry.net web portal for plate solving images. AIJ provides research grade image calibration and analysis tools with a GUI driven approach, and easily installed cross-platform compatibility. It enables new users, even at the level of undergraduate student, high school student, or amateur astronomer, to quickly start processing, modeling, and plotting astronomical image data with one tightly integrated software package.

We discuss the chosen concepts, detailed design, implementation and calibration of the 85-electrode adaptive optics (AO) system of the Swedish 1-meter Solar Telescope (SST), which was installed in 2013. The AO system is unusual in that it uses a combination of a monomorph mirror with a Shack-Hartmann (SH) wavefront sensor (WFS) and a second high-resolution SH microlens array to aid the characterization, calibration, and modal control of the deformable mirror. An Intel PC workstation performs the heavy image processing associated with cross-correlations and real-time control at a 2 kHz update rate with very low latency. The computer and software continue the successful implementation since 1995 of earlier generations of correlation tracker and AO systems at SST and its predecessor, the 50-cm Swedish Vacuum Solar Telescope, by relying entirely on work-station technology and an extremely efficient algorithm for implementing cross-correlations with the large field of view of the WFS. We describe critical aspects of the design, calibrations, software, and functioning of the AO system. The exceptionally high performance is testified through the highest Strehl ratio (inferred from the measured granulation contrast) of existing meter-class solar telescopes, as demonstrated here at wavelengths shorter than 400 nm and discussed in more detail in a previous separate publication We expect that some aspects of this AO system may also be of interest outside the solar community.

Granules observed in the solar photosphere are believed to be convective and turbulent, but the physical picture of the granular dynamical process remains unclear. Here we performed an investigation of granular dynamical motions of full length scales based on data obtained by the 1 m New Vacuum Solar Telescope and the 1.6 m Goode Solar Telescope. We developed a new granule segmenting method, which can detect both small faint and large bright granules. A large number of granules were detected, and two critical sizes, 265 and 1420 km, were found to separate the granules into three length ranges. The granules with sizes above 1420 km follow Gaussian distribution, and demonstrate flat in flatness function, which shows that they are non-intermittent and thus are dominated by convective motions. Small granules with sizes between 265 and 1420 km are fitted by a combination of power-law function and Gauss function, and exhibit nonlinearity in flatness function, which reveals that they are in the mixing motions of convection and turbulence. Mini granules with sizes below 265 km follow the power-law distribution and demonstrate linearity in flatness function, indicating that they are intermittent and strongly turbulent. These results suggest that a cascade process occurs: large granules break down due to convective instability, which transports energy into small ones; then turbulence is induced and grows, which competes with convection and further causes the small granules to continuously split. Eventually, the motions in even smaller scales enter in a turbulence-dominated regime.

Study of the small-scale structures and material flows associated with solar quiescent filaments is very important for understanding the formation and equilibrium of solar filaments. Using high resolution Hα data observed by the New Vacuum Solar Telescope, we present the structures of barbs and material flows along the threads across the spine in two quiescent filaments on 2013 September 29 and on 2012 November 2, respectively. During the evolution of the filament barb, several parallel tube-shaped structures formed and the width of the structures ranged from about 2.3 Mm to 3.3 Mm. The parallel tube-shaped structures merged together accompanied by material flows from the spine to the barb. Moreover, the boundary between the barb and surrounding atmosphere was very neat. The counter-streaming flows were not found to appear alternately in the adjacent threads of the filament. However, the large-scale patchy counter-streaming flows were detected in the filament. The flows in one patch of the filament have the same direction but flows in the adjacent patch have opposite direction. The patches of two opposite flows with a size of about 10″ were alternately exhibited along the spine of the filament. The velocity of these material flows ranged from 5.6 km s−1 to 15.0 km s−1. The material flows along the threads of the filament did not change their direction for about two hours and fourteen minutes during the evolution of the filament. Our results confirm that the large-scale counter-streaming flows with a certain width along the threads of solar filaments exist and are coaligned well with the threads.

Healthcare is the diagnosis, treatment, and prevention of disease, illness, injury, and other physical and mental impairments in human beings. Healthcare is delivered by practitioners in allied health, dentistry, midwifery-obstetrics, medicine, nursing, optometry, pharmacy, psychology and other care providers. In healthcare service to provide better performance to identify some diseases like blood pressure, skin cancer, diabetes etc. with the sensor devices those are connected with home server by using wireless sensor or wired network policies. The size of data sets being collected and analyzed in the industry for healthcare business intelligence is growing rapidly. In healthcare service case we have to concern about massive data services. To store and process huge amount of unstructured data by using traditional database system is so difficult. To alleviate this drawback we can use Hadoop architecture that has functionality to store and process huge amount of unstructured data. Hadoop Distributed file system (HDFS) can store and the Hadoop MapReduce framework process huge amount of unstructured data that enables easy development of scalable parallel applications. This paper's main motivation is to ensure better data transmission, data reliability and massive data processing with High Availability (HA) based network storage solution. So, in this paper we proposed MapReduce Agent (MRA) to process Big-Data and also proposed iSCSI Protocol adapted Network Attached Storage (NAS) system for healthcare service.