Distributed Database Management Systems and the Data Grid

Data replication is a key issue in a Data Grid and can be managed in different ways and at different levels of granularity: for example, at the file level or object level. In the High Energy Physics community, Data Grids are being developed to support the distributed analysis of experimental data. We have produced a prototype data replication tool, the Grid Data Mirroring Package (GDMP) that is in production use in one physics experiment, with middleware provided by the Globus Toolkit used for authentication, data movement, and other purposes. We present here a new, enhanced GDMP architecture and prototype implementation that uses Globus Data Grid tools for efficient file replication. We also explain how this architecture can address object replication issues in an object-oriented database management system. File transfer over wide-area networks requires specific performance tuning in order to gain optimal data transfer rates. We present performance results obtained with GridFTP, an enhanced version of FTP, and discuss tuning parameters.

The data grid is one of the infrastructures for data and storage resource management. Data replication can improve data access performance, fault tolerance, and reduce network transmission bandwidth. As the site storage space is limited in the grid, how to effectively use grid resources become an important challenge. This paper introduces a dynamic grid replication algorithm based on popularity support and confidence (BPSC). Through the algorithm, data and its associated copy can be placed on a suitable site, with reduced access latency. Through Optorsim, simulation results show that the algorithm can provide better performance compared with other algorithms Grid computing is an important branch of distributed computing. Grid computing constructs a virtual computer system through using a different location of the large number of heterogeneous resources (CPU and storage), provides the model to solve the problem of large scale computing and storage. The data grid is mainly the grid for data storage management. The data grid is defined as an effective combination of data and computing resources of distributed systems by Data Grid Group. The large-scale data- intensive applications, such as bioinformatics, high energy physics, space information generated vast amounts of data, these data may be TB scale, even up to the scale of PB. It is not practical to maintain large scale data at each site, and provide computing resources for visitors. At the same time, it will lead to increased access latency through a centralized way to storing and accessing these data from each site. Data replication technology is an effective method to reduce access latency in the data grid system. Data replication is one of the basic methods of distributed systems to improve the efficiency of system access, maintenance, system high availability. Data replication is to store data in the appropriate site for users to effective access to massive data. Data replication can reduce data access latency, reduce network bandwidth consumption, avoid congestion, adjust the load balancing in server-side, improve system reliability. Many data replication algorithm can reduce data access latency, improve system reliability, but which data will be copied, when the data will be copied at, where the data will be copied are the basic means of determining data replication algorithm. In this paper, we introduced a real-time dynamic data replication algorithm. The algorithm is based on the popularity of file dynamic to replicate data, and consider the storage space limitations of the site. Through optorsim simulation verified the algorithm. This paper is organized as follows: Section 2 is about related works on replication in data grids. In Section 3, system model and component in system are presented. The file

Both object-oriented and relational database management systems are referred to as DBMS. The web-scale is expanding at an incredible rate, and with it comes an increase in mobile applications, technologies, and social media platforms. The rapid growth of these technologies produces a variety of structured and unstructured data in various forms, each of which has various consequences for data security. Using RDBMS and OODBMS, this study's methodology outlines the development, installation, and management process of multiple and complicated data sets. This study gives a documented study comparing different kinds of data stored in databases by employing two types of database techniques: relational database method and object-oriented database technique. We use a different fingerprint database for the web and mobile devices. This database is also managed using different technologies, such as MySQL, and it accommodates data generated using distinct methods. In addition, this study explores the benefits and advantages of the various databases and determines the ideal database management system for organizations. According to the survey's findings, RDBMS stores data and the relationships between them in tables, but OODBMS stores data in objects, in a manner analogous to Object-Oriented Programming (OOP). According to the study's findings, the primary distinction between relational database management systems (RDBMS) and object-oriented database management systems (OODBMS) is that RDBMS is a Database Management System based on the relational model. In contrast, OODBMS is a Database Management System that facilitates creating and modeling data as objects.

The V3 Video Server is a demonstration showing a multimedia application developed on top of the VODAK database management system. VODAK is a prototype of an object-oriented and distributed database management system (DBMS) developed at GMD-IPSI. The V3 Video Server allows a user to interactively store, retrieve, manipulate, and present analog and short digital video clips. A video clip consists of a sequence of pictures and corresponding sound. Several attributes like author, title, and a set of keywords are annotated. The highlights of the demonstration are as follows. (1) It is shown that an object-oriented database management systems is very useful for the development of multimedia applications. (2) The video server gives valuable hints for the development of an object-oriented database management system in direction to a multimedia database management system.

Caltech High Energy Physics (HEP) has a broad program in both experimental and theoretical physics. We are known for our creativity and leadership. The future is uncertain and we strive to be involved in all the major areas of experimental and theoretical HEP physics so no matter where the important discoveries occur we are well positioned to play an important role. An outstanding group of postdoctoral scholars, graduate students, staff scientists, and technical and administrative personnel support our efforts in experimental and theoretical physics. The PI’s on this grant are involved in the following program of experimental and theoretical activities: I) EXPERIMENTAL PHYSICS Our CMS group, led by Harvey Newman and Maria Spiropulu, has played a key role in the discovery and interpretation of the Higgs boson and in searches for new physics. They have important hardware responsibilities in both ECAL and HCAL and are also involved in the upgrades needed for the High Luminosity LHC. Newman's group also develops and operates Grid-based computing, networking, and collaborative systems for CMS and the US HEP community. The charged lepton (Mu2e) and quark BaBar flavor physics group is led by David Hitlin and Frank Porter. On Mu2e they have been instrumental in the design of the calorimeter. Construction responsibilities include one third of the crystals and associated readout as well as the calibration system. They also will have responsibility for a major part of the online system software. Although data taking ceased in 2008 the Caltech BaBar group is active on several new forefront analyses. The neutrino group is led by Ryan Patterson. They are central to NOvA's core oscillation physics program, to calibration, and to detector readiness being responsible for the production and installation of 12,000 APD arrays. They have key roles in neutrino appearance and disappearance analysis in MINOS and MINOS+. Sunil Golwala leads the dark matter direct detection effort. Areas of activity include: CDMS II data analysis, contributions to SuperCDMS Soudan operations and analysis, R&D towards SuperCDMS SNOLAB, development of a novel screener for radiocontamination (the BetaCage), and development of new WIMP detector concepts. Ren-Yuan Zhu leads the HEP crystal laboratory for the advanced detector R&D effort. The crystal lab is involved in development of novel scintillating crystals and has proposed several crystal based detector concepts for future HEP experiments at the energy and intensity frontiers. Its current research effort is concentrated on development of fast crystal scintillators with good radiation hardness and low cost. II) THEORETICAL PHYSICS The main theme of Sergei Gukov's current research is the relation between the geometry of quantum group invariants and their categorification, on the one hand, and the physics of supersymmetric gauge theory and string theory, on the other. Anton Kapustin's research spans a variety of topics in non-perturbative Quantum Field Theory (QFT). His main areas of interest are supersymmetric gauge theories, non-perturbative dualities in QFT, disorder operators, Topological Quantum Field Theory, and non-relativistic QFT. He is also interested in the foundations and possible generalizations of Quantum Mechanics. Hirosi Ooguri's current research has two main components. One is to find exact results in Calabi-Yau compactification of string theory. Another is to explore applications of the AdS/CFT correspondence. He also plans to continue his project with Caltech postdoctoral fellows on BPS spectra of supersymmetric gauge theories in diverse dimensions. John Preskill works on quantum information science. This field may lead to important future technologies, and also lead to new understanding of issues in fundamental physics John Schwarz has been exploring a number of topics in superstring theory/M-theory, supersymmetric gauge theory, and their AdS/CFT relationships. Much of the motivation for these studies is the desire to gain a deeper understanding of superstring theory and M-theory. The research interests of Mark Wise span particle physics, cosmology and nuclear physics. His recent work has centered on extensions of the standard model where baryon number and lepton number are gauged and extensions of the standard model that have novel sources of baryon number violation and new sources of charged lepton flavor violation

The V 3 Video Server is a demonstration showing a multimedia application developed on top of the VODAK database management system. VODAK is a prototype of an object-oriented and distributed database management system (DBMS) developed at GMD-IPSI. The V 3 Video Server allows a user to interactively store, retrieve, manipulate, and present analog and short digital video clips. A video clip consists of a sequence of pictures and corresponding sound. Several attributes like author, title, and a set of keywords are annotated. The highlights of the demonstration are as follows. (1) It is shown that an object-oriented database management systems is very useful for the development of multimedia applications. (2) The video server gives valuable hints for the development of an object-oriented database management system in direction to a multimedia database management system .

WebDav and HTTP are becoming popular protocols for data access in the High Energy Physics community. The most used Grid and Cloud storage solutions provide such kind of interfaces, in this scenario tuning and performance evaluation became crucial aspects to promote the adoption of these protocols within the Belle II community. In this work, we present the results of a large-scale test activity, made with the goal to evaluate performances and reliability of the WebDav protocol, and study a possible adoption for the user analysis. More specifically, we considered a pilot infrastructure composed by a set of storage elements configured with the WebDav interface, hosted at the Belle II sites. The performance tests include a comparison with xrootd and gridftp. As reference tests we used a set of analysis jobs running under the Belle II software framework, accessing the input data with the ROOT I/O library, in order to simulate as much as possible a realistic user activity. The final analysis shows the possibility to achieve promising performances with WebDav on different storage systems, and gives an interesting feedback, for Belle II community and for other high energy physics experiments.

A data replication algorithm for groups of files in data grids

A paradigm change in scholarly communication is underway. Supporting Open Science, an effort to make scientific research data accessible to all interested parties by openly publishing research and encouraging others to do the same thereby making it easier to communicate scientific knowledge, is a part of the change that has become increasingly important for (digital) libraries. Digital libraries are able to play a significant role in enabling Open Science by facilitating data sharing, discovery and re-use. Because data citation is often mentioned as one incentive for data sharing, enabling data citation is a crucial feature of research data services. In this article we present a case study of data citation services for the High-Energy Physics (HEP) community using digital library technology. Our example shows how the concept of data citation is implemented for the complete research workflow, covering data production, publishing, citation and tracking of data reuse. We also describe challenges faced and distil lessons learnt for infrastructure providers and scholarly communication stakeholders across disciplines.

The future of connectivity is wireless and in that context the High Energy Physics (HEP) community is no exception. The volume of data produced at the Large Hadron Collider (LHC) is immense and represent a considerable processing challenge. Moreover the LHC HEP detector environment is one of the most demanding working environments with respect to ultra-low latencies, ultra-high data rate, reliable indoor coverage and harsh radiation environment in the world. Together with the standard requirements to be energy efficient, low cost and secure. Today, the data transmission in HEP experiments is based on wire and optical readout architecture. We propose the use of wireless data transmission described here as a third option. This paper present the motivation and overview of the status of our ASIC development and first ideas for wireless read out and control. In this first phase of development, we will focus on the 60 GHz band, which provide high bandwidth, small form factor and is a mature technology. Open issues and future strategy are also briefly discussed.

One of the principal motivations to use the grids computing and data grids comes from the applications using of large sets from data, for example, in high-energy physics or life science to improve the total output of the software environments used to carry these applications on the grids, data replication are deposited on various selected sites. In the field of the grids the majority of the strategies of replication of the data and scheduling of the jobs were tested by simulation. Several simulators of grids were born. One of the most simulators interesting for our study is the OptorSim tool. In this paper, we present an extension of the OptorSim simulator by a consistency management module of the replicas in the Data Grids. This extension corresponds to a hybrid approach of consistency, it inspired by the pessimistic and optimistic approaches of consistency. This suggested approach has two vocations, in the first time, it makes it possible to reduce the response times compared with the completely pessimistic approach, in the second time, it gives a good quality of service compared with the optimistic approach.

Michael Riordan; Lillian Hoddeson; Adrienne W. Kolb. <i>Tunnel Visions: The Rise and Fall of the Superconducting Super Collider</i>. xiii + 448 pp., illus., maps, bibl., index. Chicago/London: University of Chicago Press, 2015. $40 (cloth).

In High Energy Physics (HEP) experiments, it is useful for physics analysis and outreach if the event display software can provide sophisticated visualization effects. Unity is professional software that provides 3D modeling and animation production. GDML format files are commonly used for detector descriptions in HEP experiments. In this work, we present a method for automating the import of GDML files to the Unity engine modeling through geometric transformation. With the conversion of the file format, the complicated geometric description of the HEP detector in a GDML file can be imported directly into the Unity engine using an FBX file. This format conversion was applied to BESIII experiments to achieve an automated geometry conversion to build geometry models in the Unity engine.

Nowadays, there is a trend to create resource-consuming applications without building heavy computer centers, but to use resources on computer systems distributed over the internet. Grid middleware is a framework to access these resources. The concern of this paper is the evaluation of a specific grid middleware, namely Globus Toolkit, for data-intensive applications. As a test case, we have designed and implemented a service-based distributed web crawler on top of this middleware: A web crawler is a complex application consisting of many nodes. It imposes significantly higher demands on grid middleware regarding administrative flexibility compared to grid applications that allocate computing power of grid nodes. We have observed that some components of Globus Toolkit are flexible enough to provide the control functionality necessary for a web crawler, while others are not. For these other components, we propose possible extensions. Since we expect the combination of those characteristics to occur with many other grid applications as well, our study is of broader interest, beyond web crawling.

This paper uses the concepts of RAID-5 architecture to enhance fault tolerance in Distributed Database Management Systems. The use of parity bits for recovery from a single database site failure in accordance with the RAID-5 architecture is first demonstrated. The paper then addresses the concerns with this architecture w.r.t. a double disk failure and low availability. The proposed solution aims at providing the DDBMS with high recoverablilty in cases of two database sites failing simultaneously. It also enables the DDBMS to better respond to incoming requests directed at surviving and the failed sites without breaking down and to assist simultaneously, in the reconstruction of the failed site(s) in cases of both single and double database site failures. The proposed solution reduces the cases of complete system failure during a double database site crash significantly.