- Book Chapter
4
- 10.1016/b978-0-12-374225-4.00010-2
Chapter 10 - Data Consolidation and Integration
- Jan 01, 2009
- Master Data Management
- David Loshin
Chapter 10 - Data Consolidation and Integration
This work studied the situation of today’s data integration. To better solve the complexity and diversity in data integration, we propose a new idea of data integration service platform based on SaaS. The model architecture of data integration and its work principles are introduced. In the platform source data and result data are two interface.in the form of service. In the data integration platform, data are filtered and combined. the data are produced by the users’ requirements. Users call SaaS service to get the data that they wanted. Finally we analyze the model’s characters. This model of platform is more intelligent, efficient and personalized in solving complicate data integration.
Chapter 10 - Data Consolidation and Integration
Chapter 10 - Data Consolidation and Integration
An Exploration of the Application of Data integration in Enterprise Informationization Construction
At present, enterprises have been developing more and more quickly in China. In order to strengthen the systems of enterprise management, manufacturing execution, equipment and so on in each link of management, many enterprises have started to use data integration to construct an Informationization management system. Based on the needs of the development of enterprises, this paper analyzes the pattern formation of data integration and its advantages and explores its role in enterprise informationization construction.
Read moreIsotopic Analysis of Lead at Ultratrace Levels Using Thermal Ionization Mass Spectrometry (TIMS) Coupled with the Continuous Heating Method: Optimization of the Data Integration Range and Method.
This study systematically and experimentally evaluates data integration methods for the isotopic analysis of Pb at ultratrace levels using thermal ionization mass spectrometry (TIMS) with a continuous heating method. The evaluation utilized a certified reference material of Pb (SRM 981). The experimental evaluations encompass different data calculation methods (methods I, II, and III) and integration ranges (full, over 1%, 25%, and 75%). Method I, in which isotope ratios were calculated based on summed ion signal intensities compensating for mass fractionation, was consistent with the certified values for 10 and 1 ng standard samples across all integration ranges. For 100 pg samples, full range calculations failed for specific isotope ratios, but reduced ranges (over 1%, 25%, and 75%) yielded values overlapping with certified ones. Method II, in which isotope ratios were calculated by averaging the precalculated isotope ratios, exhibited inferior performance compared to method I. Method III, using weighted averaging to reduce anomalous values, showed results consistent with those of method I but was recommended only for single measurements. An integration range of over 1% or 25% is preferred to exclude anomalies while compensating for mass fractionation. The optimized method was validated by comparing two different instruments used for the isotopic analysis of the reference material. The enhanced accuracy and precision provide valuable insights for researchers working in ultratrace-level Pb isotopic analysis using TIMS.
Read moreData Integration for Medical Information Management
We present a new method for data integration and security by mixing medical waveforms and images with encrypted patient identifiers and unencrypted ancillary information, such as acquisition parameters, diagnostic comments and notes in textual, pictorial, and voice forms. We vary the sampling rate according to the instantaneous frequency of the signal. Redundant samples (or pixels) are eliminated and replaced by associative data which are labeled using a status string encoded based on the Huffman and run-length techniques. This method achieves both data compression and integration simultaneously, allows synchronized presentation of information from different sources by using multimedia technology, and provides data security features.
Read moreVisualization Analysis and Research of Scientific Papers and Thesis in University
The study about visualization of paper has been developed abroad in the recent few years. To analysis the thesis status and track research hotspots in universities, we propose an effective visualization method based on some techniques and utilities. A combined method of the data integration, data mining and visualization analysis is applied to analyze thesis keywords and citation. We use model-driven approach to design and build the scientific data integration and data mining platform. And a visible data analysis method is outlined to reveal research hotspot and conceptual graph.
Read moreDesign of big data integration platform based on hybrid hierarchy architecture
As the exponential growth of data in internet era, the era of big data is coming. Big data integration creates huge values that makes it a research hotspot. However, in big data era, data shows characters of large volume, velocity, veracity and especially variety which is also called heterogeneity. Multiple different sources of data lead to data heterogeneity. Multi-source heterogeneous data brings challenges to big data integration. In this paper, we proposes a big data integration platform based on hybrid hierarchy architecture, which classifies the underlying multi-source heterogeneous data sources according to themes, and uses the data warehouse as the middle-tier data source. Then user uses the mediator to directly access the middle-tier data source through pattern mapping. Experiments show that compared with the traditional method of directly connecting the underlying data source, this data integration platform improves query performance.
Read moreThe Research of Data Quality Problems in Power Enterprise Data Integration
After years accumulation of informationization construction, power enterprises have established huge and complex application systems, which include multi-class data related to business like production, operation and management. Along with the demands of developing new business application, the data integration is urgently needed to grasp overall data view; however the complex data integration environment causes the data quality problem particularly outstanding. Under the background of the power industry, this paper first studies the data quality definition and dimension recognition; then proposes a data integration platform architecture and studies the data quality control methods in data integration; elaborates data quality assessment methods and procedures; in the view of data product, designs a total data quality management (TDQM) process finally. In a typical case of application, the results show the practicability of the proposed method.
Read moreDIPSBC - data integration platform for systems biology collaborations
BackgroundModern biomedical research is often organized in collaborations involving labs worldwide. In particular in systems biology, complex molecular systems are analyzed that require the generation and interpretation of heterogeneous data for their explanation, for example ranging from gene expression studies and mass spectrometry measurements to experimental techniques for detecting molecular interactions and functional assays. XML has become the most prominent format for representing and exchanging these data. However, besides the development of standards there is still a fundamental lack of data integration systems that are able to utilize these exchange formats, organize the data in an integrative way and link it with applications for data interpretation and analysis.ResultsWe have developed DIPSBC, an interactive data integration platform supporting collaborative research projects, based on Foswiki, Solr/Lucene, and specific helper applications. We describe the main features of the implementation and highlight the performance of the system with several use cases. All components of the system are platform independent and open-source developments and thus can be easily adopted by researchers. An exemplary installation of the platform which also provides several helper applications and detailed instructions for system usage and setup is available at http://dipsbc.molgen.mpg.de.ConclusionsDIPSBC is a data integration platform for medium-scale collaboration projects that has been tested already within several research collaborations. Because of its modular design and the incorporation of XML data formats it is highly flexible and easy to use.
Read moreBatch effect removal methods for microarray gene expression data integration: a survey
Genomic data integration is a key goal to be achieved towards large-scale genomic data analysis. This process is very challenging due to the diverse sources of information resulting from genomics experiments. In this work, we review methods designed to combine genomic data recorded from microarray gene expression (MAGE) experiments. It has been acknowledged that the main source of variation between different MAGE datasets is due to the so-called 'batch effects'. The methods reviewed here perform data integration by removing (or more precisely attempting to remove) the unwanted variation associated with batch effects. They are presented in a unified framework together with a wide range of evaluation tools, which are mandatory in assessing the efficiency and the quality of the data integration process. We provide a systematic description of the MAGE data integration methodology together with some basic recommendation to help the users in choosing the appropriate tools to integrate MAGE data for large-scale analysis; and also how to evaluate them from different perspectives in order to quantify their efficiency. All genomic data used in this study for illustration purposes were retrieved from InSilicoDB http://insilico.ulb.ac.be.
Read moreFrom data silos to seamless integration and coordination: a data-asset centric approach to smart hospital facility management
Purpose Existing hospital building operations involve numerous information technology applications and complex building systems; therefore, an intelligent facility management (FM) platform is required to ensure their continuous operation. To address the persistent issues of data silos, inefficient data interoperability, and workflow incoordination that have been identified in the current body of FM practice and literature, the present study develops a data-asset (DA) centric FM platform specifically designed for hospital buildings. Design/methodology/approach This study proposes a semi-customized approach to develop the DA-centric FM platform for hospital buildings. To elucidate the precise function requirements of the hospital FM platform, focus group interviews are employed. By seamlessly integrating the as-built BIM model, IoT sensor data and FM workflow data, the BIM-based DA model with a data transfer mechanism is developed. The development of the FM platform with function modules in a case study is guided by a five-tier architecture and the coordination theory (CT). The case study provides an in-depth introduction to the applications of DA management, space management and maintenance management modules. Findings The capabilities of the developed DA-centric hospital FM platform are validated through the case application and user satisfaction survey, which assess data quality, automation level, operation efficiency, flexibility and functionality. For hospital FM activities, this DA-centric FM platform realizes data integration and seamless transformation, optimizes workflow coordination and enhances operation performance. Originality/value The initial scholarly contribution is the establishment of the BIM-based DA model, which serves as the data middle platform for continuous data integration, transmission and sharing within the FM platform. Subsequently, under the guidance of the CT, the business process of function modules is designed, improving the intra-module and inter-module workflow coordination. The developed DA-centric FM system along with its performance benchmarking application, assists facility managers and decision-makers in implementing smart operations for hospital buildings and achieving the management goals of safety, efficiency, energy savings and convenience.
Read moreA Review on new Era Medical Healthcare Services with Privacy-free Data Fusion and Integration Methods
Abstract: In this growing age of Internet of Health (IoH), with rapidly going Web and Internet services more and more organization national and world-wide transferring data and information both personal and professional on cloud, our traditional health and medical services are also migrating and transforming in a new age mod- ern healthcare system. Thus, having a large amountof available medical data regarding doctors, patients, medical infrastructures, medicine, treatment plans andprocedures and so on. This information is often very help full in medical care services and in preventing many health disasters by providing right data at right time. But this comes with a very challenging task of carefully integrating the sensitive data, and making sure of user privacy in not disclosed while doing this. In these papers we are analyzing various works done on this problem and trying to come up with a suitable and possible solution, for a better health care services a multi-source data integration and mining method for medical data, named as PDFM (Privacy-free Data Fu- sion and Mining), to search for similar medical records in privacypreserving and time-efficient manner. In this paper we are reviewing as many as research mythologies as we can, to understand the how the tech- nology is changing our healthcare services, and how IoH is being used to save patient life as well as mentining their privacy.
Read moreProceedings of the 32nd International Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe) [Volume 2
This is the first volume of the conference proceedings of the 32nd eCAADe conference, held from 10-12 September 2013 at the Department of Architecture and Built Environment, Faculty of Engineering and Environment, Northumbria University in Newcastle upon Tyne, England. Both volumes together contain 130 papers that were submitted and accepted to this conference. The theme of the 32nd eCAADe conference is Fusion- data integration at its best. All quests for data integration in architecture and the construction industry lead ultimately to FUSION, a synthesis of knowledge that transcends mere combination. FUSION is the dream of a knowledge system that will enable multiple sets of data, in manifold formats, to be presented in a unified view. This conference is exploring the possibilities for advanced levels of data integration in the service of the representation and management of the natural environment, and the design, visualisation and making of the built environment. These proceedings are presenting the contributions which explore the elusive goal of FUSION in architecture and related fields. The first volume of the proceedings contains 65 papers grouped under seven sub-themes (Towards Smarter Cities, Design Tool 1, CAAD Education, Fabrication, Shape-Form-Geometry, Visualisation and Digital Heritage).
Read moreResearch on Data Integration Based on Cloud Computing
In this study, we give some strategies for selecting the data source and several methods for data integration after analyzing the problems of sharing information resources among universities. According to the characteristics of various types of information resources in the university website, we propose the data integration framework model which combines virtual view method with data warehouse method.
Read moreThe Cytoscape Automation app article collection
Cytoscape is the premiere platform for interactive analysis, integration and visualization of network data. While Cytoscape itself delivers much basic functionality, it relies on community-written apps to deliver specialized functions and analyses. To date, Cytoscape’s CyREST feature has allowed researchers to write workflows that call basic Cytoscape functions, but provides no access to its high value app-based functions. With Cytoscape Automation, workflows can now call apps that have been upgraded to expose their functionality. This article collection is a resource to assist readers in quickly and economically leveraging such apps in reproducible workflows that scale independently to large data sets and production runs.
Read moreMethane Emissions Attribution and Quantification Based on “Plus Mobile Monitoring” Approach
Mitigating methane emissions is widely regarded as one of the most cost-effective strategies for combating climate change. Achieving this goal requires a complementary and flexible combination of source attribution and quantification technologies with various minimum detection limits (MDLs) and spatial-temporal resolutions. Ground-based mobile monitoring (MOMO) offers advantages such as high temporal resolution, lower MDLs, and great source attribution capability in mixed-source environments. However, the lack of guidance on appropriate methodological choices have limited its integration into the broader “space–air–ground” methane monitoring framework, particularly for sources with diverse emission characteristics. Here, we present a comprehensive evaluation of MOMO techniques, including their advantages, limitations, quantification uncertainties, and MDLs. Building on this assessment, we propose a “Plus MOMO” strategy to address monitoring needs ranging from regional-scale source identification to source-level localization, while enabling discrimination between fossil-fuel and biogenic methane emissions. To support this approach, we developed a MOMO data integration and visualization platform designed to facilitate multi-source data fusion and interpretation. The “Plus MOMO” strategy has been applied in several in situ case studies, including methane leaks from rural natural gas usage in Beijing, emissions from high- and low-gas coal mines, and abandoned coal mines. Based on these applications, we advocate the development of standardized MOMO protocols and a “MOMO Plus” multi-source data integration framework to improve the accuracy and robustness of methane emission attribution and quantification.
Read more