Research on Computer Aided Information Analysis Technology Based on Data Mining and Social Network Analysis

8 - Multidimensional clustering

Automated design of multidimensional clustering tables for relational databases

Defining and structuring management views is a fundamental task of the specification of data marts and reporting systems. Today such systems are based on data warehouses. A data warehouse stores materialized views on business processes to support the management’s information requirements (cf. Inmon 1996; Inmon, Hackathorn 1994; Inmon et al. 1997). It is located on a central layer of an idealized layer oriented architecture connecting online transaction processing (OLTP) systems and components enabling online analytical processing (OLAP) (cf. Becker, Holten 1998; Chaudhuri, Dayal 1997). The latter components are intended to support navigations adequate for management users through so called multi dimensional information spaces. OLTP systems directly support the business processes and are the sources of data used by OLAP systems. Typically, the integration of OLTP systems and the data warehouse is based on tools performing so called extraction, transformation and loading tasks (ETL) (cf. Inmon 1996; Widom 1995)

Database applications such as online transaction processing (OLTP) and decision support systems (DSS) constitute the largest and fastest-growing segment of the market for multiprocessor servers. However, most current system designs have been optimized to perform well on scientific and engineering workloads. Given the radically different behavior of database workloads (especially OLTP), it is important to re-evaluate key system design decisions in the context of this important class of applications.This paper examines the behavior of database workloads on shared-memory multiprocessors with aggressive out-of-order processors, and considers simple optimizations that can provide further performance improvements. Our study is based on detailed simulations of the Oracle commercial database engine. The results show that the combination of out-of-order execution and multiple instruction issue is indeed effective in improving performance of database workloads, providing gains of 1.5 and 2.6 times over an in-order single-issue processor for OLTP and DSS, respectively. In addition, speculative techniques enable optimized implementations of memory consistency models that significantly improve the performance of stricter consistency models, bringing the performance to within 10--15% of the performance of more relaxed models.The second part of our study focuses on the more challenging OLTP workload. We show that an instruction stream buffer is effective in reducing the remaining instruction stalls in OLTP, providing a 17% reduction in execution time (approaching a perfect instruction cache to within 15%). Furthermore, our characterization shows that a large fraction of the data communication misses in OLTP exhibit migratory behavior; our preliminary results show that software prefetch and writeback/flush hints can be used for this data to further reduce execution time by 12%.

University of Edinburgh, School of Informatics, EH8 9AB, Edinburgh, Scotland, United Kingdom ; cristinutza0107@yahoo.com Abstract. This paper discusses the problem of multidimensional databases, with the purpose of demonstrating the efficient support offered by them for the management of OLAP processing and motivation of decisions, especially the ones related to environmental risks. The OLAP (On-Line Analytical Processing) systems that implement or use multidimensional databases are oriented towards decision makers and allow them to an easily process, sectioning and grouping of data, as well as the visualization of data from different perspectives, for the discovery of the factors that would influence a certain behavior. OLAP systems offer advanced statistical analysis facilities, such as the one based on time series or forecasts, which are based on predefined models. The calculation of the environmental risk offers an image of the degree of air pollution due to specific polluting factors, obtained especially as result of the industrial processes that have taken place in the Targoviste, in Dambovita area. An OLAP system, consisting of decision support components, was implemented as part of the PN2 three years research project: “Sustainable Management System of Resources Used for Monitoring and Evaluating the Environmental Risks in Order to Prevent the Negative Effects and to Manage Crises Situations - MEMDUR”, code D11-037/18.09.2007. Keywords: environmental risks, multidimensional databases, OLAP systems, SOLAP architecture, MEMDUR project.

A data warehouse are central repositories of integrated data from one or more disparate sources from operational data in On-Line Transaction Processing (OLTP) system to use in decision making strategy and business intelligent using On-Line Analytical Processing (OLAP) techniques. Data warehouses support OLAP applications by storing and maintaining data in multidimensional format. Multidimensional data models as an integral part of OLAP designed to solve complex query analysis in real time.

Data warehouses provide data for on-line analytical processing (OLAP) systems, which deal with analytical tasks in businesses. As these tasks do not depend on the latest updates by transactions, the input from operational databases is separated from the outputs to dialogue interfaces for OLAP. In this paper a layered formal specification for data warehouses and OLAP systems using Abstract State Machines (ASMs) is presented. The approach explicitly exploits the fundamental idea of separating input from operational databases and output to OLAP systems. Then it will be shown how this specification can be extended to distributed data warehouses.KeywordsData WarehouseOperational DatabaseAbstract State MachineStar SchemaTional DatabaseThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

The rapidly changing data requirements of today's dynamic business environments are not handled well by current online analytical processing (OLAP) systems. Physically integrating data from new sources into OLAP systems is a long and time-consuming process, making logical integration the better choice in many situations. The increasing use of Extended Markup Language (XML) suggests that the required external data will most often be available in XML format. We present a theoretically well-founded approach to the logical federation of OLAP and XML data sources. The approach allows external XML data to be presented along with dimensional data in OLAP query results and enables the use of external XML data for selection and grouping. Special care is taken to ensure that semantic problems do not occur in the integration process. This opens up many new application areas for OLAP. A number of effective optimization techniques for OLAP-XML federations are presented. Performance results from the prototype implementation show that the approach is an attractive alternative to physical integration. The approach is exemplified using a real-world case study from the B2B domain.

SummaryThe Model‐Driven Architecture (MDA) is an approach that aligns modeling and automation for software development. By applying such an approach to data warehouse (DW) projects, we can minimize a great deal of time and cost. Furthermore, most of OnLine Analytical Processing (OLAP) platforms seem to be like black boxes that provide wizards only to business intelligence developers to create and manipulate OLAP objects without allowing their sustainability and migration from a platform to another. That is why many works in the literature have proposed using the MDA approach in DW projects. However, most of them have mainly focused on the generation of the DW relational model from the conceptual one, and they overlooked the OLAP model and the cube implementation.To deal with this problem, we propose in this paper an MDA solution to automate the process of getting OLAP cube and its implementation through a set of metamodels and automatic transformations among them. In fact, the proposal generates the OLAP and DW relational models (PSMs) from the conceptual one, using also a PDM model that describes the target business intelligence platform. After that, the source code to create the cube is got from both PSM models. For this aim, we define a set of transformation rules implemented using the Atlas transformation language. Finally, a case study will be provided to validate our approach.

In this world, each and every activity is enriched with lot of information. Business and other organization needs information for better decision making. Business Intelligence is a set of methods, process and technologies that transform raw data into meaningful and useful information. Some of the functions of business intelligence technologies are reporting, Online Analytical Processing, Online Transaction processing, data mining, process mining, complex event processing, business performance management, benchmarking and text mining. The applications of business intelligence includes E-commerce recommender system, approval of bank loan, credit/debit card fraud detection etc., In order to obtain business intelligence from large dataset there many techniques are available in data mining such as characterization, discrimination, frequent itemset mining, outlier analysis, cluster analysis and so on. In this proposed algorithm frequent itemset mining and clustering algorithm is used to extract the information from the dataset in order to make the decision making process more efficient and to improve the business intelligence.

The Decision support system that audits social insurance funds on-line based on data warehouse plays an important role in increasing audit efficiency and providing decision-making information to improve the social insurance system. In the paper the on-line auditing decision support system is introduced. Based on the data warehouse technology and on-line auditing, the system's architecture is given. The function of the system as data transmitting, data collecting, data auditing, data searching and decision analysis etc are analyzed in detail. Finally the design and the on-line analysis of the data warehouse are discussed in the paper.

There are ambiguities and vagueness in solar radiation records during a day. As a consequence, the development and adaptation of automatic knowledge acquisition techniques under uncertainty is entirely advisable. Among them fuzzy sets theory formulizes and analyses the situations in which the uncertainty is due to non-precise environment. Any good decision is based on information. Decision makers should reduce their uncertainty by obtaining as much reliable and consistent information as possible. In this paper, we introduce a novel decision support system for handling uncertain climate data consolidated with SAS application system. This novel approach is based on the membership function and multidimensional analysis. From our findings, we conclude that data warehousing and data mining are essentials for an effective decision support system. Because organizations frequently process uncertain information, decision makers should reduce their uncertainty by obtaining as much reliable and consistent information as possible. Due to the potential benefits of a data warehouse as well as internal and external pressure for creating a competitive advantage, many organizations have launched data warehouse projects with the expectations of acquiring a consistent and reliable source of data for their DSS. Therefore, a DSS with data warehouse should improve the performance of users by improving information accessibility which positively affects the quality of decision making [1]. At present there is a great need to provide decision makers from middle management upward with information at the correct level of detail to support decision making. Data warehousing, on-line analytical processing (OLAP), and data mining provide this functionality [2]. Although there are researchers in fields of certainty, such as the natural science fields of physics, mathematics, biology, and in the social science fields of philosophy, economy, society, psychology, cognition, almost nobody places suspicion on the uncertain essence of the world. An increasing number of scientists believe that uncertainty is the charm of the world and only uncertainty itself is certain! For a long time, humans thought uncertainty was equal to randomness. Probability theory is the main mathematical tool to solve the problem of randomness. With more in-depth studies, people found a kind of uncertainties that could not be described with randomness. That was “fuzziness”. Fuzziness is a characteristic feature of modern science to describe quantitative relationships and space formation by using precise definitions and rigidly proven theorems, and to explore the laws of the objective world by using precisely controlled experimental methods, accurate measurements, and calculation so as to establish a rigorous theoretic system [3]. There are ambiguities and vagueness in solar radiation records during a day. There is a desired need for providing a simple technique whereby uncertainties in the process of solar radiation measurements being handled. In this paper, we introduce a novel decision support system for handling uncertain climate data consolidated with SAS application system. This novel approach is based on the membership function and multidimensional analysis. The rest of the paper is organized as follows. The next section reviews related work. In Section 3 we will describe the characteristics of decision support systems. In Section 4 we demonstrate the basic data warehousing concepts. Section 5 provides the definition of a general framework for fuzzy sets in the presence of uncertainty. Section 6 introduces climate case study. In Section 7 we present our approach for solving this problem. Section 8 presents the results analysis. Section 9 shows International Journal for Information Security Research (IJISR), Volume 1, Issue 2, June 2011 Copyright © 2011, Infonomics Society 35

On-line analytical processing (OLAP) describes an approach to decision support, which aims to extract knowledge from a data warehouse, or more specifically, from data marts. Its main idea is providing navigation through data to non-expert users, so that they are able to interactively generate ad hoc queries without the intervention of IT professionals. This name was introduced in contrast to on-line transactional processing (OLTP), so that it reflected the different requirements and characteristics between these classes of uses. The concept falls in the area of business intelligence.

Finding an application-appropriate model for XML data warehouses

Business intelligence encompasses all activities dealing with collecting, storing/managing, and analyzing business-relevant data with the objective of generating knowledge as input to decision support. Business intelligence is often used as an umbrella term for data warehousing, reporting and OLAP (online analytical processing), MIS/DSS, and data mining, respectively.If we count all topics listed above, it is obvious that business intelligence has quite a long history also in the tourism domain. As early examples in tourism, we can identify the DINAMO system introduced by American Airlines already in 1988 or TourMIS in 1998.The widespread use of ICT, especially the uptake of the Internet and social media, led to an increase of available data on customers, competitors, and the whole market in all major business domains, including tourism. More powerful hardware and sophisticated methods to store and analyze such data turned business intelligence into one of the fastest-growing technologies and most challenging areas in the last decade.This chapter gives an overview on the topic of business intelligence and all technical components of a BI architecture (i.e., information extraction and transformation, data warehousing, and different mechanisms and tools to access and analyze data, like reporting or OLAP tools, dashboards, or data mining toolsets). Moreover, the chapter looks at the history of BI in tourism and presents and discusses typical application scenarios in tourism. Finally, we look at current trends and latest developments in the area of business intelligence and their expected implications for the tourism domain.KeywordsBusiness intelligenceData warehousingData analysisOnline analytical processingManagement information systemsDecision support systems