A scalable debugger for massively parallel message-passing programs

Data clustering is an important technique for data visualization and statistical data analysis. Using data clustering technique for geo-located data analysis and visualization has been shown to be useful in many practical domains. Although there are numerous studies for data clustering algorithms, the implementations and applications based on these algorithms are rare and inadequate, especially for web-based data visualization services. In this research, a new web-based interactive data clustering prototype is proposed for geo-located data visualization. The necessary web-based infrastructure for geo-located data analysis and visualization is designed and implemented at first. And then the new interactive data clustering prototype using multi-dimensional K-Means algorithm is implemented on the existing infrastructure. In order to assess whether the new prototype can contribute meaningfully to architectural design and urban studies, qualified users with urban study or architectural backgrounds are invited to use the prototype and then make their comments and evaluations. To make it clear how this new prototype might apply in real world settings, an application scenario in which the user might interact with the prototype is provided and analyzed.

Both interactive visualization and computational analysis methods are useful for data studies and an integration of both approaches is promising to successfully combine the benefits of both methodologies. In interactive data exploration and analysis workflows, we need successful means to quantitatively externalize results from data studies, amounting to a particular challenge for the usually qualitative visual data analysis. In this paper, we propose a hybrid approach in order to quantitatively externalize valuable findings from interactive visual data exploration and analysis, based on local linear regression models. The models are built on user-selected subsets of the data, and we provide a way of keeping track of these models and comparing them. As an additional benefit, we also provide the user with the numeric model coefficients. Once the models are available, they can be used in subsequent steps of the workflow. A model-based optimization can then be performed, for example, or more complex models can be reconstructed using an inversion of the local models. We study two datasets to exemplify the proposed approach, a meteorological data set for illustration purposes and a simulation ensemble from the automotive industry as an actual case study.

Distributed Breakpoint Detection in Message-Passing Programs

Business analytics involves using various technologies to analyze data. Data mining focuses on the automated search for knowledge, patterns, or regularities in data. As a business analyst, it is essential to recognize the type of analytical technique appropriate for solving a specific problem. Exploratory Data Analysis (EDA) describes data using statistical and visualization techniques to highlight important aspects of that data for further analysis. This involves examining a data set from many angles, describing it, and summarizing it without making assumptions about its content. Exploratory data analysis is an essential step before diving into statistical modeling or machine learning to ensure that the data is really what it claims to be and that there are no apparent errors. This type of analysis should be part of data science projects in every organization. Visual analytics is sometimes confused with data visualization. Visual analysis is not simply a matter of graphically representing data. Modern, interactive visual analytics makes combining data from multiple sources easy and performs in-depth data analysis directly in the visualization. Additionally, artificial intelligence and machine learning algorithms can offer recommendations for exploration. Ultimately, visual analytics helps transform massive data sets into business insights that can positively impact an organization. Considering the previous comment about visual data analysis, it should be added that the system has extensive capabilities to create graphical dashboards containing reports and charts. It is essential that in the case of desktops, in addition to the visualizations included in the system itself, it is possible to embed reports from third-party tools.

Deep-learning-based visual data analytics for smart construction management

Focus on software

Firstly, the concepts and classification about visualized data mining technology have been elaborated in this paper, then the technology of data mining, data visualization and regression analysis are discussed, Finally, combined with the example of sliding bearing wear coefficient test, using data mining, data visualization and regression analysis technology, this paper design a system to implement visualized data mining technology under the web environment.

Author(s): Bethel, E. Wes; Childs, Hank; Mascarenhas, Ajith; Pascucci, Valerio; Prabhat | Abstract: Visualization is a highly data intensive science: visualization algorithms take as input vast amounts of data produced by simulations or experiments, and then transform that data into imagery. It turns out, as we shall explore in this chapter, that visualization reveals a somewhat different view of scientific data management challenges than are examined elsewhere in this book. For example, a data ordering and storage layout that works well for saving data from memory to disk may not be the best thing for subsequent visual data analysis algorithms. This chapter will present four broad topic areas under this general rubric: (1) a view of SDM-related issues from the perspective of implementing a production-quality, parallel capable visual data analysis infrastructure; (2) novel data storage formats for multi-resolution, streaming data movement, access and use by post-processing tools; (3) data models, formats and APIs for performing efficient I/O for both simulations and post-processing tools, discussion of issues and previous work in this space; (4) how combining state-of- the-art techniques from scientific data management and visualization enables visual data analysis of truly massive datasets.

Programming environments support the creation, modification, execution and debugging of programs. The goal of integrating a programming environment is more than simply building tools that share a common data base and provide a consistent user interface. Ideally, the programming environment appears to the programmer as a single tool; there are no firewalls separating the various functions provided by the environment. This paper describes the techniques used to integrate Magpie, an interactive programming environment for Pascal. Display windows, called browsers, provide a consistent approach for interacting with the Pascal source code or the execution state of the program. Incremental compilation allows the programmer to specify debugging actions in Pascal, eliminating the need for a separate debugging language.

The curse of dimensionality, i.e., the fact that feature spaces of increasing dimensionality with finite sample sizes tend to be empty, has given incentive to a plethora of research activities in various disciplines and diverse application fields, e.g., statistics or neural networks. Three major application fields are multivariate data classification, data analysis and data visualization. In this contribution, methods for dimensionality reduction from three decades of interdisciplinary research are browsed and their applicability in the above application domains is briefly discussed. Complementing techniques for ensuing interactive data visualization, data navigation and visual exploratory data analysis are presented, which exploit the remarkable human perceptive and associative capabilities for interactive visual exploratory data analysis and systematic recognition system design. The main focus of this paper is on the comparison of feature selection and feature extraction techniques and the potential benefit of their combination. Further, the interesting implications of dimensionality reduction for VLSI design and related area and power consumption are pointed out.

The estimation and control of resource usage is now an important challenge in an increasing number of computing systems. In particular, requirements on timing and energy arise in a wide variety of applications such as internet of things, cloud computing, health, transportation, and robots. At the same time, parallel computing, with (heterogeneous) multi-core platforms in particular, has become the dominant paradigm in computer architecture. Predicting resource usage on such platforms poses a difficult challenge. Most work on static resource analysis has focused on sequential programs, and relatively little progress has been made on the analysis of parallel programs, or more specifically on parallel logic programs. We propose a novel, general, and flexible framework for setting up cost equations/relations which can be instantiated for performing resource usage analysis of parallel logic programs for a wide range of resources, platforms, and execution models. The analysis estimates both lower and upper bounds on the resource usage of a parallel program (without executing it) as functions on input data sizes. In addition, it also infers other meaningful information to better exploit and assess the potential and actual parallelism of a system. We develop a method for solving cost relations involving the max function that arise in the analysis of parallel programs. Finally, we instantiate our general framework for the analysis of logic programs with Independent And-Parallelism, report on an implementation within the CiaoPP system, and provide some experimental results. To our knowledge, this is the first approach to the cost analysis of parallel logic programs.

This study examines the features of forming in data visualization. To do this, the authors hypothesize that there are special areas of interest on the charts. The user pays attention to them in order to decode data encrypted with graphics. The presence of such areas, and in some cases, points, are intuitively determined during the formation of the design rules of information graphics. To verify them, the study used the eye-tracking method and the cluster analysis method. The application of interdisciplinary principles and rules of infographics design has been studied on the example of horizontal and vertical bar charts, pie, pictorial and flow charts. The result of experiments with various types of charts showed the presence of additional areas of interest not previously indicated by data visualization specialists. This makes it possible to clarify the features of graphic forms and the formation of diagrams, allows you to verify the use of design rules formulated by the efforts of domestic and foreign specialists in the late XIX — early XX centuries. Such verification can be done using a methodology that includes statistical methods and the tracking method, which allows us to take into account the valuable experience of the past in modern information design. The presented procedure can be extended to other types of charts, diagrams and thematic maps, and have practical application in the analysis of big data visualization.

Visual analysis has witnessed a growing acceptance as a method of scientific inquiry in the research community. It is used in qualitative and mixed research methods. Even so, visual data analysis is likely to produce biased results when used in analysing a large and noisy dataset. This can be evident when a data analyst is not able to holistically explore, all the values associated with the objects of interest in a dataset. Consequently, the data analyst may assess inconsistent data as consistent when contradiction associated with the data is not visualised. This work identifies incomplete analysis as a challenge in the visual data analysis of a large and noisy dataset. It considers Formal Concept Analysis (FCA) tools and techniques and prescribes the mining and visualisation of Incomplete or Inconsistent Data (IID) when dealing with a large and noisy dataset. It presents an automated approach for transforming IID from a noisy context whose objects are associated with mutually exclusive many-valued attributes, to a formal context.

Programmers of sequential and parallel computers share the objective of developing fast, reliable programs as efficiently as possible. Already, considerable effort has been made to develop tools and techniques for sequential computers. Several approaches have been devised to meet the parallel programming challenge. Sequential languages have been adapted for parallel computers; new parallel languages designed; and tools developed which aid the programmer in detecting parallel code. A parallel programming assistant can aid the user in several ways: it can carry out tasks that are simple but mundane to the user, it can make comprehension easier for the user by summarizing program information; and it can cooperate with the user in doing a complex task, thus combining its own knowledge with that of the user's.

Supporting source-level performance analysis of programs written in data-parallel languages requires a unique degree of integration between compilers and performance analysis tools. Compilers for languages such as High Performance Fortran infer parallelism and communication from data distribution directives, thus, performance tools cannot meaningfully relate measurements about these key aspects of execution performance to source-level constructs without substantial compiler support. This paper describes an integrated system for performance analysis of data-parallel programs based on the Rice Fortran 77D compiler and the Illinois Pablo performance analysis toolkit. During code generation, the Fortran D compiler records mapping information and semantic analysis results describing the relationship between performance instrumentation and the original source program. An integrated performance analysis system based on the Pablo toolkit uses this information to correlate the program's dynamic behavior with the data parallel source code. The integrated system provides detailed source-level performance feedback to programmers via a pair of graphical interfaces. Our strategy serves as a model for integration of data-parallel compilers and performance tools.