- Research Article
26
- 10.1016/0306-4379(83)90001-7
A seven-tuple representation for hierarchical data structures
- Jan 01, 1983
- Information Systems
- Timo Niemi
A seven-tuple representation for hierarchical data structures
Abstract The aim of this paper is to present the first part of a new approach devoted to the generation of a data structure and operators for the hierarchical representation of 3D polyhedra. Here are described the treatments which allow to create some of the elements of this hierarchical model. At first, partitions of the initial polyhedron are mapped into planar connex hulls. Then, these domains are used like a piecewise parametric 2D space for subsequent polyhedra generations. In order to create such a mapping, the initial 3D polyhedron is partitioned to produce simply convex subsets which can be submitted to the parametrization process. The next step consists in the generation of a minimum representation of the initial 3D polyhedron. This representation forms the root of the hierarchical data structure. Then, the mapping obtained allows the construction of various polyhedral representations of the initial geometry. Criteria related to 3D parameters are used to generate the range of polyhedra. The reverse mapping (from 2D to 3D) helps reduce the computing cost required to generate 3D polyhedra. Each 3D polyhedron generation is carried out under 3D geometric criteria depending on the context. i.e.: structural analysis, levels of details of a geometric model, ... Among the goals of the hierarchical data structure, the unification and the inter dependency of the meshes required to carry out the structural analysis of a part occupies a central position.
A seven-tuple representation for hierarchical data structures
A seven-tuple representation for hierarchical data structures
Efficiency of Uniform Grids for Intersection Detection on Serial and Parallel Machines
The uniform grid data structure is a flat (non-hierarchical) grid whose resolution adapts to the data. An exhaustive analysis of the uniform grid data structure for determining intersections in a set of many small line segments is presented. Databases from cartography, VLSI, and graphics with up to 115,973 edges are used. For each data set the intersection time, the ratio of edge pairs tested to pairs found to intersect, and size of intermediate data structures was measured as a function of grid resolution. The execution time was relatively insensitive to the grid size over a range of up to a factor of 10. 115,973 edges were processed to find 135,050 intersections in 683 seconds on a Sun 3/50 workstation. This data structure is also ideally suited for implementation on a parallel machine. When executing on a 16 processor Sequent Balance 21000, total times averaged ten times faster than when using only one processor. Finding all 81,373 intersections in a 62,045 edge database took only 28 seconds elapsed time. This research shows that more complicated, hierarchical data structures, such as quadtrees, are not necessary for this problem.
Read moreCross-Classified Multilevel Models
Cross-classified multilevel modelling is an extension of standard multilevel modelling for non-hierarchical data that have cross-classified structures. Traditional multilevel models involve hierarchical data structures whereby lower level units such as students are nested within higher level units such as schools and where these higher level units may in turn be nested within further groupings or clusters such as school districts, regions, and countries. With hierarchical data structures, there is an exact nesting of each lower level unit in one and only one higher level unit. For example, each student attends one school, each school is located within one school district, and so on. However, social reality is more complicated than this, and so social and behavioural data often do not follow pure or strict hierarchies. Two types of non-hierarchical data structures which often appear in practice are cross-classified and multiple membership structures. In this article, we describe cross-classified data structures and cross-classified hierarchical linear modelling which can be used to analyse them.
Read moreMACHINE LEARNING DECISION SUPPORT SYSTEMS FOR ADAPTATION OF EDUCATIONAL CONTENT TO THE LABOR MARKET REQUIREMENTS
Context. The urgent task of increasing the functional efficiency of machine learning of decision support system (DSS) for assessing compliance with content modern requirements of the educational disciplines of the graduation department based on the results of the employer survey has been solved.
 Objective. Increasing the functional efficiency of machine learning of DSS for assessing compliance with modern requirements of the educational disciplines content of the first (bachelor’s) level specialty educational and professional program based on machine learning and pattern recognition.
 Method. The method of machine learning of DSS is proposed for adapting the educational content of the graduation department to the labor market requirements. The idea of the method is to maximize the information capacity of the DSS in the machine learning process, which allows in the monitoring mode to guarantee a high full probability of making the correct classification decisions. The method was developed as part of a functional approach to modeling cognitive processes of natural intelligence, which makes it possible to provide DSS with flexibility when retraining the system due to increasing the power of the recognition classes alphabet. The method is based on the principle of maximizing the amount of information in the machine learning process. The modified Kullback information measure, which is a functional of the accuracy characteristics of classification solutions, is considered as a criterion for optimizing machine learning parameters. According to the proposed functional category model, an information-extreme machine learning algorithm was developed based on the hierarchical data structure in the form of a binary decursive tree. The use of such a data structure allows you to automatically divide a large number of recognition classes into pairs of nearest neighbors, for which optimization of machine learning parameters is carried out according to a linear algorithm of the required depth. The geometric parameters of hyperspherical containers of recognition classes were considered as optimization parameters, which were restored in the radial basis of the binary space of Hamming features in the machine learning process. At the same time, the input traning matrix was transformed into a working binary training matrix, which was changed in the machine learning process through admissible transformations in order to adapt the input information description of the DSS to the maximum reliability of classification decisions.
 Results. The informational, algorithmic, and software of the DSS was developed to assess the educational content quality based on the machine analysis results of respondents’ answers. Within the framework of the geometric approach, based on the informationextreme machine learning results, highly reliable decisive rules, practically invariant to the multidimensionality of the recognition features space, were constructed based on the hierarchical data structure in the form of a binary decursive tree. The influence of machine learning parameters on the functional effectiveness of machine learning of the DSS was studied on the evaluation example of the educational content of the educational and professional bachelor’s program of the specialty 122 Computer Science.
 Conclusions. The computer modeling results confirm the high functional efficiency of the proposed method of informationextreme hierarchical machine learning and can be recommended for practical use in institutions of higher education to assess compliance with modern requirements of the educational content of graduation departments.
Read moreEnsemble Modeling of CME Propagation
The current progression toward solar maximum provides a unique opportunity to use multi-perspective spacecraft observations together with numerical models to better understand the evolution and propagation of coronal mass ejections (CMEs). Of interest to both the scientific and forecasting communities are the Earth-directed “halo” CMEs, since they typically produce the most geoeffective events. However, determining the actual initial geometries of halo CMEs is a challenge due to the plane-of-sky projection effects. Thus the recent 15 February 2011 halo CME event has been selected for this study. During this event the Solar TErrestrial RElations Observatory (STEREO) A and B spacecraft were fortuitously located ∼ 90° away from the Sun–Earth line such that the CME was viewed as a limb event from these two spacecraft, thereby providing a more reliable constraint on the initial CME geometry. These multi-perspective observations were utilized to provide a simple geometrical description that assumes a cone shape for a CME to calculate its angular width and central position. The event was simulated using the coupled Wang–Sheeley–Arge (WSA)-Enlil 3D numerical solar corona-solar wind model. Daily updated global photospheric magnetic field maps were used to drive the background solar wind. To improve our modeling techniques, the sensitivity of the modeled CME arrival times to the initial input CME geometry was assessed by creating an ensemble of numerical simulations based on multiple sets of cone parameters for this event. It was found that the accuracy of the modeled arrival times not only depends on the initial input CME geometry, but also on the accuracy of the modeled solar wind background, which is driven by the input maps of the photospheric field. To improve the modeling of the background solar wind, the recently developed data-assimilated magnetic field synoptic maps produced by the Air Force Data Assimilative Photospheric flux Transport (ADAPT) model were used. The ADAPT maps provide a more instantaneous snapshot of the global photospheric field distribution than that provided by traditional daily updated synoptic maps. Using ADAPT to drive the background solar wind, an ensemble set of eight different CME arrival times was generated, where the spread in the predictions was ∼ 13 hours and was nearly centered on the observed CME shock arrival time.
Read moreCSVO: Clustered Sparse Voxel Octrees—A Hierarchical Data Structure for Geometry Representation of Voxelized 3D Scenes
When representing the geometry of voxelized three-dimensional scenes (especially if they have been voxelized to high resolutions) in a naive—uncompressed—form, one may end up using vast amounts of data. These can easily attack the available memory capacity of the graphics card, the operating memory or even secondary storage of computer. A viable solution to this problem is to use domain-specific hierarchical data structures, based on octant trees or directed acyclic graphs, which, among other advantages, provide a compact binary representation that can thus be considered to be their compressed encoding. These data structures include—inter alia—sparse voxel octrees, sparse voxel directed acyclic graphs and symmetry-aware sparse voxel directed acyclic graphs. The paper deals with the proposal of a new domain-specific hierarchical data structure: the clustered sparse voxel octrees. It is designed to represent the geometry of voxelized three-dimensional scenes and can be constructed using the out-of-core algorithm proposed in the paper. The advantage of the presented data structure is in its compact binary representation, achieved by omitting a significant number of pointers to child nodes (82.55% in case of Angel Lucy model in 1283 voxels resolution) and by using a wider range of child node pointer lengths, including 8b, 16b and 32b. We achieved from 6.57 to 6.82 times more compact encoding, compared to sparse voxel octrees, whose all node components were 32b aligned, and from 4.11 to 4.27 times more compact encoding, when not all node components were 32b aligned.
Read moreHierarchical Data Structures in Adventure Education and Therapy
Hierarchical linear modeling (HLM) is an approach used in data analysis to better understand how program outcomes are affected by the “nested” nature of data collected in many studies. An outcome can be considered variables such as an individual's self-efficacy, social skills, or more targeted outcomes such as demonstrated reading and mathematical skills. Recent research has suggested that individuals within each “nested structure” may exhibit more similar outcomes than another similar research setting. The purpose of this article is to provide examples of nested data structures and illustrate common approaches to dealing with this type of data often found in adventure education and therapy research. Data available from a study on the wilderness treatment outcomes are then analyzed using HLM to illustrate how the process can increase interpretation of findings and inform future research. Results suggest that many of the variables of interest in research on adventure education and therapy, which might explain why outcomes vary for participants, may be missing from research designs due to nested data structures. Future researchers should consider HLM approaches that may be appropriate for nested data structures common in studies on adventure education and therapy.
Read moreThe determinants of individual health care expenditures in the Italian region of Friuli Venezia Giulia: evidence from a hierarchical spatial model estimation
This work investigates the determinants of health care expenditures, such as drug prescriptions, inpatient care, and outpatient care, of the resident population of the Region of Friuli Venezia Giulia (Italy). The phenomenon of interest is examined here by considering a cross-sectional register-based dataset on individual expenditures exhibiting a cross-classified hierarchical structure. In fact, patients (about 1,000,000) are grouped by general practitioners and municipalities. Does the evidence in individual data analyses support the results of the micro- and macroeconomic literature? The adoption of disaggregated data allows us to disentangle the role of the micro- and macroeconomic determinants of the expenditures. Moreover, the degree of interdependence between neighbouring municipalities is measured by accounting for the spatial correlation in the error convolution. A feasible two-stage Heckit method has to be adapted to encompass the zero-inflation issue, to consider the hierarchical structure of data and to study the spatial diffusion process of the expenditures in the sample selection model framework. The main results on the determinants of health care expenditures at the macro-level are confirmed in our analysis on disaggregated data. On the contrary, however, the substitution effect, which is typically observed in aggregated data, has not been confirmed by the present research. Moreover, the selection process appears to be relevant in drug prescriptions and outpatient care expenditures and a significant spatial correlation in both the selection and the outcome equations emerges from the structure of error components.
Read moreUnsupervised Multi-task Learning with Hierarchical Data Structure
Unsupervised Multi-task Learning with Hierarchical Data Structure
Video-Based Hierarchical Species Classification for Longline Fishing Monitoring
The goal of electronic monitoring (EM) of longline fishing is to monitor the fish catching activities on fishing vessels, either for the regulatory compliance or catch counting. Hierarchical classification based on videos allows for inexpensive and efficient fish species identification of catches from longline fishing, where fishes are under severe deformation and self-occlusion during the catching process. More importantly, the flexibility of hierarchical classification mitigates the laborious efforts of human reviews by providing confidence scores in different hierarchical levels. Some related works either use cascaded models for hierarchical classification or make predictions per image or predict one overlapping hierarchical data structure of the dataset in advance. However, with a known non-overlapping hierarchical data structure provided by fisheries scientists, our method enforces the hierarchical data structure and introduces an efficient training and inference strategy for video-based fisheries data. Our experiments show that the proposed method outperforms the classic flat classification system significantly and our ablation study justifies our contributions in CNN model design, training strategy, and the video-based inference schemes for the hierarchical fish species classification task.
Read moreWind tunnel tests around bluff-bodies of circular base to optimize space grid envelope structures for high- rise steel buildings
The growing interest in the use of steel space grids as structural envelope elements for tall buildings leads structural concept to gain relevance in the design and aesthetics of the building. Therefore, to speak of a sensible architectural solution thereof, it is necessary the existence of a direct relationship between both concepts; architectural design and structural analysis. Given the current situation, it is necessary to develop a methodology to work and to analyze through a proper structural approach that allows solving the common problems that usually arise in the design and analysis of these structures. It is therefore necessary to address design issues as to produce a more optimal and efficient structural geometry, while providing a response to formal questions of the building. The overall aim is to project, understanding the structure as the core, steel space grid envelope structures for tall buildings to obtain resistant forms which are more optimal and efficient. In this line, it is essential to analyze the trajectory of the isostatic lines according to the loads acting on the buildings so as to obtain their simplified structural geometries. The efficiency of these geometries is compared with the basic or initial geometries (traditional standard), to determine which are most optimal. The purpose of this paper is to present an initial study line of the optimization of steel space grid envelope structures for tall buildings of circular base. Given the characteristics of this type of geometry or “bluff-bodies” (not aerodynamic) wind tunnel studies are necessary to determine the forces and moments produced by the influence of wind turbulent flow, for large numbers of Reynolds, which are typical of the tall buildings proposed. In this work we develop wind tunnel tests for three different models, scale 1/400, of tall buildings of circular base to determine the influence of the wind flow around these buildings. Once the tests are conducted the structural models are analyzed in order to compare the results with their initial geometries. The first analysis results obtained from tall buildings of circular base show that the geometries obtained using the design methodology proposed offer an improved structural performance and therefore greater efficiency, in comparison with the basic geometries, or initials.
Read moreSpatio-temporal Map Generalizations with the Hierarchical Voronoi Data Structure
Map generalization leads to simplified maps that are needed for specific applications. However, in the map generalization process [18], the processing of the map objects and the operations applied to achieve this simplified map are usually lost. This is due to the transaction processing systems implemented in commercial GIS systems. In this research, we used the Voronoi spatial data model for map generalizations. We were able to demonstrate that the map generalization does not affect only spatial objects (points, lines or polygons), but also the events corresponding to the creation and modification of map objects, together with their temporal and spatial adjacency relationships. In this paper, we present new solutions to the problems of spatio-temporal generalizations using the hierarchical Voronoi spatio-temporal data structure. The application of the hierarchical Voronoi data structure presented in this research is in spatio-temporal map generalization, which is needed for reasoning about dynamic aspects of the world, primarily about actions, events and processes. This provides an advance in the domain of map generalization as we are able to deal not only with the cartographic objects, but also their spatio-temporal characteristics and their dynamic behaviour.
Read moreReptile: Aggregation-level Explanations for Hierarchical Data
Recent query explanation systems help users understand anomalies in aggregation results by proposing predicates that describe input records that, if deleted, would resolve the anomalies. However, it can be difficult for users to understand how a predicate was chosen, and these approaches are limited to errors that can be resolved through deletion. In contrast, data errors may be due to group-wise errors, such as missing records or systematic value errors. This paper presents Reptile, an explanation system for hierarchical data. Given an anomalous aggregate query result, Reptile recommends the next drill-down attribute,and ranks the drill-down groups based on the extent repairing the group's statistics to its expected values resolves the anomaly. Reptile efficiently trains a multi-level model that leverages the data's hierarchy to estimate the expected values, and uses a factorised representation of the feature matrix to remove redundancies due to the data's hierarchical structure. We further extend model training to support factorised data, and develop a suite of optimizations that leverage the data's hierarchical structure. Reptile reduces end-to-end runtimes by more than 6 times compared to a Matlab-based implementation, correctly identifies 21/30 data errors in John Hopkin's COVID-19 data, and correctly resolves 20/22 complaints in a user study using data and researchers from Columbia University's Financial Instruments Sector Team.
Read moreEnabling In Situ Pre- and Post-processing for Exascale Hemodynamic Simulations - A Co-design Study with the Sparse Geometry Lattice-Boltzmann Code HemeLB
Today's fluid simulations deal with complex geometries and numerical data on an extreme scale. As computation approaches the exascale, it will no longer be possible to write and store the full-sized data set. In situ data analysis and scientific visualisation provide feasible solutions to the analysis of complex large scaled CFD simulations. To bring pre- and postprocessing to the exascale we must consider modifications to data structure and memory layout, and address latency and error resiliency. In this respect, a particular challenge is the exascale data processing for the sparse geometry lattice-Boltzmann code HemeLB, intended for hemodynamic simulations. In this paper, we assess the needs and challenges of HemeLB users and sketch a co-design infrastructure and system architecture for pre- and post-processing the simulation data. To enable in situ data visualisation and analysis during a running simulation, post-processing needs to work on a reduced subset of the original data. Particular choices of data structure and visualisation techniques need to be co-designed with the application scientists in order to achieve efficient and interactive data processing and analysis. In this work, we focus on the hierarchical data structure and suitable visualisation techniques which provide possible solutions to interactive in situ data processing at exascale. Architectural challenges and road-maps will be presented as the major focus of this paper. We sketch a software architecture which integrates pre- and post-processing techniques that can provide in situ analysis and ultimately computational steering to HemeLB.
Read moreA new rock slicing method based on linear programming
One of the important pre-processing stages in the analysis of jointed rock masses is the identification of rock blocks from discontinuities in the field. In 3D, the identification of polyhedral blocks usually involve tedious housekeeping algorithms, because one needs to establish their vertices, edges and faces, together with a hierarchical data structure: edges by pairs of vertices, faces by bounding edges, polyhedron by bounding faces.In this paper, we present a novel rock slicing method, based on the subdivision approach and linear programming optimisation, which requires only a single level of data structure rather than the current 2 or 3 levels presented in the literature. This method exploits the novel mathematical framework for contact detection introduced in Boon et al. (2012). In the proposed method, it is not necessary to calculate the intersections between a discontinuity and the block faces, because information on the block vertices and edges is not needed. The use of a simpler data structure presents obvious advantages in terms of code development, robustness and ease of maintenance. Non-persistent joints are also introduced in a novel way within the framework of linear programming. Advantages and disadvantages of the proposed modelling of non-persistent joints are discussed in this paper. Concave blocks are generated using established methods in the sequential subdivision approach, i.e. through fictitious joints.
Read more