Integrated data analysis and management for the problem solving environment

IDAMS is a prototype of a general purpose system for interactive data manipulation. The paper analyzes the requirements for an interactive pictorial data base system and shows that the known requirements for pictorial application can best be met by a general purpose system such as IDAMS. Major features of IDAMS are: the powerful high level data manipulation language. the datatypes of APL plus extensions for interactive data analysis. the convenient extensibility of the system by functions written in FORTRAN, PL/I or ASSEMBLY language. the interactive extensibility via APL, both within and in addition to the data manipulation language. the convenient access to special purpose hardware including image processing devices. The ease, with which the general purpose system can be adapted to a pictorial application, is contrasted with the problems and risks introduced by the development of a special purpose data base system for pictorial applications.KeywordsHigh Level LanguageAssembly LanguageCentral InterfaceData Base SystemIntegrate Data AnalysisThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

The current number of mobile Internet users has far exceeded the number of PC Internet users.The construction of college mobile website is behind the PC website.An innovative idea which integrates mobile website and computer website into one system was proposed.Content management technology is used in the system.The system which mobile website and computer website integrates into college online content management system is developed.It allows colleges and universities to build the mobile and computer website at the same time.The construction and management of integration meets the needs of smartphone and computer access.The system would enhance the level of college information. Concept of College Content Management SystemContent Management System has back-office systems or processes between software systems.Content Management System focused on solving a variety of unstructured or semi-structured collection of digital resources.It can be integrated into structured data organic business intelligence environments, such as OA, CRM, etc. Content creators, editors, publishers use content management system to submit, and publish content.The "content" may include all information files, tables, pictures, and data in the database or video.Content Management System is used in college website building software industry establishment.College website content management system can simplify the construction, management and maintenance.The basic idea is to achieve the appearance and content of the separation and management.Content Management System is stored in a database or file system.The appearance of the page is to use a template to achieve.When a user requests a page, the page has a standard HTML page provided to the user.To browse through the use of templates, administrators only need to modify the template and feel of the site adjustment.Managers can focus on content design, and greatly simplify site management and maintenance.

Introduction:Portable handheld computers and electronic data management systems have been used for national surveys in many high-income countries, however their use in developing countries has been challenging due to varying geographical, economic, climatic, political and cultural environments. In order to monitor and measure global adult tobacco use, the World Health Organization and the US Centers for Disease Control and Prevention initiated the Global Adult Tobacco Survey, a nationally representative household survey of adults, 15 years of age or older, using a standard core questionnaire, sample design, and data collection and management procedures. The Survey has been conducted in 14 low- and middle-income countries, using an electronic data collection and management system. This paper describes implementation of the electronic data collection system and associated findings.Methods:The Survey was based on a comprehensive data management protocol, to enable standardized, globally comparable high quality data collection and management. It included adaptation to specific country needs, selection of appropriate handheld hardware devices, use of open source software, and building country capacity and provide technical support.Results:In its first phase, the Global Adult Tobacco Survey was successfully conducted between 2008 and 2010, using an electronic data collection and management system for interviews in 302,800 households in 14 countries. More than 2,644 handheld computers were fielded and over 2,634 fieldworkers, supervisors and monitors were trained to use them. Questionnaires were developed and programmed in 38 languages and scripts. The global hardware failure rate was < 1% and data loss was almost 0%.Conclusion:Electronic data collection and management systems can be used effectively for conducting nationally representative surveys, particularly in low- and middle-income countries, irrespective of geographical, climatic, political and cultural environments, and capacity-building at the country level is an important vehicle for Health System Strengthening.

본 연구에서는 유역 수문자료를 효율적으로 관리할 수 있는 수문자료관리시스템(HDMS)을 개발하였으며 경기도 화성시에 위치한 발안시험유역을 대상으로 시스템의 적용성을 보여주었다. MySQL 5.0을 사용하여 관계형 데이테베이스를 설계하였으며, MS-Visual Basic 6.0을 이용하여 윈도우 기반의 시스템을 개발하였다. HDMS는 자료검색시스템, 자료관리시스템, 자료분석시스템으로 구성되었다. 자료검색시스템과 자료관리시스템은 자료검색, 자료저장, 자료갱신, 자료추출의 기능을 제공하며, 자료분석시스템은 저장된 자료로부터 다양한 수문통계정보를 제공하며, 자료의 정확성 및 품질을 분석하고 평가한다. In this paper, the Hydrologic Data Management System (HDMS) was developed for the efficient management of hydrologic data. The applicability of the system was demonstrated using the hydrologic data of study watershed located in the southwest from Suwon city MySQL 5.0, relational database management system, and MS Visual Basic 6.0 were used for the development of MS windows based HDMS. The primary components of the HDMS are data search system, data management system, and data analysis system. Data search and management systems provide basic functions for the efficient data search, storage, update and export. Data analysis system enables the users to get the further and diverse hydrologic statistical information from the stored data. Furthermore, the accuracy and quality of hydrologic data was analyzed and evaluated through data analysis system.

The application of shotgun sequencing to environmental samples has revealed a new universe of microbial community genomes (metagenomes) involving previously uncultured organisms. Metagenome analysis, which is expected to provide a comprehensive picture of the gene functions and metabolic capacity for microbial communities, needs to be conducted in the context of a comprehensive data management and analysis system. We present in this paper IMG/M, an experimental metagenome data management and analysis system that is based on the Integrated Microbial Genomes (IMG) system. IMG/M provides tools and viewers for analyzing both metagenomes and isolate genomes individually or in a comparative context. IMG/M is available at http://img.jgi.doe.gov/m.

IMG/M is a data management and analysis system for microbial community genomes (metagenomes) hosted at the Department of Energy's (DOE) Joint Genome Institute (JGI). IMG/M consists of metagenome data integrated with isolate microbial genomes from the Integrated Microbial Genomes (IMG) system. IMG/M provides IMG's comparative data analysis tools extended to handle metagenome data, together with metagenome-specific analysis tools. IMG/M is available at http://img.jgi.doe.gov/m

Genetic data are now widely available. There is, however, an apparent lack of concerted effort to produce software systems for statistical analysis of genetic data compared with other fields of statistics. It is often a tremendous task for end-users to tailor them for particular data, especially when genetic data are analysed in conjunction with a large number of covariates. Here, R http://www.r-project.org, a free, flexible and platform-independent environment for statistical modelling and graphics is explored as an integrated system for genetic data analysis. An overview of some packages currently available for analysis of genetic data is given. This is followed by examples of package development and practical applications. With clear advantages in data management, graphics, statistical analysis, programming, internet capability and use of available codes, it is a feasible, although challenging, task to develop it into an integrated platform for genetic analysis; this will require the joint efforts of many researchers.

The development of technology nowadays is so fast, technology has become part of the people's lifestyle. The presence of technology in human life can facilitate and accelerate all activities carried out so as to increase work effectiveness. Including services via smartphones and the internet. This has prompted many companies to develop their network and technological facilities. To be able to continue to develop in this increasingly rapid technological era, a company needs to present a data management system, namely a database system that provides computerized services and facilities. The main principle of a database system is to organize a set of interrelated data, while the main purpose of a database is the ease and speed of retrieving data to solve problems in systems that use a file-based approach. The result of this research is to observe the online disposition system data management.

MongoDB is a NoSQL type of database management system which does not adhere to the commonly used relational database management model. MongoDB is used for horizontal scaling across a large number of servers which may have tens, hundreds or even thousands of servers. This horizontal scaling is performed using sharding. Sharding is a database partitioning technique which partitions large database into smaller parts which are easy to manage and faster to access. There are hundreds of NoSQL databases available in the market. But each NoSQL product is different in terms of features, implementations and behavior. NoSQL and RDBMS solve different set of problems and have different requirements. MongoDB has a powerful query language which extends SQL to JSON enabling developers to take benefit of power of SQL and flexibility of JSON. Along with support for select/from/where type of queries, MongoDB supports aggregation, sorting, joins as well as nested array and collections. To improve query performance, indexes and many more features are also available.

The emerging of Web 2.0 and Web 3.0 technologies allows web users not only authoring and customizing web pages and their content but also integrating the contents of several web sites into one web page. This web integration is called web mashup. There are various End Users Programming development approaches in making mashup such as scripting, dataflow, widget, spreadsheet, and Programming By Demonstration (PBD). Whip design, as a tool lets casual users - those without programming skill - do the mashup easily through Block-Based Programming (BBP) approach. The design of Whip is guided by a number of principles that support this goal; ranging from situational application, user's preference, User's skill level to code sharing. In this paper we expound the philosophy of Whip design and explain how the design of Whip supports those principles.

This article intends to review the underlying concepts and technologies of the Semantic Web and the potential they provide for metadata management covering bibliographic resources. To get closer to a semantic web data space, different libraries are adhering to the initiatives making their traditional Knowledge Organization Systems (KOS) operational on the web through SKOS techniques, as well as releasing bibliographic data under open licenses (open bibliographic data) and publishing it with Linked Data (LD) mechanisms. LD meaningful semantic connections create the Web of Data, a global database representing the first practical step to the Semantic Web. Here interoperable data can be processed independently of application, platform or domain, providing rich retrieval results produced by powerful query languages. From a library perspective, a problem statement is a global promotion within the Library community of understanding and of adoption of Linked Open Data (LOD), of LODe-BD recommendations, as well as releasing bibliographic data as Linked Library Data (LLD). In this way, different bibliographic datasets could become full members of the Semantic Web making interoperable different knowledge datasets of heterogeneous web communities.

We present Open-EASE, a cloud-based knowledge base of robot experience data that can serve as episodic memory, providing a robot with comprehensive information for autonomously learning manipulation tasks. Open-EASE combines both robot and human activity data in a common, semantically annotated knowledge base, including robot poses, object information, environment models, the robot’s intentions and beliefs, as well as information about the actions that have been performed. A powerful query language and inference tools support reasoning about the data and retrieving information based on semantic queries. In this paper, we focus on applications of Open-EASE in the context of autonomous learning.

We present an effective optimization framework for general SQL-like map-reduce queries, which is based on a novel query algebra and uses a small number of higher-order physical operators that are directly implementable on existing map-reduce systems, such as Hadoop. Although our framework is applicable to any SQL-like map-reduce query language, we focus on a powerful query language, called MRQL. Current map-reduce query languages, such as HiveQL and PigLatin, enable users to plug-in custom map-reduce scripts into queries for those jobs that cannot be declaratively coded in the query language, which may result to suboptimal, error-prone, and hard-to-maintain code. In contrast to these languages, MRQL is expressive enough to capture most of these computations in declarative form and at the same time is amenable to optimization. We describe an optimization framework that maps the algebraic forms derived from the MRQL queries to efficient workflows of map-reduce operations that consist of our physical plan operators. We also describe many algebraic optimizations, such as fusing cascading map-reduce jobs into one job and synthesizing a combine function from the reduce function of a map-reduce job. Finally, we report on a prototype system implementation and we show some performance results of evaluating MRQL queries on a small cluster of computers.

Recent years have seen an increased interest in and availability of parallel corpora. Large corpora from international organizations (e.g. European Union, United Nations, European Patent Office), or from multilingual Internet sites (e.g. OpenSubtitles) are now easily available and are used for statistical machine translation but also for online search by different user groups. This paper gives an overview of different usages and different types of search systems. In the past, parallel corpus search systems were based on sentence-aligned corpora. We argue that automatic word alignment allows for major innovations in searching parallel corpora. Some online query systems already employ word alignment for sorting translation variants, but none supports the full query functionality that has been developed for parallel treebanks. We propose to develop such a system for efficiently searching large parallel corpora with a powerful query language.

Anomaly detection is very important for modern network service. Yet it is still a big challenge to conduct effective anomaly detection due to the high rate of service data and the complex correlations among them. Owing to the powerful query language and performance potential, complex event processing (CEP) is very suitable for this situation. In this paper, we present NEPnet, a high-performance and scalable monitoring system, which can process events for anomaly detection of network service in real time. NEPnet is based on CEP and provides a SQL-like language supporting various event correlations. On accepting user-defined queries as input, NEPnet builds a tree-based monitoring net for detailed anomaly detection. Considering the anomaly features of network service, the monitoring net utilizes limit trigger, predicate index and route table for different types of processing nodes in it. Our preliminary experiment results show that NEPnet can effectively detect anomaly of network service, with a high-speed of 100,000 events per second and 3~6 times faster than Esper, a general CEP engine.