• Home
  • Search
  • ADVANCED TECHNOLOGIES OF BIG DATA RESEARCH IN DISTRIBUTED INFORMATION SYSTEMS
  • Cite Icon10
  • https://doi.org/10.15588/1607-3274-2017-4-8Copy DOI Icon

ADVANCED TECHNOLOGIES OF BIG DATA RESEARCH IN DISTRIBUTED INFORMATION SYSTEMS

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Context. Considered question correct interpretation information flow in distributed information systems. The object of study methods are promotion “big data” on cluster system.Objective. Is the study promising areas and technology for the analysis of structures data in distributed information systems.Method. The big data tendency prospects as well as timeliness of the problem are studied in this paper. The principles of work with them are addressed. Big data processing technologies are provided. The analysis of each one is performed. An example of “MapReduce” paradigm application, uploading of big volumes of data, processing and analyzing of unstructured information and its distribution into the clustered database is provided. The article summarizes the concept of “big data”. Examples of methods for working with arrays of unstructured data. Dedicated scientific guidance for analyzing big data. The principles of unstructured data in distributed information systems. Driven work platform “Hadoop MapReduce” and “Apache Spark”. Analyzed their properties and given the differences. An analysis of comparative performance against both platforms – the performance of the number of iterations. Consider ways to create RDD: parallelization transmitted collection program and a link to an external file system in “Hadoop”. There is an example rozparalelenoyi system RDD. Proposed work lone class for basic database operations: database connection, create a table, a table, get in line id, returning all elements of the database, update, delete and create the line.Results. The analysis Models Spark and Hadoop MapReduce for phased construction distributed information system. built up SparkConf object, containing information about applique and is the final version of the experiment.Conclusions. Conducted experiment confirmed efficiency the proposed method, are capable process horizontal data arrays, that parallelization by defective presentation of information. These promising areas of analyze structure data for the purpose of forecast results and create algorithms advanced correlation, contributing new understanding activity distributed information systems further research can consist in wide use information systems, that would provide a full range technological process adaptation information flows in clusters.

Similar Papers
  • Conference Article
  • Citations20

Fuzzy Based Clustering Algorithms to Handle Big Data with Implementation on Apache Spark

  • Mar 01, 2016
  • Neha Bharill +2
  • PDF
  • Research Article
  • Citations3

Legal Governance of Brain Data Derived from Artificial Intelligence

  • Jun 02, 2021
  • Voices in Bioethics
  • Mahika Ahluwalia
  • Research Article
  • Citations7

Cloud computing and big data: Technologies and applications

  • May 20, 2018
  • Concurrency and Computation: Practice and Experience
  • Mostapha Zbakh +3
  • Research Article
  • Citations14

Performance evaluation of Map-reduce jar pig hive and spark with machine learning using big data

  • Aug 01, 2020
  • International Journal of Electrical and Computer Engineering (IJECE)
  • Santosh Jankatti +3
  • Research Article

Обеспечение основных прав в борьбе с коррупцией с применением больших данных в КНР: основные законы, риски и пути

  • Dec 21, 2020
  • Actual Problems of Economics and Law
  • Rong Hu
  • Book Chapter

Big Data Processing on Cloud Computing Using Hadoop Mapreduce and Apache Spark

  • Jan 01, 2018
  • Yassir Samadi +2
  • PDF
  • Research Article
  • Citations11

A Maturity Analysis of Big Data Technologies

  • Mar 30, 2017
  • Informatica Economica
  • Radu Boncea +3
  • Research Article
  • Citations3

Большие данные и цифровая экономика

  • Jun 30, 2020
  • System Analysis in Science and Education
  • Sergey Belov +2
  • PDF
  • Research Article
  • Citations4

The problem of analysis of big web data and the use of data mining technology for processing and searching patterns in big web data on a practical example

  • May 14, 2019
  • Open Education
  • K V Mulyukova +1
  • Research Article
  • Citations3

용접 빅데이터 환경에서 상관분석 및 회귀분석을 이용한 작업 패턴 분석 모형에 관한 연구

  • Oct 31, 2014
  • The Journal of the Korea institute of electronic communication sciences
  • Se-Hoon Jung +1
  • Conference Article

Emergency Management System for College Students based on Big Data Processing Technology

  • Oct 23, 2021
  • Software Engineering and Applications
  • Ziyue Wang +2
  • Conference Article
  • Citations2

Dynamic Updating Rough Approximations in Distributed Information Systems

  • Nov 01, 2015
  • Yanyong Huang +3
  • Research Article
  • Citations1

BIG DATA ІНСТРУМЕНТИ ТЕЛЕКОМУНІКАЦІЙНИХ КОМПАНІЙ ДЛЯ ПІДВИЩЕННЯ ЕФЕКТИВНОСТІ ПРИЙНЯТТЯ РІШЕНЬ В СКЛАДНИХ ЕКОНОМІЧНИХ СИСТЕМАХ

  • Jan 01, 2021
  • Market Infrastructure
  • Nataliia Geseleva +1
  • Research Article
  • Citations2

Parallel Computing Data Processing: Frameworks, Implementations, and Case Studies

  • Apr 01, 2025
  • International Journal of Advances in Engineering and Management
  • Prudhvi Naayini Prudhvi Naayini
  • Conference Article
  • Citations11

Operational Reliability Evaluation Method Based on Big Data Technology

  • Oct 01, 2016
  • Lijuan Hu +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.