- Research Article
7
- 10.1002/cpe.4517
Cloud computing and big data: Technologies and applications
- May 20, 2018
- Concurrency and Computation: Practice and Experience
- Mostapha Zbakh + 3 more +3
Cloud computing and big data: Technologies and applications
In the past, data processing was completed on a computer or a server. This is because the resources available at that time were limited. However, with the progress of technology, it is possible to use multiple computers and servers to process large amounts of data. This is where cloud computing comes into play. Cloud computing allows users to access data from anywhere at any time using an Internet connection. It also reduces the cost of enterprises because they do not have to buy additional hardware or software for each user. Aiming at the problems of single scale of traditional computer data processing and poor degree of adaptive parallel computing, this paper proposes a multi-source information accelerated data processing method of cloud computing technology, analyzes the application of cloud computing technology in computer data processing, and adopts the dynamic optimization technology of cloud computing speed to build a dynamic adjustment model of multi-source information data flow application of cloud computing, so as to reduce the energy cost of cloud computing, Combined with the experience of data processing users, the model can support multi-user computing entity sharing in the cloud to improve the running efficiency of data flow applications and reduce the energy cost of computer data processing. This article first outlines the basic meaning of cloud computing technology, starting with providing conditions for data transmission and sharing, and highlighting the application value of cloud computing technology. It analyzes the trend of cloud computing technology, and combines the modeling of cloud computing technology in computer data processing to propose application countermeasures for cloud computing technology in computer data processing.
Cloud computing and big data: Technologies and applications
Cloud computing and big data: Technologies and applications
Advantages of Big Data Analysis and AI Technology in Data Collecting And Processing of Preventive Maintenance
In recent years, the emergence of Cyber-Physical systems (CPS), big data, cloud computing, and industrial wireless networks have promoted the development of Industry 4.0. Intelligent manufacturing systems are the leaders of this change. In smart manufacturing, the emphasis will be placed on using technologies such as big data analytics, cloud computing, edge computing, and artificial intelligence (AI). The advantages of new technologies are significantly reflected in the comparison of preventive maintenance and traditional maintenance based on intelligent technology: preventive maintenance significantly reduces the cost of prevention and, at the same time, dramatically improves the accuracy and timeliness of maintenance, bringing inestimable value to intelligent manufacturing. This paper will analyze new technologies’ innovative advantages and technical prospects through big data analysis and specific application scenarios of AI technology in preventive maintenance. Firstly, in data acquisition, this paper examines the architecture of preventive maintenance systems based on big data. Then, it analyzes the composition of the data pipeline: in the realization of data collection and processing in the field of cloud computing and edge computing, and the aspect of data processing, it discusses the participation of AI technology in data understanding and processing and the unprecedented changes it brings.
Read moreA Computing System for Processing the Interstate Power Grid Data
The paper presents a Data Processing and Geo-information Computing System (DPGICS) intended to study and forecast the expansion of interstate power grids. We propose an original technology for data storage in an object-oriented database, and a technology for data processing and representation using user-friendly interface. An example is given to demonstrate the DPGICS applied to visualize energy data on maps, and to form aggregated tables with the results obtained using the ORIRES optimization model being part of DPGICS. Index Terms: geo-information system, optimization model, data processing, object database, power plant, power system, interstate power interconnection.
Read moreSelecting a suitable Cloud Computing technology deployment model for an academic institute
Purpose– Cloud Computing (CC) technology is getting implemented rapidly in the educational sector to improve learning, research and other administrative process. As evident from the literature review, most of these implementations are happening in the western countries such as USA, UK, while the level of implementation of CC in developing countries such as India is rare. Moreover, implementing CC technology in the educational sector require various decisions to be made by the managers of the Information Technology (IT) department such as selecting suitable deployment model, vendor providing cloud service, etc. in their respective university or institute. The purpose of this paper is to attempt to address one such decision. Since, different types of CC deployment are available; selecting a suitable one plays a key role, as it might have an impact on the requirements of various stakeholders such as students, teachers, administrative staff (especially the staff members in the IT department), etc. apart from affecting the overall performance of the facilities such as a laboratory. Naturally, a proper decision by analysing multiple perspectives has to be made while carrying out such strategic initiatives by any educational institute.Design/methodology/approach– A case study methodology has been chosen as the research methodology to discuss and demonstrate the above decision problem that was faced in real time by one of the educational institutes in India, offering high-quality management education. The IT managers of this institute were planning to switch over to CC technology for the computer laboratory and they have to make a decision of choosing suitable alternative CC deployment models such as private cloud (PRC), public cloud (PUC), community cloud (COC), hybrid cloud (HYC), etc. by analysing and comparing them based on various factors and perspectives such as elasticity, availability, scalability, etc. Since, multiple factors are involved in making such a strategic decision, the most commonly used Multi-Criteria Decision Making (MCDM) model – namely, the Analytic Hierarchy Process (AHP) is used as a decision support during the decision making process.Findings– The team of decision makers, who were planning to implement CC in the case institute, found that PRC is best as they believed that it would provide adequate cost savings, apart from providing necessary security to maintain confidential information such as student's detail, grades, etc.Research limitations/implications– The results obtained are based on a single case study. Hence, they cannot be generalized for institutions across educational sector. However, the decision making situation and understanding its impact on the stakeholders of the educational institute can be common across various educational institute.Practical implications– Using a real-life case study of an educational institute, this paper presented a strategic decision making situation, which needs to be considered by the IT managers of the educational institutes when they decide to switch over to CC technology. Various criteria to be considered during the decision making process was identified from the literature review were identified and enumerated. These factors would useful for the IT managers of the different educational institute and they can suitably add or delete these decision criteria as per their requirements and situation at hand. Moreover, the algorithm of AHP, which was used as a decision support, was presented in a step-by-step manner, which should be beneficial for the practitioners to apply the same for similar decision making situations.Originality/value– It is believed that this paper would be the first to report on a strategic decision of choosing the deployment model for CC technology especially in the educational sector. Similarly, this paper would also contribute to the field of CC, as it lists out the decision criteria that are to be considered for making the above decision, which has not got adequate importance. Lastly, this paper is also unique in the realm of AHP because application for a decision problem in the field of CC especially in the educational sector is least reported.
Read moreDesign of Distributed Network Mass Data Processing System based on Cloud Computing Technology
Due to the rapid increase in the amount of data that people need to deal with computing tasks, such as distributed computing, cloud computing and other technologies are more and more concerned by most people. In recent years, with people's attention to information security and personal privacy protection, cloud computing security has gradually become the focus of researchers. In the cloud computing environment, massive distributed data storage and management and data centralization autonomy can control the data mechanism, and distribute management of redundant data and transaction processing. These management and application are generally through the distributed database for actual operation, from the user's point of view, the access process to the distributed database is transparent. In fact, from the user's point of view, a single distributed database is essentially a combination of a group of databases stored on multiple computers. This paper studies the distributed data processing system based on cloud computing technology.
Read moreModelling Cities as a Collection of TeraSystems – Computational Challenges in Multi-Agent Approach
Modelling Cities as a Collection of TeraSystems – Computational Challenges in Multi-Agent Approach
Design of Cross-Source Education Information Classification Model Based on Cloud Computing Technology
Traditional classification algorithms can be well applied to limited data sets, but the application effect of uncertain data sets was poor. Therefore, this paper proposed a cross-source education information classification model based on cloud computing technology, which aimed to provide support for education information services in the cloud computing environment. Firstly, based on the analysis of the structure and function of the cloud computing platform, this paper expounded the cloud computing service mode and its deployment mode and gave a multisource information processing method based on the cloud computing center combined with the characteristics of information distribution in the cloud computing environment. Secondly, by analyzing the types of educational information resources, this paper summarized the feature extraction of educational information using data mining technology and gave the classification method of educational information based on text features. Finally, a cross-source education information classification model in the cloud computing environment was designed. The experimental comparison showed that the method proposed in this paper can effectively classify the multisource education information under the cloud computing platform. Compared with other traditional classification models, this model not only had higher classification accuracy but also can achieve better classification efficiency. The classification model proposed in this paper can provide a reference for the classification of other information resources in the cloud computing environment.
Read moreA Systematic Review of Blockchain, AI, and Cloud Integration for Secure Digital Ecosystems
The convergence of blockchain, artificial intelligence (AI), and cloud computing is catalyzing a paradigm shift in developing secure, intelligent, and scalable digital infrastructures. This triad of technologies is increasingly utilized to improve performance, transparency, and trust in engineering-driven and socio-technical environments. This study systematically reviews the evolution, integration strategies, and applications of blockchain, AI, and cloud computing in digital ecosystems. The analysis is based on 108 peer-reviewed studies spanning the years 2012 to 2025. A comprehensive literature analysis was conducted to identify trends, synergies, and sector-specific implementations of these systems. The review explores how their integration supports real-world engineering and operational use cases. Blockchain contributes to decentralized architectures, secure data exchange, and identity verification. AI supports adaptive behavior, autonomous decision-making, and predictive analytics. Cloud computing offers the scalable infrastructure necessary for deployment. Key challenges addressed include interoperability, latency, security trade-offs, and resource allocation. Use cases in digital finance, supply chain management, and industrial automation demonstrate the effectiveness of this integration in building resilient, ethically aligned, and high-performance infrastructures. The findings offer valuable insights and technical considerations for engineers and architects seeking to design next-generation cyber-physical systems that are secure, intelligent, and socially responsive. Clinical Trial Number Not applicable. This article accentuates the extensive use of blockchain, cloud computing, and AI principles, emphasizing their crucial significance in the contemporary digital environment and paths in which blockchain technology may be employed to automate financial transactions, enhance the security of personal data and records, facilitate cross-border transactions, verify identities, execute smart contracts, utilize cryptocurrencies, and manage supply chains. This research systematically assesses the development and practical application of blockchain, cloud computing, and artificial intelligence technologies over the past decade. This study primarily focuses on monitoring the progress, practical applications, and benefits of blockchain technology in the context of financial transactions. This article probes the symbiotic relationship between artificial intelligence, cloud and blockchain technology, analyzing the evolution and fundamental concepts of their integration from 2012 to 2025. This paper also presents a detailed analysis of 108 research works acquitted over the past decade. The study provides a comprehensive examination of the current state and fundamental principles related to the integration of artificial intelligence, cloud, and blockchain technology. This paper offers a comprehensive analysis of the major obstacles confronted by blockchain technology, examining its wide-ranging applications over several industries and its socko role in transaction systems and the domain of cryptocurrencies.
Read moreIntelligent Technologies and Methods of Tundra Vegetation Properties Detection Using Satellite Multispectral Imagery
The aim of the study is to develop a script and intelligent technology for collection and processing of heterogeneous data of field measurements and multispectral space imagery in order to identify and assess the state of natural objects. The core principle of the method is adaptive modeling and adjustment of an identification and evaluation technology of the properties of natural objects based on processing of multispectral space imagery, a geobotanical description and field measurements. As an example, we consider the problem of identification and evaluation of tundra vegetation using imagery from Sentinel-2 or Resource-P satellites. The results of the identification and assessment of the state of tundra vegetation are presented by a part of a vegetation map matching territories suitable for grazing deer in different seasons. The identification and assessment are focused on plant community types and possibility to feed reindeer in different seasons of the year. The testing results demonstrate effectiveness of the proposed technology for collection and processing of heterogeneous data.
Read moreSemantic Technologies and Cloud Computing
Cloud computing has become a generic umbrella term for the flexible delivery of IT resources—such as storage, computing power, software development platforms, and applications—as services over the Internet. The foremost innovation is that the IT infrastructure no longer lies with the user, breaking up the previously monolithic ownership and administrative control of its assets. The combination of cloud computing and semantic technologies holds great potential. In this chapter, we analyze three ways in which cloud computing and semantic technologies can be combined: (1) building on cloud computing technologies, e.g. from the area of distributed computing, to realize better semantic applications and enable semantic technologies to scale to ever larger data sets, (2) delivering semantic technologies as services in the cloud, and (3) using semantic technologies to improve cloud computing, in particular to further improve automatic data-center management. For each of these dimensions we identify challenges and opportunities, provide a survey, and present a research roadmap.
Read moreDesign of Big Data Processing System Architecture Based on Hadoop under the Cloud Computing
In allusion to limitations of traditional data processing technology in big data processing, big data processing system architecture based on hadoop is designed, using the characteristics of quantification, unstructured and dynamic of cloud computing.It uses HDFS be responsible for big data storage, and uses MapReduce be responsible for big data calculation and uses Hbase as unstructured data storage database, at the same time a system of storage and cloud computing security model are designed, in order to implement efficient storage, management, and retrieval of data,thus it can save construction cost, and guarantee system stability, reliability and security.
Read moreApplication Research of Cloud Computing in the Smart Grid Information Processing
With the rapid development of national economy, our demand for power resources has also increased rapidly. The traditional power grid can not be achieved operational status of equipment for effective monitoring and control, we will not be able to ensure the quality and quality of electricity service. Cloudbased build smart grid information platform enables gathering the parameter of grid operation state, greatly increasing the economic efficiency of power enterprises. Firstly, cloud computing and smart grid briefly described, and then pointed out that cloud computing applications in the smart grid information platform, and specialized of cloud-based smart grid information platform, in order for the power grid enterprises to enhance their level of service and provide effective reference. KEYWORD: cloud computing; smart power grids; information platform; Application 4th International Conference on Mechanical Materials and Manufacturing Engineering (MMME 2016) © 2016. The authors Published by Atlantis Press 202 3 THE MAIN PROBLEM IS STILL THE SMART GRID INFORMATION PLATFORM FACING The transition to a cloud computing data center. Our data center because of the different regions and the degree of information presents different characteristics, some data centers already have a basic cloud computing capabilities, but most data centers still remain in the initial level, to ensure the normal operation of the existing data center power under the premise, gradual transition to cloud computing data center in order to meet future requirements of the development of smart grid. Restricting data transmission problem. State Grid Corporation between provincial branches and there are a lot of data needs to be transmitted, will bring massive data transmission efficiency decreases, taking into account the load balancing device between the cloud node, thus building a wide area network channels to resolve data transmission problem. Security of data transmission. Data Center for Cloud Computing power companies to build internal private cloud, capable of self-maintenance and management, system wide area network data transmission services, according to the third security zone defined security partition, and install proprietary equipment production area and external public network isolation . 4 CLOUD COMPUTING APPLICATIONS IN THE SMART GRID INFORMATION POLICY PLATFORM Integrate and optimize the management of heterogeneous resources. Among the smart grid systems, data resources, information systems between various platforms and mutually dispersed, severe heterogeneity, thus leading to the integration of the quality of information sharing to increase difficulty, unable to effectively improve network management efficiency for the power distribution system electrical work quality management and marketing operations system maintenance upgrade will not be able to effectively meet demand (Jie Yang, 2014). Cloud computing technology enables the power system to effectively integrate the various business data and computing resources on the basis of information for business collaboration platform built on effective, able to satisfy the huge demand for smart grid information resource sharing. Cloud computing network virtualization and application virtualization technology, the server virtualization technology and other resources to achieve each service abstraction, and then realize the difference between the system and the software effectively eliminated by the appropriate method to achieve the effective integration of information resources, and then to optimize the management, greatly improving the efficiency of heterogeneous resources management applications. Distributed storage and management of large volume of data. After application of smart grid information platform construction, customer service requests varied, huge data volume information brought it to the storage and management of data provides a great challenge. Cloud computing technology in general face amount of data each smart grid system and unit collected using forms distributed storage of data to achieve the effective storage, greatly to ensure the security and reliability of data storage. GFS effective use of technology with each node, the master server is responsible for the effective management of the whole file system, the file system and complete the work of the metadata stored in the data block is the main server for data storage block sliced, and by saving three or more redundant backup storage. At the same time, client access and complete access to the main block server information. Fast Power System Parallel Computation and Treatment. Smart grids and information platform for the large volume of data to provide stable operation of the power grid data base, but more critical is the analysis and design of each system operating data, planning and decision-making, and even failures and transient stability, state estimation and intelligent a variety of computing and content analysis and decision-making process, its huge computing needs, general computing system can not reach its goal (Wang, Mengxue, 2015). Cloud computing technology through parallel computing technology has greatly enhanced parallel processing capability of the power system, which provides parallel programming model makes more simple and efficient parallel algorithms. MapReduce as Google made an important parallel programming model, and its role in large data sets in parallel computing plays a very prominent. Parallel processing job results by the client to achieve effective user submitted, via decomposition automated master role, the corresponding task scheduling to working nodes and nodes work completed by the specific calculations and perform the appropriate task. 5 SMART GRID INFORMATION PLATFORM CLOUD COMPUTING ANALYSIS Cloud Computing Smart Grid Information Platform Architecture. Smart grid technology information platform architecture cloud computing include the following several levels and aspects (Yan Cui, 2015): First, that the platform infrastructure layer is the integration of the various hardware resources and related management capabilities of virtualized using virtual technology to achieve the corresponding hardware devices such as computers and network storage devices abstraction, and then complete the automation and optimization of resource data and load management; secondly, the main platform for the integration of the various layers of software
Read moreResearch on building an innovative electric power marketing business application system based on cloud computing and microservices architecture technologies
The paper proposes the method of building the electric power marketing business application system based on the cloud computing and microservices architecture technologies to solve the issues of the current system with the concentrated infrastructure and the monolithic architecture which are difficult to support the business processing in very large scale and the evolution of the electric power marketing business. The paper first introduces the current electric power marketing business application system and highlights its main drawbacks. Then it proposes the method to build the innovative electric power marketing business application system with the main technical characteristics as follows: the IaaS part of the application system has the distributed infrastructures with the IT resource elastic management and powerful horizontal scalability brought by the cloud computing technology; its PaaS part is the service platform with the components of the data processing, information integration, application building, and cloud service center to provide the several cloud services, such as one-click deployment, flexible scaling, fault self-healing, gray distribution, full-link monitoring and other cloud service capabilities; and its SaaS part has the microservices architecture with the features of servitization, componentization, decentralization, independent deployment etc. Finally, the suggestions are given to design the microservices for the electric power marketing business application.
Read moreData Processing System Based on Computer
With the popularization of computer and Internet, software technology, signal processing technology and real-time processing technology have been applied to all aspects of life, which has caused a surge of data. Therefore, big data (hereinafter referred to as BD) has become the focus of attention all over the world, which requires improving data application and processing technology. Through BD, countries can obtain corresponding knowledge, which will improve the software and comprehensive application of BD. With the in-depth study of deep learning algorithm, we can continuously improve the application of BD, which is a Data Processing (hereinafter referred to as DP) method with high precision, fast speed, flexible use and strong scalability. Through the DP system, we can realize the post demodulation and processing of signals in various equipment, which can achieve the state of data availability. In many ways, we can obtain the required knowledge through the DP system, which will improve the processing ability of the computer. Firstly, this paper puts forward the challenges faced by BD. Then, this paper analyzes the algorithms in DP. Finally, this paper designs a DP system.
Read moreInformation Technologies for Data Processing to Analyze Labor Market Indicators by the Russian Federation Regions
The article is devoted to the study and classification of information technologies for statistical data processing being applied to labor market analysis. The methods that contribute to understanding the employment structure and other aspects of the labor market in the Russian Federation are considered. The emphasis is placed on the use of descriptive statistics, clusterization and geo-analytics of labor market indicators in the context of the regions of the Russian Federation. The result of the research is the analysis of the labor market characteristics of the regions, statistical and correlation data analysis, clustering of the Russian Federation regions according to labor market indicators, as well as the creation of an interactive map based on the employment level. The clustering identified groups of regions with similar labor market indicators in terms of employment and unemployment, labor force level, the ratio of per capita monetary incomes of the population to their national average, the ratio of average monthly wages to the subsistence minimum, the ratio of the specific gross regional product in the subject to its national average, as well as the structure of the employed population in the main types of economic activity. It was found that in 2023, 4 clusters are being formed in the Russian labor market with regions whose indicators within each cluster have similar values. The first cluster includes 22 regions of the Russian Federation with low employment (55.4%) and high unemployment (7.2%) of the population. The second cluster includes 3 regions and is characterized by a high employment rate (73.1%), a high share of labor force participation (75.4%), and the highest ratio of per capita monetary incomes of the population to their average value in the Russian Federation (281.8%). A significant part of the population in these regions is engaged in mining (23.4%). The third cluster includes 9 regions of the Russian Federation with higher employment rates (66.1%) and labor force participation (68.0%) compared to the average in the Russian Federation, as well as the lowest unemployment rate among the clusters. The fourth cluster is the most extensive: it includes the remaining 53 subjects of the RussianFederation. It can be characterized by low values of the considered indicators. The regions of this cluster also have the lowest unemployment rate (2.8%).
Read more