LEVERAGING MACHINE LEARNING FOR RESOURCE OPTIMIZATION IN USA DATA CENTERS: A FOCUS ON INCOMPLETE DATA AND BUSINESS DEVELOPMENT

The application of Artificial Intelligence (AI) and Machine Learning (ML) models is increasingly leveraged to automate and optimize Data Centre (DC) operations. However, the interpretability and transparency of these complex models pose critical challenges. Hence, this paper explores the Shapley Additive exPlanations (SHAP) values model explainability method for addressing and enhancing the critical interpretability and transparency challenges of predictive maintenance models. This method computes and assigns Shapley values for each feature, then quantifies and assesses their impact on the model’s output. By quantifying the contribution of each feature, SHAP values can assist DC operators in understanding the underlying reasoning behind the model’s output in order to make proactive decisions. As DC operations are dynamically changing, we additionally investigate how SHAP can capture the temporal behaviors of feature importance in the dynamic DC environment over time. We validate our approach with selected predictive models using an actual dataset from a High-Performance Computing (HPC) DC sourced from the Enea CRESCO6 cluster in Italy. The experimental analyses are formalized using summary, waterfall, force, and dependency explanations. We delve into temporal feature importance analysis to capture the features’ impact on model output over time. The results demonstrate that model explainability can improve model transparency and facilitate collaboration between DC operators and AI systems, which can enhance the operational efficiency and reliability of DCs by providing a quantitative assessment of each feature’s impact on the model’s output.

Reliability, availability, and life-cycle cost (LCC) analysis of combined cooling, heating and power (CCHP) integration to data centers considering electricity and cooling supplies

Our research aims to improve energy efficiency in data centres by combining cloud computing infrastructure with machine learning techniques. We propose that dynamic resource assignment, combined with intelligent optimisation of cooling systems, can reduce power waste and operational costs. Real-time sensor data from various data centre components such as servers, cooling systems, and power distribution units is collected and fed into machine learning models for analysis. In this way, we can create power arrangements that are tailored to the resources and needs of various applications. The experimental results show that energy consumption has been reduced by an average of 30% compared to traditional methods. Furthermore, our machine learning models are quite accurate in predicting cooling system performance. For example, an Artificial Neural Network (ANN) has an accuracy rate of 98.78%. This result demonstrates the efficacy of our approach in promoting energy efficiency and operational performance in data centres: it not only provides a scalable, cost-effective solution to industry energy efficiency challenges, but it also improves day-to-day data centre operations by reducing electrical consumption. Our approach, which is based on dynamic allocation of computational resources and real-time data analysis for optimising cooling systems, not only saves energy but also improves operational efficiency. With energy in mind, we must all work towards a more sustainable and green approach to data centre management. Future research can look into other potential optimisations, as well as issues with scalability and application in real-world data centre environments.

Currently, utilizing virtualization technology in data centers often imposes an increasing burden on the host machine (HM), leading to a decline in VM performance. To address this issue, live virtual migration (LVM) is employed to alleviate the load on the VM. This study introduces a hybrid machine learning model designed to estimate the direct migration of pre-copied migration virtual machines within the data center. The proposed model integrates Markov Decision Process (MDP), genetic algorithm (GA), and random forest (RF) algorithms to forecast the prioritized movement of virtual machines and identify the optimal host machine target. The hybrid models achieve a 99% accuracy rate with quicker training times compared to the previous studies that utilized K-nearest neighbor, decision tree classification, support vector machines, logistic regression, and neural networks. The authors recommend further exploration of a deep learning approach (DL) to address other data center performance issues. This paper outlines promising strategies for enhancing virtual machine migration in data centers. The hybrid models demonstrate high accuracy and faster training times than previous research, indicating the potential for optimizing virtual machine placement and minimizing downtime. The authors emphasize the significance of considering data center performance and propose further investigation. Moreover, it would be beneficial to delve into the practical implementation and dissemination of the proposed model in real-world data centers.

Intrusion detection plays a critical role in safeguarding computer networks from malicious activities and unauthorized access. Traditional machine learning (ML) models have been widely employed for intrusion detection, but their effectiveness can be limited due to the complex and evolving nature of network attacks. An efficient Convolutional Neural Network (CNN) that utilizes one-dimensional convolutions, batch normalization, and max pooling layers is designed to capture the attack patterns in network traffic data. By leveraging the inherent feature extraction capabilities of CNNs, the proposed architecture demonstrates improved performance in identifying network intrusions compared to traditional ML models. The effectiveness of the novel CNN architecture is evaluated by conducted comprehensive experiments on two benchmark intrusion detection datasets. The designed CNN performance was compared with four other ML models such as logistic regression, k-nearest neighbors, decision trees, and random forest. The experimental results revealed that the proposed CNN architecture outperformed the traditional ML models with highest accuracy of 97.68% and 97.39% and highest F1-score of 97.68% and 97.40% for. UNSW-NB15 and CICIDS2017 datasets, respectively. The proposed CNN architecture serves as a promising alternative to traditional ML models, offering improved performance in identifying and mitigating network attacks.

Energy management and reduction is one of the major challenges in the Cloud industry's data centres. The Uptime Institute's 2012 report, the industry's leading authority, highlighted the crisis in data centre energy management. 30% of data centres will run out of power, space and cooling in 2012. On average there's a 90% energy overhead in data centre operations, yet 55% of servers use less than 10% of their capacity. The 500,000 data centres worldwide have a server electricity consumption of 400 Billion kWh/year (approx $40 Billion ) which is growing at 12% CAGR, yet only 11% of the centres monitor their consumption. The global CO2 emissions of these centres, is equivalent to the airline industry, 2% of global emissions. It is expected that by 2020 20% of Europe's electrical energy will be data centre related. Data centre cooling requirements also have an enormous hydro footprint. A 1 MW data centre in a U.S-type climate has an annual hydro footprint of 99 million litres/annum Yet studies have shown that operational energy savings of 40% and substantial reductions in physical space, cooling requirements and water consumption can be achieved, where comprehensive and effective energy monitoring and management systems are employed. These can deliver a ROI within months, and further savings which extend over the centre's lifetime. The technologies which have the potential to deliver these benefits, DCIM (Data Centre Infrastructure Management) systems have only emerged in the last 3 to 4 years and are still in their infancy. Not surprisingly, a new global industry providing innovative, green, sustainable data centre technologies will be worth €45 Billion by 2016. The main barriers to effective monitoring/management is instrumentation and training. Vast volumes of data are gathered and must be competently analysed. Most monitoring systems, involve some form of physical metering and cabling and downtime, a major challenge when 10's thousands of servers are involved. Furthermore, all approaches physical and hybrid approaches limit the level of monitoring visibility to the server, individual processes cannot be monitored. A spin-out company from University College Dublin Ireland, Stratergia, has developed a unique data centre energy management system PAPILLON. It is totally software-based, measuring every server's energy consumption in real-time. It is intuitive to use, operates on any platform and can be installed in hours without any downtime or retrofitting. It uses a client-server type architecture. Software agents on servers communicate periodically, to a master server which has power models for each server type. Using the power models, the master computes in real-time and saves in a data base, all relevant energy information of the centre. In operation, Papillon identifies and quantifies energy saving actions that can be implemented, and coupled with electricity network data, more sustainable energy sources can be introduced into the power input of the centre. Papillon has been trialled at Swedish Compare Testlab and is one of the core tools being installed at state-of-the-art data centres at Kajaani, Finland and Cenit, Spain for a new international EU-funded Masters programme in green, sustainable data centre management.

This study examines data center characteristics, loads, control systems, and technologies to identify demand response (DR) and automated DR (Open Auto-DR) opportunities and challenges. The study was performed in collaboration with technology experts, industrial partners, and data center facility managers and existing research on commercial and industrial DR was collected and analyzed. The results suggest that data centers, with significant and rapidly growing energy use, have significant DR potential. Because data centers are highly automated, they are excellent candidates for Open Auto-DR. 'Non-mission-critical' data centers are the most likely candidates for early adoption of DR. Data center site infrastructure DR strategies have been well studied for other commercial buildings; however, DR strategies for information technology (IT) infrastructure have not been studied extensively. The largest opportunity for DR or load reduction in data centers is in the use of virtualization to reduce IT equipment energy use, which correspondingly reduces facility cooling loads. DR strategies could also be deployed for data center lighting, and heating, ventilation, and air conditioning. Additional studies and demonstrations are needed to quantify benefits to data centers of participating in DR and to address concerns about DR's possible impact on data center performance or quality of service and equipment life span.

Data centres are large energy consumers, which have become more energy efficient in recent years due to increased awareness of opportunities, increasing energy costs and corporate social responsibility pressures. A lifecycle assessment approach identifies two other significant areas of impact: the embodied impact of IT equipment and mechanical and electrical plant, and the electricity source used in operational and embodied processes. Many data centre operators publicise their energy efficiency, some also report on their carbon footprint. However, there is a need for simple tools in order to help operators better understand and quantify the embodied impact and inform green procurement. Focussing purely on energy efficiency may cause a burden shift, e.g. by replacing equipment with more efficient equipment but increasing the embodied impact. The total environmental impact could remain the same/increase, but with the perception of a ‘greener’ data centre. Although currently there is limited data available for data centre life cycle assessments and the process is resource intensive, research has identified which factors significantly impact a facility’s environmental impact. This knowledge should be used in the design process and throughout the data centre lifecycle to minimise data centre environmental impact. Practical application: As the data centre industry continues to grow and its sustainability receives closer scrutiny, it is important to increase awareness of where its highest environment impacts lie and analyse the factors which influence this. This can help inform policy and decision-making to support the design and operation of data centres which are truly more sustainable. It is important that this research is not just theoretical but can translate into practical actions which can be implemented in a cost-effective manner for the benefit of everyone. The current focus in industry has been energy consumption and energy efficiency; many practices which were considered innovative a few years ago have now become standard best practice. It is time to examine which other areas should be prioritised for improvement.

This study explores the application of machine learning techniques, specifically classification, to improve data analysis outcomes. The primary objective is to evaluate and compare the performance of Decision Tree and Random Forest classifiers in the context of a structured dataset. Using the Elbow Method for optimal clustering alongside decision tree and random forest for classification algorithms, this research investigates the effectiveness of each method in accurately categorizing data. The study employs K-Means clustering to segment the data and Decision Trees and Random Forests for classification tasks. Dataset used in this research was obtained from Kaggle consisting of 13 attributes and 1048575 rows, all of which are numeric. The key results show that Random Forest outperforms Decision Trees in terms of classification accuracy, precision, recall, and F1 score, providing a more robust model for data classification. The performance improvement observed in Random Forest, particularly in handling complex datasets, demonstrates its superiority in generalizing across varied classes. The findings suggest that for applications requiring high accuracy and reliability, Random Forest is preferable to Decision Trees, especially when the dataset exhibits high variability. This research contributes to a deeper understanding of how different machine learning models can be applied to real-world classification problems, offering insights into the selection of the most appropriate model based on specific data characteristics.

Data center (DC) electricity use is increasing at an annual rate of over 20% and presents a concern for the Information Technology (IT) industry, governments, and the society. A large fraction of the energy use is consumed by the compressor cooling to maintain the recommended operating conditions for IT equipment. The most common way to improve the DC efficiency is achieved by optimally provisioning the cooling power to match the global heat dissipation in the DC. However, at a more granular level, the large range of heat densities of today's IT equipment makes the task of provisioning cooling power optimized to the level of individual computer room air conditioning (CRAC) units much more challenging. Distributed sensing within a DC enables the development of new strategies to improve energy efficiency, such as hot spot elimination through targeted cooling, matching power consumption at rack level with workload schedule, and minimizing power losses. The scope of Measurement and Management Technologies (MMT) is to develop a software tool and the underlying sensing technology to provide critical decision support and control for DC and telecommunication facilities (TF) operations. A key aspect of MMT technology is integration of modeling tools to understand how changes in one operational parameter affect the overall DC response. It is demonstrated that reduced ordered models for DC can generate, in less than 2 seconds computational time, a three dimensional thermal model in a 50 kft{sup 2} DC. This rapid modeling enables real time visualization of the DC conditions and enables 'what if' scenarios simulations to characterize response to 'disturbances'. One such example is thermal zone modeling that matches the cooling power to the heat generated at a local level by identifying DC zones cooled by a specific CRAC. Turning off a CRAC unit can be simulated to understand how the other CRAC utilization changes and how server temperature responds. Several new sensing technologies were added to the existing MMT platform: (1) air contamination (corrosion) sensors, (2) power monitoring, and (3) a wireless environmental sensing network. All three technologies are built on cost effective sensing solutions that increase the density of sensing points and enable high resolution mapping of DCs. The wireless sensing solution enables Air Conditioning Unit (ACU) control while the corrosion sensor enables air side economization and can quantify the risk of IT equipment failure due to air contamination. Validation data for six test sites demonstrate that leveraging MMT energy efficiency solutions combined with industry best practices results in an average of 20% reduction in cooling energy, without major infrastructure upgrades. As an illustration of the unique MMT capabilities, a data center infrastructure efficiency (DCIE) of 87% (industry best operation) was achieved. The technology is commercialized through IBM System and Technology Lab Services that offers MMT as a solution to improve DC energy efficiency. Estimation indicates that deploying MMT in existing DCs can results in an 8 billion kWh savings and projection indicates that constant adoption of MMT can results in obtainable savings of 44 billion kWh in 2035. Negotiations are under way with business partners to commercialize/license the ACU control technology and the new sensor solutions (corrosion and power sensing) to enable third party vendors and developers to leverage the energy efficiency solutions.

Optimizing energy efficiency in data center cooling towers is crucial for reducing operational costs and environmental impact. This review explores the integration of predictive maintenance and project management to achieve this goal. By leveraging predictive maintenance techniques, data center operators can anticipate and address potential issues before they lead to costly downtime or inefficiencies. Project management plays a key role in coordinating these efforts, ensuring that maintenance activities are carried out efficiently and effectively. Predictive maintenance relies on data analytics and machine learning algorithms to monitor the condition of cooling towers in real-time. By analyzing data such as temperature, pressure, and flow rates, these algorithms can detect anomalies and predict potential failures. This proactive approach allows data center operators to schedule maintenance activities during planned downtime, minimizing disruptions to operations. Project management practices, such as Agile or Waterfall methodologies, are essential for coordinating predictive maintenance efforts. Project managers oversee the planning, execution, and monitoring of maintenance activities, ensuring that they are completed on time and within budget. They also facilitate communication between stakeholders, including maintenance teams, data analysts, and management, to ensure that everyone is aligned and working towards the same goals. By integrating predictive maintenance with project management, data center operators can achieve significant improvements in energy efficiency. By addressing maintenance issues proactively, operators can reduce energy consumption, extend the lifespan of cooling equipment, and minimize downtime. Additionally, project management practices ensure that these efforts are coordinated and effective, maximizing the benefits of predictive maintenance. In conclusion, optimizing energy efficiency in data center cooling towers requires a holistic approach that combines predictive maintenance and project management. By leveraging predictive maintenance techniques and project management practices, data center operators can achieve significant improvements in energy efficiency, reduce operational costs, and enhance environmental sustainability.

Due to the increase in computer rack equipment power in recent years, thermal management of data centers has become a challenging problem. Data center facilities with raised floor plenums are the most popular configuration from a thermal management perspective. Considerable ongoing research efforts focus on optimizing the room layouts and equipment design in order to achieve the desired cooling. However, the detrimental impact of under floor blockages, which occur widely, is seldom addressed. These blockages often take the form of chiller pipes, cabling, and wires. They impede the flow of cold air from the air conditioning units and yield unpredictable air flow patterns. This results in highly maldistributed tile flow rates which can create additional hot spots above the raised floors. In this paper the effect of such under floor blockages on data center performance is characterized in detail. A representative data center is modeled using commercial CFD code, with typical under floor blockages. Blockages are shown to have a significant impact on tile flow rates and rack inlet temperatures. A detailed parametric study is presented, to identify the locations under the floor, where blockages if installed, have minimal effect on data center performance. Case studies are presented to show that blockages, if installed with prior consideration, have a positive effect on overall data center performance. Finally guidelines are presented on how to rearrange existing blockages or to install new blockages, and still achieve an improvement in thermal performance, without any change to the room layout or cold air supply.

The growing demand for data center facilities has made intelligently managed data center operations necessary. For temperature measurement and thermal management, a common practice is to install a limited number of temperature sensors evenly distributed throughout the room. However, data center operators rarely fully equip facilities with temperature sensors due to their cost, complexity, and maintenance requirements, creating vacancies in the data center temperature and cooling picture. The local nature of sensor data can also be misinterpreted and misused. Without novel methods to interpret and visualize temperatures obtained by prediction or measurement, data center operators cannot easily identify urgent local cooling issues or quickly examine the temperature at other location. This paper presents methods to predict a full three-dimensional temperature field in data centers from a limited number of measurement points. Several different statistical interpolating schemes are discussed. We also validate the interpolated temperature fields against benchmark data from Computation Fluid Dynamics (CFD) and show good agreement.

Landfills are one of the major sources of greenhouse gas emissions worldwide. Over the past few decades, gas collection and energy conversion systems have been increasingly implemented in landfills to enhance sustainability and profitability. Accurate methane (CH4) generation rate estimates are essential for designing and optimizing these systems. However, due to the heterogeneity of waste properties, site-specific conditions, and the complex interrelated thermo-hydro-bio-mechanical processes involved, obtaining precise CH4 generation predictions is challenging. Although laboratory and field monitoring data provide valuable insights, obtaining such data is expensive and is often site-specific and non-generalizable. Process-based numerical models, such as the coupled thermo-hydro-bio-mechanical (CTHBM) model developed at the University of Illinois Chicago, offer reliable estimates but are computationally intensive for optimization tasks. Recent advancements in machine learning (ML) based data-driven modeling show promise in handling complex nonlinear datasets. This study evaluates the effectiveness of several ML models, including random forests (RF), extreme gradient boosting (XGB), multi-layer perceptron (MLP), and linear regression (LR), in predicting landfill CH4 generation rates. The data used to train these ML models is generated using the CTHBM model by varying several waste properties. Results indicate that during the rapid methane generation phase, the MLP model demonstrated excellent performance, while XGB also showed reasonable accuracy. In contrast, RF and LR models did not accurately predict methane generation rates during this phase. This study is a preliminary proof of concept for applying ML techniques in landfill CH4 prediction. Further exploration of advanced techniques, such as physics-informed ML, is recommended for scalable and generalizable predictions.

In recent years, Machine Learning (ML) models, especially deep learning models, have become commodities. In this context, data centers which hold a lot of data often buy ML models from ML model providers, train them on their data locally and use the trained models to provide intelligent services. Existing work has shown that there is a risk of data leakage, which could cause incalculable consequences. Even under the black-box condition, there are still some attacks that can steal the private data held by data centers, and the Capacity Abuse Attack (CAA) is the state-of-the-art attack method. CAA attackers steal the training data by labeling malicious samples with the data to be stolen. However, the label encodings are usually mapped into other output forms such as categories, and it is impossible for the adversary to know the mapping relationship between the form outputted by the trained model and the label encodings. Without the mapping relationship, CAA becomes invalid. Aiming at the limitation of CAA, this study proposes a novel practical attack method, i.e., Capacity Abuse Attack II (CAAII), which can find the mapping relationship between the output in the arbitrary form returned by the trained model and the values of the stolen data. Experiments are conducted on MNIST, Fashion-MNIST, and CIFAR10 datasets, and experimental results show that no matter what forms are returned by the model, our attack method can always find the mapping relationship and successfully steals the training data.