Data science and analytics in aviation

Data Science is associated with new discoveries, the discovery of value from the data. It is a practice of deriving insights and developing business strategies through transformation of data in to useful information. It has been evaluated as a scientific field and research evolution in disciplines like statistics, computing science, intelligence science, and practical transformation in the domains like science, engineering, public sector, business and lifestyle. The field encompasses the larger areas of artificial intelligence, data analytics, machine learning, pattern recognition, natural language understanding, and big data manipulation. It also tackles related new scientific challenges, ranging from data capture, creation, storage, retrieval, sharing, analysis, optimization, and visualization, to integrative analysis across heterogeneous and interdependent complex resources for better decision-making, collaboration, and, ultimately, value creation. In this paper we entitled epicycles of analysis, formal modeling, from data analysis to data science, data analytics -A keystone of data science, The Big data is not a single technology but an amalgamation of old and new technologies that assistance companies gain actionable awareness. The big data is vital because it manages, store and manipulates large amount of data at the desirable speed and time. Big data addresses detached requirements, in other words the amalgamate of multiple un-associated datasets, processing of large amounts of amorphous data and harvesting of unseen information in a time-sensitive generation.
 As businesses struggle to stay up with changing market requirements, some companies are finding creative ways to use Big Data to their growing business needs and increasingly complex problems. As organizations evolve their processes and see the opportunities that Big Data can provide, they struggle to beyond traditional Business Intelligence activities, like using data to populate reports and dashboards, and move toward Data Science- driven projects that plan to answer more open-ended and sophisticated questions.
 Although some organizations are fortunate to have data scientists, most are not, because there is a growing talent gap that makes finding and hiring data scientists in a timely manner is difficult. This paper, aimed to demonstrate a close view about Data science, big data, including big data concepts like data storage, data processing, and data analysis of these technological developments, we also provide brief description about big data analytics and its characteristics , data structures, data analytics life cycle, emphasizes critical points on these issues.

This chapter introduces data science with its history and importance in this modern era briefly. This chapter also elaborates the discussion by relating data science to various modern fields like big data analytics, artificial intelligence, deep learning, and machine learning. This chapter also discuss the necessary of data analytics in this big data era. This chapter also briefly introduces another emerging field, Internet of Things (IoT) and explores the contribution IoT towards big data analytics and data science in research perspective. It also briefly introduces the programming and non-programming tools used in the data science field.

Recent advances in computing have lead to diverse applications in wide domains such as cyber-forensics, data science, business analytics, business intelligence, computer security, Web technology, and Big data analytics. Data analytics refer to broad term where many of the areas such as cyber-physical systems (CPS), Internet of Things (IoT), Big data, machine learning and data mining overlap among each other. However, there are subtle differences among these areas. Data analytics form as one of the key components of these wide areas in computing. For example, in IoT the data that are collected from various devices need to analyze for inferring the outcomes of it. Hence, data analytics need to be carried on it. There are various platforms available for data analytics. In this chapter, a brief overview of the term data analytics, different types of data, different types of analytics, and the analytical architecture is first discussed. It is later followed by the different phases that are involved in the lifecycle of the data analytics project and the interconnection of Big data and Hadoop ecosystem.

The military establishment, mimicking the business world in many respects, is abuzz with the rapid growth in big data, data analytics, machine learning, and statistical learning using artificial intelligence as well as supervised and unsupervised learning. But the challenge is really understanding what all these concepts mean for the military and how do these concepts relate the fundamental statistical principles historically employed by the defense operations research analyst or statistician. This chapter defines the key terms in the area and discusses the key aspects of the modern data challenge: big data, data engineering, data science, data analytics, and data mining. The chapter then focuses on data analytics and the range of methods and concerns associated with data analytics, and a discussion of the some of the techniques within the data analytics realm. The chapter closes with recommendations and concerns for the future.

The unprecedented proliferation of miniaturized sensors and intelligent communication, computing, and control technologies have paved the way for the development of the Industrial Internet of Things. The IIoT incorporates machine learning and massively parallel distributed systems such as clouds, clusters, and grids for big data storage, processing, and analytics. In IIoT, end devices continuously generate and transmit data streams, resulting in increased network traffic between device-cloud communication. Moreover, it increases in-network data transmissions. requiring additional efforts for big data processing, management, and analytics. To cope with these engendered issues, this article first introduces a novel concentric computing model (CCM) paradigm composed of sensing systems, outer and inner gateway processors, and central processors (outer and inner) for the deployment of big data analytics applications in IIoT. Second, we investigate, highlight, and report recent research efforts directed at the IIoT paradigm with respect to big data analytics. Third, we identify and discuss indispensable challenges that remain to be addressed for employing CCM in the IIoT paradigm. Lastly, we provide several future research directions (e.g., real-time data analytics, data integration, transmission of meaningful data, edge analytics, real-time fusion of streaming data, and security and privacy).

Advanced Data Science and Analytics with Python enables data scientists to continue developing their skills and apply them in business as well as academic settings. The subjects discussed in this book are complementary and a follow-up to the topics discussed in Data Science and Analytics with Python. The aim is to cover important advanced areas in data science using tools developed in Python such as SciKit-learn, Pandas, Numpy, Beautiful Soup, NLTK, NetworkX and others. The model development is supported by the use of frameworks such as Keras, TensorFlow and Core ML, as well as Swift for the development of iOS and MacOS applications. Features: Targets readers with a background in programming, who are interested in the tools used in data analytics and data science Uses Python throughout Presents tools, alongside solved examples, with steps that the reader can easily reproduce and adapt to their needs Focuses on the practical use of the tools rather than on lengthy explanations Provides the reader with the opportunity to use the book whenever needed rather than following a sequential path The book can be read independently from the previous volume and each of the chapters in this volume is sufficiently independent from the others, providing flexibility for the reader. Each of the topics addressed in the book tackles the data science workflow from a practical perspective, concentrating on the process and results obtained. The implementation and deployment of trained models are central to the book. Time series analysis, natural language processing, topic modelling, social network analysis, neural networks and deep learning are comprehensively covered. The book discusses the need to develop data products and addresses the subject of bringing models to their intended audiences – in this case, literally to the users’ fingertips in the form of an iPhone app. About the Author Dr. Jesus Rogel-Salazar is a lead data scientist in the field, working for companies such as Tympa Health Technologies, Barclays, AKQA, IBM Data Science Studio and Dow Jones. He is a visiting researcher at the Department of Physics at Imperial College London, UK and a member of the School of Physics, Astronomy and Mathematics at the University of Hertfordshire, UK.

Recent advances and widespread usage of online web services and social media platforms, coupled with ubiquitous low cost devices, mobile technologies, and increasing capacity of lower cost storage, has led to a proliferation of Big data, ranging from, news, e-commerce clickstreams, and online business transactions to continuous event logs and social media expressions. These large amounts of online data, often referred to as data streams, because they get generated at extremely high throughputs or velocity, can make conventional and classical data analytics methodologies obsolete. For these reasons, the issues of management and analysis of data streams have been researched extensively in recent years. The special case of social media Big Data brings additional challenges, particularly because of the unstructured nature of the data, specifically free text. One classical approach to mine text data has been Topic Modeling. Topic Models are statistical models that can be used for discovering the abstract ``topics'' that may occur in a corpus of documents. Topic models have emerged as a powerful technique in machine learning and data science, providing a great balance between simplicity and complexity. They also provide sophisticated insight without the need for real natural language understanding. However they have not been designed to cope with the type of text data that is abundant on social media platforms, but rather for traditional medium size corpora consisting of longer documents, adhering to a specific language and typically spanning a stable set of topics. Unlike traditional document corpora, social media messages tend to be very short, sparse, noisy, and do not adhere to a standard vocabulary, linguistic patterns, or stable topic distributions. They are also generated at high velocity that impose high demands on topic modeling; and their evolving or dynamic nature, makes any set of results from topic modeling quickly become stale in the face of changes in the textual content and topics discussed within social media streams. In this dissertation, we propose an integrated topic modeling framework built on top of an existing stream-clustering framework called Stream-Dashboard, which can extract, isolate, and track topics over any given time period. In this new framework, Stream Dashboard first clusters the data stream points into homogeneous groups. Then data from each group is ushered to the topic modeling framework which extracts finer topics from the group. The proposed framework tracks the evolution of the clusters over time to detect milestones corresponding to changes in topic evolution,

Big data and data analytics are currently the buzzwords in both academia and industry to become data driven. Big data has been the trending topic in the accounting industry also. Big data and data analytics will have an important impact on accounting and accountants. Big data will improve the quality of accounting information and the accounting profession will continue to provide real-time and dynamic information to assist in decision-making. The purpose of this research is to investigate the impact of big data and big data analytics in accounting. Data analytics is one of the most recent developments in the accounting context. This study is qualitative in nature and adopted a literature review methodology to gain a better understanding of the study area. This literature review seeks to provide a description and evaluation of the impact of big data analytics on accounting. This research found that big data presents great opportunities for decision making in accounting and risks analysis, which indicated that companies could improve their performance, measure performance, manage risks and allow effective real-time decision-making with data analytics. This research revealed that accountants can create more value in a world of big data analytics and encourages accountants to get started with big data to find answers to risks in business operations as well as understand financial performance. It shows that relying on big data analytics will open new possibilities for accountants. This study contributes to the research literature in the area of big data analytics on accounting. The limitations of this study are that it utilizes few recent peer reviewed articles in the general accounting practice, therefore not exhaustive in describing how big data and big data analytics impacts accounting.

The overwhelming amount, production speed, multidimensionality, and potential value of data currently available—often simplified and referred to as big data —exceed the limits of understanding of the human brain. At the same time, developments in data analytics and computational power provide the opportunity to obtain new insights and transfer data-provided added value to clinical practice in real time. What is the role of the health care professional in collaboration with the data scientist in the changing landscape of modern care? We discuss how health care professionals should provide expert knowledge in each of the stages of clinical decision support design: data level, algorithm level, and decision support level. Including various ethical considerations, we advocate for health care professionals to responsibly initiate and guide interprofessional teams, including patients, and embrace novel analytic technologies to translate big data into patient benefit driven by human(e) values.

Digital technologies have become a cause célèbre among academics and practitioners as great tools capable of building resilient and sustainable supply chains. This chapter provides an overview of the recent developments in data analytics applications in supply chain resilience (SCR) and supply chain sustainability (SCS). There has been an exponential growth of literature on data analytics applications for SCR and SCS, with a particularly notable increase observed since 2015. In this systematic literature review, we find that both SCR and SCS research are concentrated around five main themes: (1) data analytics capabilities, (2) role of Industry 4.0, (3) blockchain adoption, (4) big data analytics, and (5) machine learning. Closed-loop supply chain design and circular economy are of unique focus in SCS, while digital twin only emerged as a research theme in SCR research. The underlying themes in SCR contexts are more dispersed than in SCS, mostly due to the comparative maturity of SCS research. In light of the promising developments in data analytics applications for SCR and SCS, promising avenues for future inquiry are the design of effective data-sharing incentive mechanisms, and the utilization of big data from social media platforms, yielding valuable insights for both research and practitioners.

The collection of high-quality data provides a key competitive advantage to companies in their decision-making process. It helps to understand customer behavior and enables the usage and deployment of new technologies based on machine learning. However, the process from collecting the data, to clean and process it to be used by data scientists and applications is often manual, non-optimized and error-prone. This increases the time that the data takes to deliver value for the business. To reduce this time companies are looking into automation and validation of the data processes. Data processes are the operational side of data analytic workflow.DataOps, a recently coined term by data scientists, data analysts and data engineers refer to a general process aimed to shorten the end-to-end data analytic life-cycle time by introducing automation in the data collection, validation, and verification process. Despite its increasing popularity among practitioners, research on this topic has been limited and does not provide a clear definition for the term or how a data analytic process evolves from ad-hoc data collection to fully automated data analytics as envisioned by DataOps.This research provides three main contributions. First, utilizing multi-vocal literature we provide a definition and a scope for the general process referred to as DataOps. Second, based on a case study with a large mobile telecommunication organization, we analyze how multiple data analytic teams evolve their infrastructure and processes towards DataOps. Also, we provide a stairway showing the different stages of the evolution process. With this evolution model, companies can identify the stage which they belong to and also, can try to move to the next stage by overcoming the challenges they encounter in the current stage.

_ This article, written by JPT Technology Editor Chris Carpenter, contains highlights of paper SPE 217665, “Well Construction in the Era of Big Data: It’s Not Data Analytics, It’s Engineering With Data,” by Gregory S. Payette, SPE, ExxonMobil; Jeffrey R. Bailey, SPE, consultant; and Paul E. Pastusek, SPE, ExxonMobil, et al. The paper has not been peer reviewed. _ The authors write that data science captures value in well construction when data-analysis methods such as machine learning are underpinned by first principles derived from physics and engineering and supported by deep domain expertise. The authors provide a summary of important data pertaining to the well-construction process and discuss high-level areas where data science can add value to well construction through analysis of such data. Introduction The authors write that it is important for organizations to grow data science and physics-based modeling solutions together; well-construction data science should be what they term an “engineering with data” endeavor. A large portion of the complete paper is dedicated to discussing ways that organizations can improve their abilities to derive value from data-science efforts. Most discussion focuses on steps that data science teams can take today. However, the provided commentary on data management and governance is forward-looking. The paper concludes by examining several historical data-science case studies for well construction. Each example highlights the need to connect data and some physical or engineering process to deliver value through data science. Improving the Effect of Data Science in Well Construction Data Management and Governance. A step that can be taken to enable better holistic well-construction data management is for data collectors and creators to organize their data using data models that center around what the authors term “data entities” that are common and stable across data collectors. Common well-construction data entities include items such as Wells, Wellbores, Hole Sections, Surveys, Casing Strings, Drillstrings and Bottomhole Assemblies (BHAs), Tubing Strings, and Downhole Completion Equipment. These data entities are capitalized in this paper to denote their roles as data entities. The industry is accustomed to organizing data around entities. Two common types of databases particularly relevant to data-science efforts commonly used by operators include the following: - Well Information Management Databases (WIMD)—These databases are used to document information about the life cycle of wells. - Wellsite Information Transfer Standard Markup Language (WITSML) Databases: WITSML databases are primarily used to store time- and depth-series sensor data collected during drilling and completion activities. For the purposes of their paper, the authors do not include other data entities that can be captured through WITSML data repositories. Even though WIMD and WITSML databases share common data entities, such entities typically are not linked to one another through formal relationships at the original database levels. This creates a barrier for data-science projects that require data from both source systems.

This chapter provides an in-depth introduction to the fundamental principles, methodologies, and applications that define these fields and delves into the historical evolution of data science and analytics, tracing their roots from traditional statistics and computer science to the modern era characterized by big data and advanced computing technologies. It introduces key concepts such as big data, machine learning, data mining, and data visualization, elucidating how these elements converge to extract valuable insights from complex datasets. A detailed overview of the data science process is presented, outlining each critical stage from data collection and cleaning to exploratory data analysis, modeling, and deployment. This orderly approach guarantees that peruses get a handle on the whole lifecycle of data-driven projects. Additionally, the chapter highlights the essential tools and technologies used in the field.

Photo by Josh Riemer on Unsplash
 Introduction
 With the rapid advancements in neurotechnological machinery and improved analytical insights from machine learning in neuroscience, the availability of big brain data has increased tremendously. Neurological health research is done using digitized brain data.[1] There must be adequate data governance to secure the privacy of subjects participating in brain research and treatments. If not properly regulated, the research methods could lead to significant breaches of the subject’s autonomy and privacy. This paper will address the necessity for neuroprotection laws, which effectively govern the use of big brain data to ensure respect for patient privacy and autonomy.
 Background
 Artificial intelligence and machine learning can be integrated with neuroscience big brain data to drive research studies. This integrative technology allows patterns of electrical activity in neurons to be studied in detail.[2]Specifically, it uses a robotic system which can reason, plan, and exhibit biologically intelligent behavior. Machine learning is a method of computer programming where the code can adapt its behavior based on big brain data.[3] The big brain data is the collection of large amounts of information for the purpose of deciphering patterns through computer analysis using machine learning.[4] The information that these technologies provide is extensive enough to allow a researcher to read a patient’s mind. AI and machine learning technologies work by finding the underlying structure of brain data, which is then described by patterns known as latent factors, eventually resulting in an understanding of the brain’s temporal dynamics.[5]
 Through these technologies, researchers are able to decipher how the human brain computes its performances and thoughts. However, due to the extensive and complex nature of the data processed through AI and machine learning, researchers may gain access to personal information a patient may not wish to reveal. From a bioethical lens, tensions arise in the realm of patient autonomy. Patients are not able to control the transmission of data from their brains that is analyzed by researchers. Governing brain data through laws may enhance the extent of patient privacy in the case where brain data is being used through AI technologies.[6] A responsible approach to governing brain data would require a sophisticated legal structure.
 Analysis
 Impact on Patient Autonomy and Privacy 
 In research pertaining to big brain data, the consent forms do not fully cover the vast amounts of information that is collected. According to research, personal data has become the most sought out commodity to provide content to corporations and the web-based service industry. Unfortunately, data leaks that release private information frequently occur.[7] The storage of an individual’s data on technologies accessible on the internet during research studies makes it vulnerable to leaks, jeopardizing an individual’s privacy. These data leaks may cause the patient to be identified easily, as the degree of information provided by AI technologies are personalized and may be decoded through brain fingerprinting methods.[8]
 There has been an extensive growth in the development and use of AI. It is efficient in providing information to radiologists who diagnose various diseases including brain cancer and psychiatric disease, and AI assists in the delivery of telemedicine.[9] However, the ethical pitfall of reduced patient autonomy must be addressed by analyzing current AI technologies and creating more options for patient preference in how the data may be used. For instance, facial recognition technology[10] commonly used in health care produces more information than listed in common consent forms, threatening to undermine informed consent. Facial recognition software collects extensive data and may disclose more information than a person would prefer to provide despite being a useful tool for diagnosing medical and genetic conditions.[11] In addition, people may not be aware that their images are being used to generate more clinical data for other purposes. It is difficult to guarantee the data is anonymized. Consent requirements must include informing people about the complexity of the potential uses of the data; software developers should maximize patient privacy.[12] Furthermore, there is a “human element” in the use of AI technologies as medical providers control the use and the extent to which data is captured or accessed through the AI technologies.[13] People must understand the scope of the technology and have clear communication with the physician or health care provider about how the medical information will be used. 
 Existing Laws for Brain Data Governance 
 A strict system of defined legal responsibilities of medical providers will ensure a higher degree of patient privacy and autonomy when AI technologies and data from machine learning are used. Governing specific algorithmic data is crucial in safeguarding a patient’s privacy and developing a gold standard treatment protocol following the procurement of the information.[14] Certain AI technologies provide more data than others, and legal boundaries should be established to ensure strong performance, quality control, and scope for patient privacy and autonomy. For instance, currently AI technologies are being used in the realm of intensive neurological care. However, there is a significant level of patient uncertainty about how much control patients have over the data’s uses.[15] Calibrated legal and ethical standards will allow important brain data to be securely governed and monitored.
 Once brain signals are recorded and processed from one individual, the data may be merged with other data in Brain Computer Interface Technology (BCI).[16] To ensure a right and ability to retrieve personal data or pull it from the collection, specific regulations for varying types of data are needed.[17] The importance of consent and patient privacy must be considered through giving patients a transparent view of how brain data is governed.[18] The legal system must address discriminatory issues and risks to patients whose data is used in studies. Laws like the General Data Protection Regulation (GDPR) and the California Consumer Privacy Protection Act (CCPA) can serve as effective models to protect aggregated data. These laws govern consumer information and ensure the compliance when personal data is collected.[19] California voters recently approved expansion of the CCPA to health data. The Washington Privacy Act, which would have provided rights to access, change, and withdraw personal data, failed to pass. Other states should improve privacy as well,[20] although a federal bill would be preferable. Scientists at the Heidelberg Academy of Sciences argue for data security to be governed in a manner that balances patient privacy and autonomy with the commercial interests of researchers.[21] The balance could be achieved through privacy protections like those in the Washington Privacy Act. Although the Health Insurance Portability and Accountability Act (HIPAA) provides an overall framework to deter the likelihood of dangers to patient protection and privacy, more thorough laws are warranted to combat pervasive data transfer and analysis that technology has brought to the health care industry.[22] Breaches of patient privacy under current HIPAA regulations include releasing patient information to a reporter without their consent and sending HIV data to a patient’s employer without consent.[23] HIPAA does not cover information being shared with outside contractors who do not have an agreement with technology companies to keep patient data confidential. HIPAA regulations also do not always address blatant breaches on patient data confidentiality.[24] Patients must be provided with methods to monitor the data being analyzed to be able to view the extent of private information being generated via AI technologies. In health research, the medical purposes of better diagnosis, earlier detection of diseases, or prevention are ethical justifications for the use of the data if it was collected with permission, the person understood and approved the uses of the data, and the data was deidentified.
 A standard governance framework is required in providing the fairest system of care to patients who allow their brain data to be examined. Informed consent in the neuroscience field could reaffirm the privacy and autonomy of patients by ensuring that they understand the type of information collected. Laws also could protect data after a patient’s death. Malpractice in the scope of brain data could give people a cause of action critical in safeguarding patient’s rights. Data breach lawsuits will become common but generally do not cover deidentified data that becomes part of big data collection. A more synchronized approach to the collection and consent process will encourage an understanding of how big data is used to diagnose and treat patients. Some altruistic people may even be more likely to consent if they know the largescale data collection is helpful to treat and diagnose people. Others should have the ability to opt out of sharing neurological data, especially when there is not certainty surrounding deidentification.[25]
 Conclusion
 Artificial intelligence and machine learning technologies have the potential to aid in the diagnosis and treatment of people globally by extracting and aggregating brain data specific to individuals. However, the secure use of the data is necessary to build trust between care providers and patients, as well as in balancing the bioethical principles of beneficence and patient autonomy. We must ensure the highest quality of care to patients, while protecting their privacy, informed consent, and clinical trust. More sophis

This chapter provides a brief overview of the growing role played by big data, data analytics, and artificial intelligence (AI) in the accounting profession. The term 'Big Data' along with other trending topics such as 'Data Analytics' and 'Artificial Intelligence (AI)' have become buzzwords in the accounting profession in recent years. The skills of accounting professionals have evolved as technology has made rapid advances from using pencil and paper to typewriters and calculators, and eventually spreadsheets and accounting software. Data analytics in accounting is a relatively new skill set that is growing significantly in all areas of the accounting profession. Accounting professionals who can discern patterns and trends in big data and translate them into compelling strategic narratives will find themselves at the center of the twenty-first-century business world. Therefore, accounting professionals can capitalize on numerous opportunities in this rapidly evolving, disruptive, but ultimately advantageous environment by embracing big data, data analytics, and artificial intelligence (AI) to stay ahead of the competition.