Using Suffix-Tree to Identify Patterns and Cluster Traces from Event Log

Process mining is an emerging discipline incorporating methods and tools for the analysis of system/process executions captured in the form of event logs [1]. Traditionally process mining can be divided into three research areas: discovery (construction of process models from event logs), conformance checking (finding log and model deviations), and enhancement of existing process models with additional event log data.BPMN (Business Process Model and Notation) 2.0 [2] is a widely used process modeling notation, supported by various process modeling and analysis tools, and is a de-facto process modeling standard. Using BPMN within process mining opens perspectives for applicability of the existing process mining techniques: for instance discovered process models can be analyzed or enacted using existing BPMN-based software, and vice versa, manually created models can be imported to a process mining tool, verified against event logs, and enhanced with additional data.In this work we bridge the gap between conventional process modeling formalisms used in the context of process mining (e.g., Petri nets, causal nets, process trees) and BPMN. For that purpose we developed a suite of conversion algorithms and provide formal guarantees relating the behavior of Petri nets (including non-free-choice nets) to the corresponding BPMN models (and vice versa). The derived relations are used to enhance the BPMN models with information learned from the event logs.The developed conversion techniques are described in detail in [3] and have been implemented [4] as a part of ProM (Process Mining Framework) [5] -- an open source tool for process mining and verified on real event log data. Moreover, cases for which conversion algorithms give more compact process models in comparison with the initial models are identified. Although the developed algorithms deal with basic control flow constructs only, they can be applied in the discovery of advanced BPMN modeling elements [2], including subprocesses [6-7], cancellations [8], conditional branching and data objects, swimlanes, message flows, and others.

Process mining (PM) is a technique to extract a process model from an event log to represent the process behaviour recorded in that event log. A mined process model with high fitness means that it can reflect most of the process behaviour recorded in the event log. Previous studies have shown that the mined model with high fitness can be used in process improvement, such as fraud detection, continuous process improvement and benchmarking. Genetic process mining (GPM) is a famous PM approach, which can simultaneously identify several process structures from event logs. However, GPM cannot effectively discover parallel structures from event logs. This study proposes a PM approach based on integration of GPM, particle swarm optimisation and differential evolution to find process models with high fitness for event logs involving multiple parallel structures. The results show that the proposed approach does indeed lead to improvement in gaining process models with high fitness for event logs involving multiple parallel structures.

Process mining explores event logs to offer valuable insights to business process managers. Some types of business processes are hard to mine, including unstructured and knowledge-intensive processes. Then, trace clustering is usually applied to event logs aiming to break it into sublogs, making it more amenable to the typical process mining task. However, applying clustering algorithms involves decisions, such as how traces are represented, that can lead to better results. In this paper, we compare four vector space models for trace clustering, using them with an agglomerative clustering algorithm in synthetic and real-world event logs. Our analyses suggest the embeddings-based vector space model can properly handle trace clustering in unstructured processes.

Global conformance checking measures using shallow representation and deep learning

Process mining is a technique for extracting process models from event logs. Event logs contain abundant information related to an event such as the timestamp of the event, the actions that triggers the event, etc. Much of existing process mining research has been focused on discoveries of process models behind event logs. How to uncover the timing constraints from event logs that are associated with the discovered process models is not well-studied. In this paper, we present an approach that extends existing process mining techniques to not only mine but also integrate timing constraints with process models discovered and constructed by existing process mining algorithms. The approach contains three major steps, i.e., first, for a given process model constructed by an existing process mining algorithm and represented as a workflow net, extract a time dependent set for each transition in the workflow net model. Second, based on the time dependent sets, develop an algorithm to extract timing constraints from event logs for each transition in the model. Third, extend the original workflow net into a time Petri net where the discovered timing constraints are associated with their corresponding transitions. A real-life road traffic fine management process scenario is used as a case study to show how timing constraints in the fine management process can be discovered from event logs with our approach.

Process mining has proven to be a valuable tool for analyzing operational process executions based on event logs. Existing techniques perform well on structured processes, but still have problems discovering and visualizing less structured ones. Unfortunately, process mining is most interesting in domains requiring flexibility. A typical example would be the treatment process in a hospital where it is vital that people can deviate to deal with changing circumstances. Here it is useful to provide insights into the actual processes but at the same time there is a lot of diversity leading to complex models that are difficult to interpret. This paper presents an approach using trace clustering, i.e., the event log is split into homogeneous subsets and for each subset a process model is created. We demonstrate that our approach, based on log profiles, can improve process mining results in real flexible environments. To illustrate this we present a real-life case study.

The basic objective of process mining is to discover, monitor, and improve process models by extracting knowledge from event logs using different techniques. In order to enhance the quality of process models, several works in literature used trace clustering, where a trace represents a sequence of events of the same process instance (user). In this research paper, we attempt to discover process models in the educational domain so as to refine learning resource recommendation. For this reason, we propose to apply trace clustering on event log extracted from the learning platform Moodle. Indeed, to the best of our knowledge, trace clustering has not yet been applied in the educational domain. From this perspective, we performed several experiments with various clustering algorithms to retain the most performant one. Subsequently, we applied a process discovery algorithm, namely heuristic miner. The results revealed that the quality of the discovered process models is better once trace clustering is considered.

A learning management system is a system that supports student learning with several components. Telkom University is an institution that has an LMS called CeLOE LMS (Center for e-Learning and Open Education Learning Management System). Using LMS supports students' learning process, and lecturers can monitor what activities are carried out by their students. The pattern of learning by students can affect the success of learning in certain situations. The influence of these learning patterns makes lecturers need to pay attention to differences in student learning patterns. The data that will be used in this research are Website Application Development and Enterprise Systems courses. This study uses a process mining method with fuzzy miner algorithms to overcome the "spaghetti-like" process model into a more straightforward and easier-to-understand form. The resulting process model will then be analyzed using the graph simplification process method to obtain an accurate process model that describes the event log. In the Website Application Development course, conformance for all students Event logs is 99.93%, while conformance for students with index A event log is 99.94%. In the Enterprise System course, both event logs show the best conformance of 100%. The modeling produced by the two courses shows that the resulting model has a close alignment between the fuzzy model and the event log to reflect the behavior observed in the event log.

Process mining techniques aim at extracting knowledge from event logs. One of the most important tasks in process mining is process model discovery. In discovering process models, an algorithm is designed to build a process model from a given event log. In this paper, a new model to discover process models has been proposed. A combination of Genetic Algorithm and Simulated Annealing has been used in this model. Genetic Algorithms has previously been used in this context. Previous approaches had drawbacks in fitness evaluation that misguided the algorithm. Another problem was that the quality of the candidates, in the population, was low such that it reduced the chance of finding a perfect answer. In this paper, a new fitness measure has been proposed to evaluate process models based on event logs. Moreover SA has been used to improve the quality of candidates in the population. It has been demonstrated that the proposed model outperformed in terms of rediscovering process models, compared to other approaches which are proposed in the literature, which was the result of better fitness evaluation and increased quality of individuals,. It came to conclusion that using GA and SA in combination with each other can be effective in this context.

Process discovery aims to discover process models from event logs to describe actual business processes. The quality of event logs has an impact on the quality of process models, so preprocessing methods can be used to improve the quality of event logs. Chaotic activities may exist in real business scenarios, and the occurrence of chaotic activities is independent of other activities in the process and can occur at any location in the event log at any frequency. Therefore, chaotic activities seriously affect the model quality of process discovery. Filtering chaotic activities in event logs can effectively improve the quality of event logs and thus improve the quality of process models. The traditional chaotic activity filtering algorithm makes it difficult to balance accuracy and time performance. Therefore, a direct method for filtering chaotic activities is proposed in this paper. By analyzing the relationship between activities, chaotic activities are identified in the log according to the characteristics of chaotic activities and the direct following relationship of activities as the judgment condition, and the filtering of chaotic activities in the event log is realized. In addition, this paper proposes an indirect chaotic activity filtering method, which identifies and filters chaotic activities in the log by analyzing the influence of the existence of different activities on the overall chaos degree of the log. The proposed method is compared with the traditional chaotic activity filtering method on several simulation/real data sets, and the accuracy and running time between the multi-group event logs and the process models generated before and after chaotic activity filtering are analyzed, further verifying the effectiveness and feasibility of the proposed method. By summarizing the experimental results, it is found that the accuracy of the proposed chaotic activity filtering methods is greater than that of the frequency-based filtering method and is close to that of the entropy-based chaotic activity filtering methods. Moreover, compared with other filtering methods used in the experiment, the chaotic activity filtering method proposed in this paper can improve the efficiency by 23.4% on average for simulation logs, and by 84.25% on average for real event logs. It is concluded that compared with other filtering methods, the proposed chaotic activity filtering methods have higher accuracy and can effectively improve the time performance of chaotic activity filtering. Therefore, the chaotic activity filtering method proposed in this paper can balance the accuracy and time performance, and can ensure the integrity of the filtered event log to a certain extent.

VINST is a system used to record all activities related to the incident and problem management in Volvo IT Belgium. In this VINST system, activities recorded in several attributes, such as serial number, change date and time, status, and any other attributes needed, which is stored in the event log. In these sequenced activities, there are some specific knowledge that is not explicitly described in the event log. To find some of the necessary knowledge, this study extracts knowledge from the event log, by using process mining. Heuristic miner algorithm was implemented in this study, because this algorithm has advantages compared to other methods, such as the ability to calculate the frequency of the process, to handle noise, and to combine the frequency between events and trace in the event log to build a process model. The steps being taken in this study began with the discovery process, followed by conformance checking, and completed with process model extension in enhancement step, which was finding knowledge based on analysing process model and event log. This study was using a specifically designed program to achieve the goals of this study. This study used VINST incident records with 149 cases consisting of 2.771 events. By applying heuristics miner, a process model discovered with precision, recall, and f-measure more than 96%. Knowledge gained from this process model extension were the analysis of time and organizational perspectives in forms of timestamp-impact attribute relation and originator-impact attribute relation.

The current business environment has no room for inefficiency as it can cause companies to lose out to their competitors, to lose customer trust, and to experience cost overruns. Business processes within the company continue to grow and cause them to run more complex. The large scale and complexity of business processes pose a challenge in improving the quality of process model because the effectiveness of time and the efficiency of existing resources are the biggest challenges. In the context of optimizing business processes with a process mining approach, most current process models are optimized with a trace clustering approach to explore the model and to perform analysis on the resulting process model. Meanwhile, in the event log data, not only the activities but also the other resources, such as records of employee or staff working time, process service time, and processing costs, are recorded. This article proposes a mechanism alternative to optimize business processes by exploring the resources that occur in the process. The mechanism is carried out in three stages. The first stage is optimizing the job shop scheduling method from the generated event log. Scheduling the time becomes a problem in the job shop. Utilizing the right time can increase the effectiveness of performance in order to reduce costs. Scheduling can be defined as the allocation of multiple jobs in a series of machines, in which each machine only does one job at a time. In general, scheduling becomes a problem when sequencing the operations and allocating them into specific time slots without prolonging the technical and capacity constraints. The second stage is generating the resource value that is recorded in the event log from the results of analysis of the previous stage, namely, job shop scheduling. The resource values are multivariate and then clustered to determine homogeneous clusters. The last stage is optimizing the nonlinear multipolynomials in the homogeneous cluster formed by using the Hessian solution. The results obtained are analyzed to get recommendations on business processes that are appropriate for the company’s needs. The impact of long waiting times will increase service costs, but by improving workload, costs can be reduced. The process model and the value of service costs resulting from the mechanism in the research can be a reference for process owners in evaluating and improving ongoing processes.

The text highlights the challenges of analyzing massive amounts of data, particularly in the context of business processes using process mining. Outliers or irregular behavior in the data can negatively impact processing and clutter process models, leading to less useful paths. The objective is to automatically extract process models from the data, and an automated method for removing irregular behavior from event logs is introduced. This method significantly improves the quality of identified process models and scales well to large datasets. Since the effectiveness of filtering strategies depends on the event log, users can interactively filter activities and directly view the filtered process model from the event log using a slider-based approach. Ultimately, the choice of included activities is left to the user. The method is tested using actual occurrence log collections from enterprise process oversight and hospital environments. The results demonstrate that the newly proposed activity filtering approaches yield process models that are more behaviorally specific compared to conventional frequency-based filtering methods

Event logs are the primary source of information in process mining. An event log consists of events, each having three mandatory attributes: a case identifier, an activity, and a timestamp. Translucent event logs add a fourth mandatory attribute: enabled activities. These are activities for which execution was possible besides the executed activity. Information on enabled activities can be accessed in task management software, in tasks executed within a desktop environment, or by utilizing domain knowledge. Information on enabled activities is valuable for process discovery and other process mining tasks. For example, utilizing the information when discovering process models from translucent event logs results in more robust and generalizable process models. In recent work, translucent activity relationships were defined, and their application was shown by extending the inductive mining approach. This work extends the defined relationships by also introducing frequencies. As a result, the Inductive Miner—infrequent can be extended. Hence, it is possible to use these relationships in the presence of noise in the recorded event logs. We introduce three translucent variants for the Inductive Miner—infrequent, each using translucent activity relationships at different points. Moreover, we allow for different graphs when fall-throughs within the Inductive Miner occur. Using artificial and enriched real-life event logs, we show that considering these relationships, more data-specific process models that still have desired generalization capabilities can be discovered.

The completeness of event logs and long-distance dependencies are two major challenges for process mining. Until now, most process mining methods have not been able to discover long-distance dependency and assume that the directly-follows relationship in the log is complete. However, due to the existence of high concurrency and the cycle, it is difficult to guarantee that the real-life log is complete regarding the directly-follows relationship. Therefore, process mining needs to be able to deal with incompleteness. In this paper, we propose a method for discovering process models including sequential, exclusive, concurrent, and cyclic structures from incomplete event logs. The method analyzes the co-occurrence class of the log and the model and then uses the technology of combining the behavior profile and co-occurrence class to obtain the communication behavior profile of the co-occurrence class. Furthermore, a method of constructing a substructure from the event log using the co-occurrence class is presented. Finally, the whole process model is built by combining those substructures. The experimental results show that the proposed method can discover process models with complex structures involving cycles from incomplete event logs and also can deal with long-distance dependency in the event log. Meanwhile, the discovered process model has a good degree of consistency with the original model.