Web Application fact extractor (WAFE)

A relevant consequence of the expansion of the web and e-commerce is the growth of the demand of new web sites and web applications. As a result, web sites and applications are usually developed without a formalized process, and web pages are directly coded in an incremental way, where new pages are obtained by duplicating existing ones. Duplicated web pages, having the same structure and just differing for the data they include, can be considered as clones. The identification of clones may reduce the effort devoted to test, maintain and evolve web sites and applications. Moreover, clone detection among different web sites aims to detect cases of possible plagiarism. In this paper we propose an approach. based on similarity metrics, to detect duplicated pages in web sites and applications, implemented with HTML language and ASP technology. The proposed approach has been assessed by analyzing several web sites and Web applications. The obtained results are reported in the paper with respect to some case studies.

An unlimited keyboard support is one of the main accessibility requirements for web pages and web applications. But it is not sufficient that the user can perform all actions on the page using the keyboard. In addition designers of web sites or web applications have to make sure that keyboard users can use their pages with acceptable performance. We present GOMS models for mouse and keyboard navigation in web pages and web applications. These models can be used to compare keyboard navigation with mouse navigation. Such a comparison allows us to decide if the amount of keyboard support for a web page or web application is sufficient or if there is an unacceptable disadvantage for keyboard users.

It is possible to create interactive, responsive web applications that allow user-generated contributions. However, the relevant technologies have to be explicitly deployed by the authors of the web pages. In this work we present the concept of parasitic and symbiotic web applications which can be deployed on arbitrary web pages by means of a proxy-based application platform. Such applications are capable of inserting, editing and deleting the content of web pages. We use an HTTP proxy in order to insert JavaScript code on each web page that is delivered from the web server to the browser. Additionally we use a database server hosting user-generated scripts as well as high-level APIs allowing for implementing customized web applications. Our approach is capable of cooperating with existing web pages by using shared standards (e.g. formatting of the structure on DOM level) and common APIs but also allows for user-generated (parasitic) applications on arbitrary web pages without the need for cooperation by the page owner.

Software testing is indispensable to assure software quality. Traditional software testing techniques are insufficient for modern web applications due to their unique characteristics, such as highly dynamic generation of web pages and interactions with DOM elements. Meanwhile, existing web testing techniques are cumbersome to use in long-term maintenance and evolution because the tests are often brittle in the presence of fast changes to web pages. In this paper, we propose an automatic test generation technique for dynamic web applications. Our technique effectively decouples test code from web pages by automatically generating page objects. Based on page objects, our technique performs iterative feedback directed random test generation. Our evaluation on seven real-world web applications demonstrates that the proposed technique achieves reasonable code coverage (from 23.3% to 90.8%) and can effectively explore dynamically generated web pages (around 14.7 times more than the original static web pages), revealing hundreds of HTML issues and five real errors in the applications.

Since the emergence of web 2.0, the architecture of web applications has been transformed significantly and its complexity has grown enormously. In such web applications, the user interface (UI) is an important ingredient and with the increased complexity, its testing is getting increasingly complex and cost/time-consuming process. Recently introduced, interaction flow modeling language (IFML) is an object management group (OMG) standard. IFML is gaining popularity for developing web applications, primarily, because of its excellent features for modeling UI elements, their content, and their interaction capturing capabilities. However, despite its superior UI modeling features, its UI testing is accomplished through traditional time-consuming techniques, which are employed after implementing the UI code. Hence, to overcome these limitations, this paper introduces a novel model-based testing approach for IFML UI elements. The proposed approach provides complete navigation testing using formal models. Moreover, the approach transforms the IFML models to all necessary UI testing artifacts by generating state transition matrix plus detailed UI test case document. As a part of a research, model-based user interface test case (MBUITC) generator tool is implemented to automatically generate navigation model for formal verification, test case document, and transition matrices from IFML models. The applicability of the proposed approach is validated through two benchmark case studies. The results have shown that the proposed approach provides test cases at the early stages of development, i.e., specification and analysis, which eventually helps in building a right product at the right time at a comparatively lower cost.

With conventional regression test tools for Web applications, it is difficult to specify the values to be verified that are repeated output inside loop statements. We need to select each of these values displayed in Web pages with the mouse. This paper presents a method that automates regression testing of Web applications on the server side. This method makes it easy to specify values to be verified and enables us to specify them when we develop Web applications. We can directly check the verification results on the Web pages that are shown in the Web browser. If we find a fault, we can even directly modify a part of the server program in the Web browser that corresponds to the currently displayed Web page.

WebWriter: A browser-based editor for constructing Web applications

It is desirable for web applications to be reusable, for example in case a vendor wants to deliver new valuable services by using and combining existing applications quickly. One of the well-known ways of reusing web applications, Mashup, has become popular in the web development community and applied to many open web sites, as we can just combine the data retrieved from Web pages or APIs of the web applications. But in the case of the Mashup of enterprise web applications, or Enterprise Mashup, it is quite difficult since these applications are often not intended to be reusable and have no Web APIs. That means we have to create the Web APIs for the applications, which takes much work. In this paper, we describe a light-weight Web API creation methodology in order to create Web APIs for enterprise web applications much more easily than we can by extending the source code. The created Web API can connect to the web application just as a client who has an account does. So we can create a Web API for Enterprise Mashup without modifying the application at all and we can call the Web API securely using the user account information of the application. We developed the implementation of our methodology and applied it to actual applications to evaluate its effectiveness.

With the advent of web 2.0, web application architectures have been evolved, and their complexity has grown enormously. Due to the complexity, testing of web applications is getting time-consuming and intensive process. In today’s web applications, users can achieve the same goal by performing different actions. To ensure that the entire system is safe and robust, developers try to test all possible user action sequences in the testing phase. Since the space of all the possibilities is enormous, covering all user action sequences can be impossible. To automate the test script generation task and reduce the space of the possible user action sequences, we propose a novel method based on long short-term memory (LSTM) network for generating test scripts from user clickstream data. The experiment results clearly show that generated hidden test sequences are user-like sequences, and the process of generating test scripts with the proposed model is less time-consuming than writing them manually.

Traditional Web application category recognition is implemented by fingerprint rule matching, which is difficult to extract fingerprint rules and has limited coverage. At present, many improved identification methods semi-automatically extract fingerprints through certain rules and identify Web application categories through clustering or classification algorithms, but still rely on fingerprint rules and human intervention, and the time complexity of classification is too high to process a large amount of data. This paper proposes Multi-layer Simhash Algorithm and combines DBSCAN clustering to realize intelligent identification of Web application types, pioneering the complete automation of fingerprint identification of Web applications. This method has the function of discovering unknown Web applications and predicting unknown application types, and solves the problems of fingerprint rule extraction and manual dependence of Web applications. This paper through the TF-IDF algorithm to extract the Web page text key words and weight, Then, Multi-layer Simhash Algorithm is used to transform text feature words and weights into binary characteristic hash value, at last, the hamming distance between the input Web page and the characteristic hash value of the known category is compared with the radius of the base class, which determines the category of the input Web application. The experimental results show that the accuracy of Web application category recognition and prediction is more than 97% and 93% respectively.

The Web represents one of the largest repositories of information ever compiled by mankind and as such search techniques are essential to navigating its depths and returning pertinent information. Typically the search techniques employed in search engines such as Google entail the use of keywords in which Web pages containing the specified keywords are sought out and then ranked using an algorithm such as PageRank. While keywords are suitable for many search tasks, certain types of data cannot be readily searched using keywords alone. Regular expression based pattern matching allows for enhanced search capability in that it allows for a textual pattern to be specified and matching to be performed against the pattern. Regular expressions have been developed that allow for the identification of common C\C++ code structures such a loops, conditionals and functions. These regular expressions are then integrated into a Perl program that performs a keyword based search of the Yahoo Search engine and used to extract any code elements that match those patterns. Thus an algorithm or programming technique can be specified with keywords, the Yahoo search used to identify Web pages pertinent to those keywords, and the regular expressions used to identify and extract any C\C++ code found in the resultant Web pages. Application of this technique would likely be of great benefit towards creating specialized search capabilities for software developers.

Alone with Internet appeared, the web applications have been used in many business areas. But the flexibility, changeful and reuse of web page is always one of core difficult problems to many web designers and developers. Here start at introduction of data-driven method and analysis problems of web pages design and implementations, by research and study on the XML, XSL and MVC technologies, it introduces an XML based data-driven dynamic web page design method and model to provide a dynamic web page generation and then to improve web page reusability, scalability, flexibility, and extensibility. At the end, it demonstrates the implementation with XSL templates.KeywordsXMLData-DrivenWeb PageXSL

Automated testing is important for validating the behavior of programs with complex user interfaces, such as web applications. In the enterprise context, web applications are popular client-server programs that provide rendered web pages as a user front-end, and the business logic is typically implemented on the server-side. In this paper, we present an approach to automatically generate test cases for component-based user interfaces for web applications built on the Java EE platform. We generate a sequence of user actions to navigate through the web application. For each supported user action, we gather constraints from the view template describing the web page (e.g. a button must be enabled in order to be clicked by a user), as well as constraints that are introduced while executing a server-side component. We have implemented our approach in a tool to determine its practical use in an experiment.

The keyboard is the most universally supported input method operable by people with disabilities. Yet, many popular websites lack keyboard accessible mechanism, which could cause failures that make the website unusable. In this paper, we present a novel approach for automatically detecting and localizing keyboard accessibility failures in web applications. Our extensive evaluation of our technique on real world web pages showed that our technique was able to detect keyboard failures in web applications with high precision and recall and was able to accurately identify the underlying elements in the web pages that led to the observed problems.

Data analysis is a data inspecting and transforming process for the purpose of making conclusions and obtaining useful information to help make a decision about disclosed forecasts. There are numerous technologies and methods for analyzing data that are mainly determined by the type of data.The paper presents models for organizing web applications' data based on the integrated use of structured data from databases of web applications and unstructured data derived from web pages and server log files. Bu studying the many existing approaches to data analysis from web applications, a summary of the process of data analysis from web applications has been made. An example of using this approach in e-commerce applications is given. The software tools that can be used to perform analyses have been pointed out.