Initial Framework for Software Quality Evaluation Based on ISO/IEC 25022 and ISO/IEC 25023

Software stakeholders, including developers, managers, and end users, require high quality software products. Several works have aimed to identify software quality, but the quality of software products is often not comprehensively, specifically, or effectively defined because previous approaches have focused on certain quality aspects. Moreover, the evaluation results of quality metrics often depend on software stakeholders so that it is often hard to compare quality evaluation results across software products. ISO/IEC has tried to define evaluation methods for the quality of software products and provide common standards, called the SQuaRE (Systems and software Quality Requirements and Evaluation) series including ISO/IEC 25022:2016 and ISO/IEC 25023:2016. However, the SQuaRE series include ambiguous metrics so that it is not always easy to apply the series to products and compare results. In this paper, we propose a SQuaRE-based software quality evaluation framework, which successfully concretized many product metrics and quality in use metrics originally defined in the SQuaRE series1. Through a case study targeting a commercial software product, we confirmed that our framework is concretely applicable to the software package/service product.

У статті розкриваються погляди на методологію та порядок оцінювання спеціального програмного забезпечення з урахуванням вимог Національних стандартів України ДСТУ ISO/ІЕС 25010:2016 (ISO/ІЕС 25010:2011, IDT). “Інженерія систем і програмних засобів. Вимоги до якості систем і програмних засобів та її оцінювання. Моделі якості системи та програмних засобівˮ та ДСТУ ІS0/ІЕС 9126-1:2013 (ІS0/ІЕС 9126 1:2001, IDТ). “Програмна інженерія. Якість продукту. Частина 1. Модель якостіˮ. Як приклад розглядається перевірка якості спеціального програмного забезпечення для управління військами.

The database of the automated control system is an artificial functioning object that provides information services. The process of database functioning occurs with some finite efficiency. To improve the information support of the automated system, it is necessary to obtain an accurate assessment of the efficiency of the basis – the database. Modern approaches to assessing the quality of databases based on the standards ISO / IEC 25012: 2008 "Software engineering – Software product. Quality Requirements and Evaluation (SQuaRE) – Data quality model" and ISO / IEC 25024: 2015 "Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – Measurement of data quality" do not provide the ability to obtain objective numerical estimates. There is a contradiction between the need to obtain accurate estimates of the intensity of significant properties of the database and the available tools for solving this problem. Purpose. Development of a template of a parametric database model suitable for forming a list of operational and technical requirements for a database in the process of assessing the effectiveness of its functioning for its intended purpose. Results. A list of significant operational, result and resource properties of a typical database of an automated control system for a complex organizational and technical object has been formulated, using the example of a spacecraft flight control center (MCC). Measurable parameters of database functioning as an artificial object implementing a targeted process of satisfying the information needs of users (applied processes) have been put forward. Proposals have been developed for the structures of convolution of measurable parameters of database functioning, presented in the form of oriented graphs. Interpretations have been developed for formulating private indicators of the effectiveness of the functioning of the automated control system database. A methodological basis has been created for developing procedures for assessing the effectiveness of the database. Practical significance. A set of structural models of private performance indicators of the functioning of the database of an automated control system for an organizational and technical object, provided with measurable parameters, has been developed to form procedures for assessing the effectiveness of its functioning in the task of improving the management cycle.

As software systems continue to grow more complex, evaluating software quality becomes increasingly critical. This study analyzes existing software quality models, including McCall, Boehm, FURPS, and ISO Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE), with a specific focus on the ISO/IEC 25010:2023 standard. The research aims to assess the completeness of these models and explore interdependencies among key quality attributes relevant to software requirements engineering. The paper identifies key characteristics and associated metrics based on ISO/IEC standards using comparative analysis and a literature review. Findings show that ISO/IEC 25010:2023 provides the most comprehensive structure, with Functional Suitability and Compatibility identified as essential due to their universally recommended metrics. Survey data from 328 practicing analysts in Ukraine and internationally demonstrate a gap between theoretical models and real-world requirements documentation practices, particularly for non-functional requirements. The identified dependencies between quality attributes enable a more integrated and structured approach to identifying and analyzing non-functional requirements in IT projects. The study emphasizes that software quality models must be tailored to project-specific goals and constraints, with attention to trade-offs and stakeholder needs during the requirements specification, prioritization, and validation processes. The findings support the adaptation of quality models to specific project constraints and emphasize the business analyst’s role in tailoring quality criteria for practical use in software development.

System and software quality evaluation is an important method of quality assurance, and its standardization provides quality requirements and evaluation supported by quality measurement. ISO/IEC organizations have also published a series of standards on system and software quality requirements and evaluation, which is significant for assuring the quality of system and software. This paper introduces quality evaluation based on SQuaRE series standards, and analyzes the relationships among quality model, measurement, requirements, evaluation. Besides, considerations and suggestions are given when applying the measurement function to quality evaluation. Finally, comparison with different methods of quantifying quality characteristics and sub-characteristics with the measured values is analyzed.

Systems and software engineering. Systems and software Quality Requirements and Evaluation (SQuaRE). Guide to SQuaRE

This paper discussed the development of an Online Support Management System to have a centralized system to support the information technology needs of every department of the University of Antique, in effect, to support the needs of the students. The system was developed using the modified Software Development Life Cycle Waterfall Model using six phases – Conceptualization, Technical Feasibility, Development, Pilot Testing, Creation of User’s manual, and Evaluation of Online Support Management System. Each phase must be completed before the next phase can begin and there is no overlapping in the phases. The researcher anchors the study on Research and Development (R&D) which aims to create a new body of knowledge about existing products or processes, or the creation of an entirely new product. Unstructured interviews, document analysis, and modified survey-questionnaire adapted from ISO/IEC 25010: 2011 Systems and Software Quality Requirements and Evaluation (SQuaRE) - System and software quality models had been conducted for data collection. The findings showed that three groups of the respondents were satisfied with the features and capabilities of the Online Support Management System and complied with the requirements or specifications based on ISO/IEC 25010: 2011 standards. Though the respondents are satisfied with their evaluation of the developed Online Support Management System, the result revealed that there was a significant difference noted in the evaluations of the respondents. This result implies that the evaluation made by the three groups of respondents significantly differs from one another in terms of functional suitability, performance efficiency, compatibility, usability, reliability, security, and maintainability.

Microservice architecture (MSA) is a type of software and systems architecture that is based on the modularization principle. It proposes designing systems employing small-scaled, loosely coupled, and independently deployable microservices. There are several benefits of microservices architecture in terms of maintainability, scalability, and productivity which have led to rise in its popularity. Even though there are several studies about development in MSA, the studies on the quality of the microservice-based systems are limited. In this study, we propose a quality model based on fuzzy logic to measure and assess quality attributes of systems in MSA that can be used by software architects, developers, and project managers. We focus on maintainability of microservices because it is one of the most important quality attributes of software systems. We identified sub-characteristics and properties of microservices that affect maintainability, and constructed a hierarchical quality model based on ISO/IEC 250xy standard SQuaRE (System and Software Quality Requirements and Evaluation). Our fuzzy model measures maintainability of microservices in three levels, i.e., low, medium, and high. We provided a basis for the development and application of quality models in industrial practice as well as a basis for further extension. To demonstrate and evaluate our methodology, we used open-source applications designed in MSA. The results show that our method can assess maintainability of microservices realistically.

Fire safety in remote and geographically isolated regions, such as Bantayan Island, is chronically hindered by fragmented infrastructure, delayed emergency response cycles, and a systemic lack of accessible fire safety education. These vulnerabilities often transform manageable incidents into large-scale disasters. This study introduces the Bantayan Online Fire Report System, a comprehensive web and mobile-based ecosystem engineered to bridge the critical communication gap between residents and emergency personnel. The development process was strictly guided by the ISO/IEC 25010:2011 Systems and Software Quality Requirements and Evaluation (SQuaRE) model, ensuring the platform met rigorous standards for functional suitability, reliability, and the security. The system architecture integrates a centralized administrative dashboard for real-time resource mapping, automated push notifications for rapid dissemination of safety protocols, and a lightweight mobile interface optimized for low-bandwidth environments common in rural areas. By digitizing the reporting pipeline, the platform replaces traditional, high-latency communication methods with instantaneous data transmission and GPS-enabled location tracking. Initial pilot testing and empirical evaluations demonstrated a significant reduction in incident-to-response latency and a measurable increase in community disaster awareness. The system was appraised through usability testing, where it achieved high scores in learnability and user satisfaction among both local authorities and residents. These findings underscore the transformative potential of localized digital interventions in overcoming logistical barriers in underserved communities. Ultimately, the Bantayan Online Fire Report System serves as a scalable prototype for enhancing disaster resilience, proving that integrating technology with civic participation can effectively mitigate fire-related risks and safeguard human life in the remote Maritime Provinces.

This article describes empirical research results regarding the "history effect" in software quality evaluation processes. Most software quality models and evaluation processes models assume that software quality may be deterministically evaluated, especially when it is evaluated by experts. Consequently, software developers focus on the technical characteristics of the software product. A similar assumption is common in most engineering disciplines. However, in regard to other kinds of goods, direct violations of the assumption about objective evaluation were shown to be affected by the consequences of cognitive processes limitations. Ongoing discussion in the area of behavioral economics raises the question: are the experts prone to observation biases? If they are, then software quality models overlook an important aspect of software quality evaluation. This article proposes an experiment that aims to trace the influence of users' knowledge on software quality assessment. Measuring the influence of single variables for the software quality perception process is a complex task. There is no valid quality model for the precise measurement of product quality, and consequently software engineering does not have tools to freely manipulate the quality level for a product. This article proposes a simplified method to manipulate the observed quality level, thereby making it possible to conduct research. The proposed experiment has been conducted among professional software evaluators. The results show the significant negative influence (large effect size) of negative experience of users on final opinion about software quality regardless of its actual level.

Software quality has become a critical and essential aspect in the success of many software companies and products. Since 1970, a number of software quality models have been proposed to evaluate the quality of general and specific domains of software products. These models suffer from the ambiguity of relationships among quality characteristics, sub characteristics and quality measures: there is no clear definition, rule or procedure on how the quality sub characteristics are derived from the main characteristics, how the quality measures could be identified and associated with quality characteristics and sub characteristics and how those could be validated. This study proposes a set of rules for the development and evaluation of software quality models.KeywordsSoftware qualityQuality measuresQuality modelsModel rules

With new global demands for better quality of software products, effective and efficient SQE (Software Quality Evaluation) becomes necessary and indispensible. Existing methods of SQE are as it is, however, subjective, non-quantitative and uncompleted to some extent. In this paper, we introduce a novel method, an improved AHPM (Analytic Hierarchy Process Model) incorporated traditional AHPM and some quality characteristics from ISO/IEC 9126, which attempts to propose a better method of software quality evaluation that is relatively objective, quantitative and completed. On this basis, current software can be well assessed as well as future products can be well predicted.

To assist personalized healthcare of elderly people, our interest is to develop a virtual caregiver system that retrieves the expression of mental and physical health states through human–computer interaction in the form of dialogue. The purpose of this paper is to implement and evaluate a virtual caregiver system using mobile chatbot. Unlike the conventional health monitoring approach, our key idea is to integrate a rule-based virtual caregiver system (called “Mind Monitoring” service) with the physical, mental, and social questionnaires into the mobile chat application. The elderly person receives one question from the mobile chatbot per day, and answers it by pushing the optional button or using a speech recognition technique. Furthermore, a novel method is implemented to quantify the answers, generate visual graphs, and send the corresponding summaries or advice to the specific elder. In the experimental evaluation, we applied it to eight elderly subjects and 19 younger subjects within 14 months. As main results, its effects were significantly improved by the proposed method, including the above 80% in the response rate, the accurate reflection of their real lives from the responses, and high usefulness of the feedback messages with software quality requirements and evaluation. We also conducted interviews with subjects for health analysis and improvement.

The goal of any automatic process is to run without human intervention. However, it is not uncommon that unexpected issues recur, requiring repetitive human intervention in order to processes execute successfully. Such situations indicate that those processes were not designed with the necessary quality requirements to achieve the automation goal, and quality needs to be improved. This paper describes a case study of the quality improvements of several automatic ETL processes that required a growing amount of effort to ensure its successful execution. Key to the improvement process was the use of the ISO/IEC 25010 Standard for Systems and Software Quality Requirements and Evaluation to categorize all issues found. This approach proved beneficial in two important ways: first, it created a clear understanding of the overall ETL processes quality problems, second, it made obvious which issues deserved uttermost attention.

Management of child health care can be negatively affected by incomplete recording, low data quality, and lack of data integration of health management information systems to support decision making and public health program needs. Given the importance of identifying key determinants of child health via capturing and integrating accurate and high-quality information, we aim to address this gap through the development and testing requirements for an integrated child health information system. A five-phase design thinking approach including empathizing, defining, ideation, prototyping, and testing was applied. We employed observations and interviews with the health workers at the primary health care network to identify end-users' challenges and needs using tools in human-centered design and focus group discussion. Then, a potential solution to the identified problems was developed as an integrated maternal and child health information system (IMCHIS) prototype and tested using Software Quality Requirements and Evaluation Model (SQuaRE) ISO/IEC 25000. IMCHIS was developed as a web-based system with 74 data elements and seven maternal and child health care requirements. The requirements of "child disease" with weight (0.26), "child nutrition" with weight (0.20), and "prenatal care" with weight (0.16) acquired the maximum weight coefficient. In the testing phase, the highest score with the weight coefficient of 0.48 and 0.73 was attributed to efficiency and functionality characteristics, focusing on software capability to fulfill the tasks that meet users' needs. Implementing a successful child health care system integrates both maternal and child health care information systems to track the effect of maternal conditions on child health and support managing performance and optimizing service delivery. The highest quality score of IMCHIS in efficiency and functionality characteristics confirms that it owns the capability to identify key determinants of child health.