A Heuristic Method for Large-Scale Cognitive-Diagnostic Computerized Adaptive Testing

Knowledge space theory is a theory that provides a guidelines for human learners` possible education decisions and has been used in various educational environment. However, traditional methodologies using the knowledge space theory have always depended on handwork system and it is necessary to learn programming language such as Visual Basic and R, causing time consuming situations. In order to overcome those issues on the environment of education we propose a new Knowledge Structure Analysis System that not just analyzes learners` knowledge structures automatically but to provide critical learning path for the learners based on knowledge space theory. Proposed system is implemented by using rApache generating critical learning path computing Chi-square value. This provides an automatic way of analyzing knowledge structure in learners` knowledge space and shows systematic reviews for the knowledge space.

A crucial problem in knowledge space theory, a modern psy chological test theory, is the derivation of a realistic knowledge structure representing the organization of knowledge in an information domain and examinee population under reference. Often, one is left with the problem of selecting among candidate competing knowledge structures. This article proposes a measure for the selection among competing knowledge structures. It is derived within an operational framework (prediction paradigm), and is partly based on the unitary method of proportional reduction in predictive error as advocated by the authors Guttman, Goodman, and Kruskal. In particular, this measure is designed to trade off the (descriptive) fit and size of a knowledge structure, which is of high interest in knowledge space theory. The proposed approach is compared with the Correlational Agreement Coef ficient, which has been recently discussed for the selection among competing surmise relations. Their performances as selection measures are compared in a simulation study using the fundamental basic local independence model in knowledge space theory

The knowledge space theory can better understand the knowledge concept and its internal connection by analyzing and understanding the connection and combination of knowledge concepts. A personalized learning resource recommendation framework based on knowledge space theory is designed to help students better understand and master subject knowledge in this paper. The framework mainly includes the following three steps: firstly, analyze the students' learning behavior, and establish the student knowledge space model; secondly, establish the subject knowledge space model by analyzing the structure and relationship of subject knowledge; finally, according to the student's The knowledge space model and subject knowledge space model design personalized learning resource recommendation algorithms to provide students with the most suitable learning resources. Experiments are conducted to verify the validity and feasibility of the framework, as well as its impact on student learning outcomes.

In the early eighties of the last century three theories were independently developed in the fields of information science, mathematical psychology and cognitive psychology. In 1982 Rudolph Wille conceptualized a principled way of deriving a concept hierarchy from a collection of objects and their properties: the Formal Concept Analysis. Such representation draws upon the order theory developed in 1937 by Birkhoff about the one-to-one correspondence between distributive lattices and partial orders. In 1985 Jean Claude Falmagne and Jean-Paul Doignon, starting from Birkhoff’s theorem, developed a theory to represent the prerequisite relations among sets of problems in the field of knowledge assessment: The Knowledge Space Theory. In 1983 Kikumi Tatsuoka introduced the concept of a Q-Matrix defining the basis for the development of a skill based way for cognitive diagnosis: The Cognitive Diagnostic Models. It is an interesting issue how, so far, only few attempts to highlight similarities among these theories have been carried out. This research is aimed at pinpointing some of the main deterministic and probabilistic concepts that, even if named differently, are shared by the three theories.

The present work explores the connections between cognitive diagnostic models (CDM) and knowledge space theory (KST) and shows that these two quite distinct approaches overlap. It is proved that in fact the Multiple Strategy DINA (Deterministic Input Noisy AND-gate) model and the CBLIM, a competence-based extension of the basic local independence model (BLIM), are equivalent. To demonstrate the benefits that arise from integrating the two theoretical perspectives, it is shown that a fairly complete picture on the identifiability of these models emerges by combining results from both camps. The impact of the results is illustrated by an empirical example, and topics for further research are pointed out.

Knowledge space theory is part of psychometrics and provides a theoretical framework for the modeling, assessment, and training of knowledge. It utilizes the idea that some pieces of knowledge may imply others, and is based on order and set theory. We introduce the R package <b>DAKS</b> for performing basic and advanced operations in knowledge space theory. This package implements three inductive item tree analysis algorithms for deriving quasi orders from binary data, the original, corrected, and minimized corrected algorithms, in sample as well as population quantities. It provides functions for computing population and estimated asymptotic variances of and one and two sample Z tests for the diff fit measures, and for switching between test item and knowledge state representations. Other features are a function for computing response pattern and knowledge state frequencies, a data (based on a finite mixture latent variable model) and quasi order simulation tool, and a Hasse diagram drawing device. We describe the functions of the package and demonstrate their usage by real and simulated data examples.

Learning, forgetting, and the correlation of knowledge in knowledge space theory

Knowledge Spaces

Automata for knowledge assessment based on the structure of observed learning outcome taxonomy

We report a comparative study using knowledge space theory (KST) to assess the impact of a hands-on laboratory exercise that used molecular model kits to emphasize the connections between a plane of symmetry, chirality, and isomerism in an introductory organic chemistry course. The experimental design compared three groups of students-two that carried out the laboratory exercise (treatment groups) and one that did not (control group). Our assessments revealed that all three groups made significant improvements in their understanding of chirality and isomerism, but that the two treatment groups showed more improvements than the control group. The KST analysis showed that the acquisition of the skills for finding a plane of symmetry in a molecule came late in the students' critical learning pathways, which indicated that this was difficult for many students. Students were unfamiliar with this type of reasoning, and our studies revealed that the laboratory exercise was useful in teaching the method to introductory organic chemistry students.

In this paper, an automatic lesson generation system is presented which is suitable in a learning-by-mimicking scenario where the learning objects can be represented as multiattribute time series data. The dance is used as an example in this paper to illustrate the idea. Given a dance motion sequence as the input, the proposed lesson generation system automatically generates the lesson plan for students. It first extracts patterns from the input dance sequence to form the learning objects. The prerequisite structure is then built by considering the relations between the learning objects. Afterward the knowledge structure is constructed from the prerequisite structure based on the knowledge space theory. Finally, the learning path is derived according to an easy-to-complex manner while respecting the prerequisite relations. A user study that involved 40 students was conducted to evaluate the proposed work. The average learning time required for the treatment group (learning with the proposed system) was found to be lower than that of the control group (learning by free browsing) thus demonstrating the learning efficiency of the proposed system. The feedback from the questionnaires indicated that a majority of the subjects showed positive response toward the usefulness and rationality of our proposed system.

BLIM’s identifiability and parameter invariance under backward and forward transformations

The authors investigate the relationship between student learning choices and learning styles in the use of an innovative learning environment for statistics. For teaching introductory statistics to first-year students in economics and business, Maastricht University uses a blended learning environment. It allows students to individualize learning by attuning the available learning tools to their personal preferences. The blended learning environment consists of tutorials focused on problem-based learning, lectures, independent learning and an electronic learning environment (ALEKS) based on knowledge space theory. The paper examines the intensity of use of ALEKS and investigates the relationship between this and student learning dispositions in a correlational study. Data from around 4,650 students are used. The findings suggest that less academically-inclined students, such as those with ‘surface’ approaches to learning, profit most from the availability of e-learning tools.

In this paper we explain how a systematic approach to design Assessment as a Service on a cloud with SOA architecture can exploit add on functionalities like online learning with interactive assessment as a type of formative and integrative assessment for the learning process. The idea is realized by a system (computer based program) that systematically asks questions and leads the students towards knowledge construction and discovery. The system should be as simple as possible and intelligent enough to enable the realization of this idea. This online learning tool with adaptive testing uses software agents, where several strategies define the agent’s behavior. We observed that the strategy “3 correct answers in a row” performs the best.KeywordsE-testingE-learningComputer based testing

Background &amp; Problem Statement - Software testing is a critical phase in the software development lifecycle (SDLC), ensuring that applications function correctly, meet user requirements, and maintain high- quality standards. Traditional software testing approaches, including manual testing and rule-based automation, often face challenges in scalability, efficiency, and adaptability to dynamic software environments. Traditional testing methods are overwhelmed by complex software systems which slows down defect detection and extends both testing costs and release schedules. Machine Learning (ML) has emerged as a transformative solution, introducing predictive and adaptive capabilities that optimize test case selection, automate defect detection, and enhance overall software quality assurance (QA). This study explores the integration of ML in software testing, addressing the challenges of traditional QA methodologies and demonstrating how AI-driven frameworks improve testing efficiency. Methodology - To investigate the impact of ML in software testing, this research adopts a systematic approach by analyzing ML-driven test automation techniques, including predictive testing, adaptive test execution, and automated test case generation. Research reviews how Google Microsoft Facebook IBM and Deep Code put ML-based quality assurance frameworks into operation. The study leverages supervised learning, reinforcement learning, deep learning, and NLP-based techniques to demonstrate how ML models predict software defects, dynamically adapt test cases, and optimize testing resources. The research tests how ML-based testing models operate within CI/CD pipelines to improve ongoing testing and deployment flow. Analysis &amp; Results - The analysis of ML-driven software testing reveals that predictive analytics improves early defect detection rates. It helps developers spend 37% less time debugging their work. Adaptive testing models, including self-healing test scripts, minimize maintenance costs by 50% and enhance test reliability in agile environments. The integration of NLP-based test case generation increases test coverage. NLP technology enables automatic connection between requirements and test cases at 89% success rate. Additionally, reinforcement learning techniques improve test case selection, reducing redundant test executions by 43%. Our research shows different ML methods work well to lessen incorrect error alerts. ML integration for QA surely increasing defect prediction accuracy and optimizing test execution time. Findings &amp; Contributions - This research contributes to the field of AI-driven software testing by providing a comprehensive framework for ML-based QA methodologies. Our study shows that machine learning helps find more software problems better adapts test cases and lowers testing expenses to solve present software development needs. The study also identifies critical challenges, including data availability, model interpretability, and computational overhead, suggesting future research directions in Explainable AI (XAI), hybrid AI-ML testing models, and AI-driven security testing. As the industry moves toward AI-first software testing, this research paves the way for fully autonomous QA frameworks, enabling intelligent, scalable, and cost- effective software validation techniques. Keywords - Machine Learning, Software Testing, Quality Assurance, Predictive Testing, Adaptive Testing, Test Automation, Defect Prediction, Self- Healing Test Scripts, AI-Driven QA, Reinforcement