• Home
  • Search
  • Improving course evaluation processes in higher education institutions: a modular system approach
  • https://doi.org/10.7717/peerj-cs.3110Copy DOI Icon

Improving course evaluation processes in higher education institutions: a modular system approach

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Course and instructor evaluations (CIE) are essential tools for assessing educational quality in higher education. However, traditional CIE systems often suffer from inconsistencies between structured responses and open-ended feedback, leading to unreliable insights and increased administrative workload. This study suggests a modular system to address these challenges, leveraging sentiment analysis and inconsistency detection to enhance the reliability and efficiency of CIE processes.BackgroundImproving the reliability of CIE data is crucial for informed decision-making in higher education. Existing methods fail to address discrepancies between numerical scores and textual feedback, resulting in misleading evaluations. This study proposes a system to identify and exclude inconsistent data, providing more reliable insights.MethodsUsing the Design Science Research Methodology (DSRM), a system architecture was developed with five modules: data collection, preprocessing, sentiment analysis, inconsistency detection, and reporting. A dataset of 13,651 anonymized Turkish CIE records was used to train and evaluate machine learning algorithms, including support vector machines, naive Bayes, random forest, decision trees, K-nearest neighbors, and OpenAI’s GPT-4 Turbo Preview model. Sentiment analysis results from open-ended responses were compared with structured responses to identify inconsistencies.ResultsThe GPT-4 Turbo Preview model outperformed traditional algorithms, achieving 85% accuracy, 88% precision, and 95% recall. Analysis of a prototype system applied to 431 CIEs identified a 37% inconsistency rate. By excluding inconsistent data, the system generated reliable reports with actionable insights for course and instructor performance. The purpose of this study is to design and evaluate a new system using the Design Science Research (DSR) approach to enhance the accuracy and reliability of course evaluation processes employed in higher education institutions. The modular system effectively addresses inconsistencies in CIE processes, offering a scalable and adaptable solution for higher education institutions. By integrating advanced machine learning techniques, the system enhances the accuracy and reliability of evaluation reports, supporting data-driven decision-making. Future work will focus on refining sentiment analysis for neutral comments and broadening the system’s applicability to diverse educational contexts. This innovative approach represents a significant advancement in leveraging technology to improve educational quality.

Similar Papers
  • PDF
  • Research Article
  • Citations2

Innovative aspects of enhancement of management processes in the higher educational institution on the basis of application of modern information and communication technologies

  • Jan 01, 2016
  • Open Education
  • I E Zhukovskya
  • Research Article
  • Citations1

DIDACTIC TERMS OF USE OF BIOGRAPH INFINITI SPECIALIZED SOFTWARE IN UKRAINE’S HIGHER EDUCATION INSTITUTIONS

  • Apr 30, 2023
  • Information Technologies and Learning Tools
  • Olha M Lunhol +3
  • PDF
  • Research Article

Implementation of Quality Control of the Educational Process in Higher Education Institutions Based on Models

  • Dec 17, 2022
  • Journal of Curriculum and Teaching
  • Ihor Kolodii +4
  • Research Article
  • Citations8

Supervised learning using support vector machine applied to sentiment analysis of teacher performance satisfaction

  • Oct 01, 2022
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Omar Chamorro-Atalaya +6
  • PDF
  • Research Article
  • Citations1

PROVIDING THE INNOVATIVE PEDAGOGICAL PROCESS IN HIGHER EDUCATION INSTITUTIONS: THE REQUIREMENT OF TIME

  • May 31, 2022
  • Scientific Bulletin of Uzhhorod University. Series: «Pedagogy. Social Work»
  • Victoriia Savitska +1
  • Research Article
  • Citations7

Enhancing medical radiation science education through a design science research methodology

  • Mar 05, 2021
  • Journal of Medical Imaging and Radiation Sciences
  • Sibusiso Mdletshe +2
  • Research Article

A Framework of IT Governance for Higher Educational Institutions in the Philippines Amid and Beyond COVID-19 Pandemic

  • May 08, 2022
  • International Journal of Emerging Trends in Engineering Research
  • Jessevim R Galeon
  • Research Article

INNOVATIVE TEACHING METHODS IN HIGHER EDUCATION INSTITUTIONS DURING A FULL-SCALE INVASION

  • Jan 01, 2024
  • Bulletin of Taras Shevchenko National University of Kyiv. Social work
  • Tetiana Zakharina
  • Research Article
  • Citations2

Optimization of purchasing business process in Moroccan public universities based on COBIT and artificial intelligence techniques

  • Feb 20, 2023
  • Kybernetes
  • Zakaria Sakyoud +2
  • Research Article

Components of intellectual capital for the research process in higher education institutions

  • Oct 24, 2023
  • Revista de Gestão e Secretariado (Management and Administrative Professional Review)
  • Carlos Vidal Tovar +4
  • Research Article
  • Citations2

DIDACTIC ASPECTS OF DISTANCE LEARNING IN THE CONDITIONS OF PANDEMIC AND MARTIAL LAW

  • Dec 22, 2022
  • Naukovyy Visnyk Dnipropetrovs kogo Derzhavnogo Universytety Vnutrishnikh Sprav
  • Olena Galushko +2
  • Research Article
  • Citations1

Innovative Approaches to the Organization of the Educational Process in the Higher Educational Institutions

  • Oct 19, 2022
  • Journal of Higher Education Theory and Practice
  • Mykhailo Poplavskyi
  • Research Article

GAME TECHNOLOGIES IN THE FORMATION OF READINESS FOR PROFESSIONAL ACTIVITY OF UNIVERSITY TEACHERS

  • Mar 07, 2025
  • Educational Discourse: collection of scientific papers
  • Oleksandra Voinalovych +1
  • Research Article
  • Citations1

АКМЕОЛОГІЧНИЙ ПІДХІД ДО ФОРМУВАННЯ ПРОФЕСІЙНОЇ КОМПЕТЕНТНОСТІ МАЙБУТНІХ ВЧИТЕЛІВ БІОЛОГІЇ

  • Apr 01, 2022
  • Academic Notes Series Pedagogical Science
  • Svitlana Genkal
  • Research Article
  • Citations3

The Role of Student Self-Government in Ensuring the Quality of Higher Education

  • Apr 01, 2021
  • Journal of Vasyl Stefanyk Precarpathian National University
  • Oksana Kondur +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.