• Home
  • Search
  • A Threshold Selection Method in Code Plagiarism Checking Function for Code Writing Problem in Java Programming Learning Assistant System Considering AI-Generated Codes
  • https://doi.org/10.3390/analytics5010002Copy DOI Icon

A Threshold Selection Method in Code Plagiarism Checking Function for Code Writing Problem in Java Programming Learning Assistant System Considering AI-Generated Codes

  • Dec 26, 2025
  • Analytics
  • Perwira Annissa Dyah Permatasari +6 more
Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Similar Papers
Abstract

To support novice learners, the Java programming learning assistant system (JPLAS) has been developed with various features. Among them, code writing problem (CWP) assigns writing an answer code that passes a given test code. The correctness of an answer code is validated by running it on JUnit. In previous works, we implemented a code plagiarism checking function that calculates the similarity score for each pair of answer codes based on the Levenshtein distance. When the score is higher than a given threshold, this pair is regarded as plagiarism. However, a method for finding the proper threshold has not been studied. In addition, AI-generated codes have become threats in plagiarism, as AI has grown in popularity, which should be investigated. In this paper, we propose a threshold selection method based on Tukey’s IQR fences. It uses a custom upper threshold derived from the statistical distribution of similarity scores for each assignment. To better accommodate skewed similarity distributions, the method introduces a simple percentile-based adjustment for determining the upper threshold. We also design prompts to generate answer codes using generative AI and apply them to four AI models. For evaluation, we used a total of 745 source codes of two datasets. The first dataset consists of 420 answer codes across 12 CWP instances from 35 first-year undergraduate students in the State Polytechnic of Malang, Indonesia (POLINEMA). The second dataset includes 325 answer codes across five CWP assignments from 65 third-year undergraduate students at Okayama University, Japan. The applications of our proposals found the following: (1) any pair of student codes whose score is higher than the selected threshold has some evidence of plagiarism, (2) some student codes have a higher similarity than the threshold with AI-generated codes, indicating the use of generative AI, and (3) multiple AI models can generate code that resembles student-written code, despite adopting different implementations. The validity of our proposal is confirmed.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations7

Code Plagiarism Checking Function and Its Application for Code Writing Problem in Java Programming Learning Assistant System

  • Jan 17, 2024
  • Analytics
  • Ei Ei Htet +6
  • Conference Article
  • Citations9

An Implementation of Answer Code Validation Program for Code Writing Problem in Java Programming Learning Assistant System

  • Mar 18, 2023
  • Khaing Hsu Wai +5
  • Conference Article
  • Citations4

An Extension of Code Correction Problem for Java Programming Learning Assistant System

  • Mar 28, 2020
  • Nobuo Funabiki +6
  • Conference Article
  • Citations3

A proposal of Javadoc hint function for Java Programming Learning Assistant System

  • Oct 01, 2014
  • Nobuo Funabiki +2
  • Research Article
  • Citations2

An Automatic Code Generation Tool Using Generative Artificial Intelligence for Element Fill-in-the-Blank Problems in a Java Programming Learning Assistant System

  • May 31, 2025
  • Electronics
  • Zihao Zhu +5
  • Conference Article
  • Citations1

Test Code Improvements for Code Writing Problem in Java Programming Assistant System

  • Oct 12, 2021
  • Xiqin Lu +6
  • Conference Article
  • Citations1

File access extension of test code generation tool for Java programming learning assistant system

  • Oct 01, 2017
  • Nobuo Funabiki +3
  • Conference Article
  • Citations9

A Proposal of Test Code Generation Tool for Java Programming Learning Assistant System

  • Mar 01, 2017
  • Nobuo Funabiki +3
  • Conference Article
  • Citations9

An Implementation of Java Programming Learning Assistant System in University Course

  • Mar 18, 2023
  • Xiqin Lu +4
  • Book Chapter

A Proposal of Recommendation Function for Solving Element Fill-in-Blank Problem in Java Programming Learning Assistant System

  • Aug 15, 2019
  • Nobuo Funabiki +4
  • PDF
  • Research Article
  • Citations1

A Proposal of Hint Function for Java Programming Learning Assistant System

  • Jan 01, 2023
  • International Journal of Information and Education Technology
  • Yanhui Jing +5
  • Book Chapter

An Improved Informative Test Code Approach for Code Writing Problem in Java Programming Learning Assistant System

  • Jan 01, 2018
  • Nobuo Funabiki +3
  • Research Article

A design-aware test code approach for code writing problem in Java programming learning assistant system

  • Jan 01, 2017
  • International Journal of Space-Based and Situated Computing
  • Nobuo Funabiki +1
  • Research Article
  • Citations3

A design-aware test code approach for code writing problem in Java programming learning assistant system

  • Jan 01, 2017
  • International Journal of Space-Based and Situated Computing
  • Khin Khin Zaw +1
  • Conference Article
  • Citations1

Software Quality Metrics Calculations for Java Programming Learning Assistant System

  • Feb 01, 2020
  • Khin Khin Zaw +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.