• Home
  • Search
  • Quantitative Analysis of Rubric-based Feedback Received From Claude 3.5 Sonnet on Mathematical Programming Problems
  • Cite Icon2
  • https://doi.org/10.1109/urtc65039.2024.10937532Copy DOI Icon

Quantitative Analysis of Rubric-based Feedback Received From Claude 3.5 Sonnet on Mathematical Programming Problems

  • Oct 11, 2024
  • Joel Raj +8 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Large language model (LLM)-based auto-graders, like Claude 3.5 Sonnet, show promise in educational technology. To test their capabilities, we conducted an experiment in which four researchers solved five mathematical programming problems in Python, ranging from easy to complex. The researchers received feedback from Claude, using a 22 -criteria rubric designed to evaluate the following key aspects of coding: “Correctness,” “Efficiency,” “Data Structure Usage,” “Code Readability,” and “Testing” before resubmitting their assignments. The mean score improvement of $\mathbf{1 7 . 5}$ points demonstrates that LLMs can improve code quality, with the highest percentage increases in time complexity $(\mathbf{+} \mathbf{2 5 . 4 5 \%})$, efficiency $(\mathbf{+ 2 2 . 5 9 \%})$, and edge case handling ($+22 \%$).

Similar Papers
  • Research Article
  • Citations7

Mathematical programming procedures to optimize the collector field subsystem of a power tower system

  • Jan 01, 1983
  • Solar Energy
  • Osman Coşkunoḡlu
  • Research Article
  • Citations3

The necessary and sufficient conditions for single extremality in non-convex problems of mathematical programming

  • Jan 01, 1985
  • USSR Computational Mathematics and Mathematical Physics
  • I.I Gasanov +1
  • Book Chapter

Linear Mathematical Programming

  • Jan 01, 1990
  • Raphael T Haftka +2
  • Research Article

RBF-Chebychev direct method for solving variational problems

  • Mar 01, 2019
  • Caspian Journal of Mathematical Sciences (CJMS)peer
  • A Golbabai +1
  • Research Article
  • Citations3

An η-approximation approach to duality in mathematical programming problems involving r-invex functions

  • Sep 23, 2005
  • Journal of Mathematical Analysis and Applications
  • Tadeusz Antczak
  • Conference Article
  • Citations3

Unification of the direct and indirect approaches to optimal control

  • Aug 10, 1992
  • James Cloutier +1
  • Research Article
  • Citations29

Closure and upper semicontinuity results in mathematical programming, Nash and economic equilibria1

  • Jan 01, 1986
  • Optimization
  • R Lucchetti +1
  • Research Article
  • Citations2

Application of linear programming to non-linear problems with free boundaries for Laplace's equation

  • Jan 01, 1983
  • USSR Computational Mathematics and Mathematical Physics
  • E.L Amromin +1
  • Book Chapter

Nonlinear Problems in Mathematical Programming and Optimal Control

  • Sep 14, 2009
  • Dumitru Motreanu
  • Research Article
  • Citations1

SECOND-ORDER SYMMETRIC DUALITY IN MULTIOBJECTIVE PROGRAMMING OVER CONES

  • Jan 01, 2016
  • Journal of the Korean Mathematical Society
  • Tilak Raj Gulati +1
  • Research Article
  • Citations12

The Linear Dynamic Complementarity Problem is a special case of the Extended Linear Complementarity Problem

  • May 01, 1998
  • Systems & Control Letters
  • Bart De Schutter +1
  • PDF
  • Research Article
  • Citations2

Mathematical Programming Approach to the Optimality of the Solution for Deterministic Inventory Models with Partial Backordering

  • Jan 01, 2013
  • Advances in Operations Research
  • Irena Stojkovska
  • Conference Article
  • Citations15

Completing virtual network embedding all in one mathematical programming

  • Sep 01, 2011
  • Wenzhi Liu +3
  • Book Chapter
  • Citations1

Power System Restoration by Joint Usage of Expert System and Mathematical Programming Approach

  • Jan 01, 2009
  • M M Adibi
  • PDF
  • Research Article
  • Citations4

Optimal Solution of Multi-Choice Mathematical Programming Problem Using a New Technique

  • Jan 01, 2016
  • American Journal of Operations Research
  • Tarek A Khalil +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.