• Home
  • Search
  • Empirical evaluation of continuous test-driven development in industrial settings
  • Cite Icon2
  • https://doi.org/10.3233/jifs-179369Copy DOI Icon

Empirical evaluation of continuous test-driven development in industrial settings

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

BACKGROUND: Continuous Test-Driven Development (CTDD) is, proposed by the authors, enhancement of the well-established Test-Driven Development (TDD) agile software development and design practice. CTDD combines TDD with continuous testing (CT) that essentially perform background testing. The idea is to eliminate the need to execute tests manually by a TDD-inspired developer. OBJECTIVE: The objective is to compare the efficiency of CTDD vs TDD measured by the red-to-green time (RTG time), i.e., time from the moment when the project is rendered not compiling or any of the tests is failing, up until the moment when the project compiles and all the tests are passing. We consider the RTG time to be a possible measurement of efficiency because the shorter the RTG time, the quicker the developer is advancing to the next phase of the TDD cycle. METHOD: We perform single case and small- n experiments in industrial settings presenting how our idea of Agile Experimentation materialise in practice. We analyse professional developers in a real-world software development project employing Microsoft.NET. We extend the contribution presented in our earlier paper by: 1) performing additional experimental evaluation of CTDD and thus collecting additional empirical evidence, 2) giving an extended, detailed example how to use and analyse both a single case and small- n experimental designs to evaluate a new practice (CTDD) in industrial settings taking into account natural constraints one may observe (e.g., a limited number of developers available for research purposes) and presenting how to reach more reliable conclusions using effect size measures, especially PEM and PAND which are more appropriate when data are not normally distributed or there is a large variation between or within phases. RESULTS: We observed reduced variance and trimmed means of the RTG time in CTDD in comparison to TDD. Various effect size measures (including ES, d-index, PEM, and PAND) indicate small, albeit non-zero, effect size due to CTDD. CONCLUSIONS: Eliminating the reoccurring manual task of selecting and executing tests and waiting for the results (by embracing CTDD) may slightly improve the development speed, but this small change on a level of a single developer, multiplied by a number of developers, can potentially lead to savings on the company or industry level.

Similar Papers
  • Conference Article
  • Citations1

Using spring Roo for the test-driven development of Web applications

  • Mar 26, 2012
  • Tim A Majchrzak +1
  • Dissertation
  • Citations1

A Theory of Coordination in Agile Software Development Projects

  • Jan 01, 2012
  • Diane Elizabeth Strode
  • Dissertation
  • Citations6

A Theory of Coordination in Agile Software Development Projects

  • Jan 01, 2012
  • Diane Elizabeth Strode
  • Conference Article
  • Citations11

Implementing Computer-Aided Language Learning Tool Using Hybrid Agile Method: A Case Study

  • Sep 01, 2013
  • Mashal Alqudah +1
  • Book Chapter
  • Citations13

Critical Issues on Test-Driven Development

  • Jan 01, 2011
  • Sami Kollanus
  • Conference Article
  • Citations3

Software Practices For Agile Developers: A Systematic Literature Review

  • Jul 27, 2022
  • Devina Arnyndiasari +2
  • Research Article
  • Citations53

The impacts of agile and lean practices on project constraints: A tertiary study

  • Jun 23, 2016
  • Journal of Systems and Software
  • Indira Nurdiani +2
  • Book Chapter

Adapting Test-Driven Development to Build Robust Web Services

  • Jan 01, 2014
  • Nuno Laranjeiro +1
  • Supplementary Content
  • Citations3

The situated software architect

  • Jan 10, 2017
  • Figshare
  • Paul Taylor
  • Research Article
  • Citations13

Enhancing IoT Project Success through Agile Best Practices

  • Feb 23, 2023
  • ACM Transactions on Internet of Things
  • Wouter Moedt Van Bolhuis +3
  • Book Chapter

Exploratory Test-Driven Development Study with ChatGPT in Different Scenarios

  • Jan 01, 2025
  • Juliano Cesar Pancher +2
  • Research Article
  • Citations12

Understanding the perceived relevance of capability measures: A survey of Agile Software Development practitioners

  • May 27, 2021
  • Journal of Systems and Software
  • Sai Datta Vishnubhotla +2
  • Conference Article
  • Citations1

Teaching Test-Driven Development and Object-Oriented Design by Example

  • Apr 01, 2023
  • Bingyang Wei
  • Research Article

Penerapan Test Driven Development (TDD) pada Laravel Menggunakan PHPUnit

  • Aug 19, 2024
  • Jurnal Sistem Informasi
  • Sigit Wijanarko +1
  • Conference Article
  • Citations9

On the role of Wiki for managing knowledge in agile software development

  • May 01, 2013
  • Pankaj Kamthan
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.