• Open Access IconOpen Access
  • Cite Icon225
  • https://doi.org/10.1145/1753326.1753555Copy DOI Icon

GUI testing using computer vision

  • Apr 10, 2010
  • Tsung-Hsiang Chang +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Testing a GUI's visual behavior typically requires human testers to interact with the GUI and to observe whether the expected results of interaction are presented. This paper presents a new approach to GUI testing using computer vision for testers to automate their tasks. Testers can write a visual test script that uses images to specify which GUI components to interact with and what visual feedback to be observed. Testers can also generate visual test scripts by demonstration. By recording both input events and screen images, it is possible to extract the images of components interacted with and the visual feedback seen by the demonstrator, and generate a visual test script automatically. We show that a variety of GUI behavior can be tested using this approach. Also, we show how this approach can facilitate good testing practices such as unit testing, regression testing, and test-driven development.

Similar Papers
  • Conference Article
  • Citations8

Adding Criteria-Based Tests to Test Driven Development

  • Apr 01, 2012
  • William Shelton +3
  • Research Article

Improving efficiency of automated functional testing in agile projects

  • Jan 01, 2012
  • Annales Universitatis Scientiarum Budapestinensis de Rolando Eötvös Nominatae. Sectio computatorica
  • Gáspár Nagy
  • Conference Article
  • Citations86

Evaluating advantages of test driven development

  • Sep 21, 2006
  • Gerardo Canfora +4
  • Research Article

Post-Refactoring Recovery of Unit Tests: An Automated Approach

  • Apr 26, 2023
  • International Journal of Interactive Mobile Technologies (iJIM)
  • Abdallah Qusef +3
  • Research Article
  • Citations23

Test-driven learning in early programming courses

  • Feb 29, 2008
  • ACM SIGCSE Bulletin
  • David Janzen +1
  • Conference Article
  • Citations6

Test-Driven Component Integration with UML 2.0 Testing and Monitoring Profile

  • Oct 01, 2007
  • Donglin Liang +1
  • Research Article

METHODS OF ENHANCING UNIT TEST QUALITY FOR RELIABLE CODE

  • Aug 01, 2024
  • The American Journal of Engineering and Technology
  • Nikhil Badwaik
  • Conference Article
  • Citations58

Students' and professionals' perceptions of test-driven development

  • Apr 04, 2016
  • Giuseppe Scanniello +4
  • Conference Article
  • Citations80

Test-driven learning in early programming courses

  • Mar 12, 2008
  • David Janzen +1
  • Research Article
  • Citations51

Test-driven simulation modelling: A case study using agent-based maritime search-operation simulation

  • Apr 08, 2016
  • European Journal of Operational Research
  • Bhakti Stephan Onggo +1
  • Book Chapter
  • Citations2

Putting Requirements and Quality at the Core of Global Service Delivery: Current Efforts and Future Plans at Pace University

  • Jan 01, 2008
  • Olly Gotel +1
  • Research Article
  • Citations23

Adapting automated test generation to GUI testing of industry applications

  • Jul 06, 2017
  • Information and Software Technology
  • Rudolf Ramler +2
  • Research Article
  • Citations8

Test-Driven Development in HPC Science: A Case Study

  • Sep 01, 2018
  • Computing in Science & Engineering
  • Aziz Nanthaamornphong +1
  • Book Chapter
  • Citations3

Generating Regression Unit Tests Using a Combination of Verification and Capture & Replay

  • Jan 01, 2010
  • Christoph Gladisch +3
  • Conference Article
  • Citations20

Hybrid monkey testing: enhancing automated GUI tests with random test generation

  • Sep 04, 2017
  • Thomas Wetzlmaier +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.