• Home
  • Search
  • Deep GUI: Black-box GUI Input Generation with Deep Learning
  • Cite Icon28
  • https://doi.org/10.1109/ase51524.2021.9678778Copy DOI Icon

Deep GUI: Black-box GUI Input Generation with Deep Learning

  • Nov 1, 2021
  • Faraz Yazdanibanafshedaragh +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Despite the proliferation of Android testing tools, Google Monkey has remained the de facto standard for practitioners. The popularity of Google Monkey is largely due to the fact that it is a black-box testing tool, making it widely applicable to all types of Android apps, regardless of their underlying implementation details. An important drawback of Google Monkey, however, is the fact that it uses the most naive form of test input generation technique, i.e., random testing. In this work, we present Deep GUI, an approach that aims to complement the benefits of black-box testing with a more intelligent form of GUI input generation. Given only screenshots of apps, Deep GUI first employs deep learning to construct a model of valid GUI interactions. It then uses this model to generate effective inputs for an app under test without the need to probe its implementation details. Moreover, since the data collection, training, and inference processes are performed independent of the platform, the model inferred by Deep GUI has application for testing apps in other platforms as well. We implemented a prototype of Deep GUI in a tool called Monkey++ by extending Google Monkey and evaluated it for its ability to crawl Android apps. We found that Monkey++ achieves significant improvements over Google Monkey in cases where an app’s UI is complex, requiring sophisticated inputs. Furthermore, our experimental results demonstrate the model inferred using Deep GUI can be reused for effective GUI input generation across platforms without the need for retraining.

Similar Papers
  • Research Article
  • Citations82

WHO's Assessment Instrument for Mental Health Systems: Collecting Essential Information for Policy and Service Delivery

  • Jun 01, 2007
  • Psychiatric Services
  • Shekhar Saxena +5
  • Research Article
  • Citations1

CHSI costing study–Challenges and solutions for cost data collection in private hospitals in India

  • Dec 12, 2022
  • PLOS ONE
  • Maninder Pal Singh +28
  • Conference Article
  • Citations2

Software black-box testing tool for railway signaling system by real interface

  • Oct 01, 2013
  • Jong-Gyu Hwang +3
  • Research Article
  • Citations2

Sociodemographic Variables in Canadian Organ Donation Organizations: A Health Information Survey.

  • Jun 08, 2023
  • Transplantation Direct
  • Murdoch Leeies +8
  • Conference Article
  • Citations2

Realtime data analysis for the Joint Theater Missile Defense Simulation Network (JTMDSN)

  • Dec 07, 1994
  • M.D Gray +1
  • Research Article
  • Citations3

Non-parametric induction motor rotor flux estimator based on feed-forward neural network

  • Jun 01, 2022
  • International Journal of Power Electronics and Drive Systems (IJPEDS)
  • Siti Nursyuhada Mahsahirun +3
  • PDF
  • Research Article
  • Citations17

ARTDL: Adaptive Random Testing for Deep Learning Systems

  • Jan 01, 2020
  • IEEE Access
  • Min Yan +2
  • PDF
  • Research Article
  • Citations21

Process evaluation of health system costing – Experience from CHSI study in India

  • May 13, 2020
  • PLoS ONE
  • Shankar Prinja +9
  • Research Article

Integration of UAV and Deep Learning for Stress Detection in Pea Fields

  • Jan 01, 2025
  • Legume Genomics and Genetics
  • Minghua Li
  • Research Article
  • Citations1

Pengaruh Penggunaan Aplikasi Al-Qur’an Android Terhadap Motivasi Membaca Al-Qur’an Pada Siswa Smp Islam Terpadu Al-Falah Muhammadiyah Cilawu Garut

  • Aug 19, 2022
  • Masagi
  • Debby Rizki Amalia +1
  • Research Article
  • Citations49

Unmanned aerial vehicle rotor fault diagnosis based on interval sampling reconstruction of vibration signals and a one-dimensional convolutional neural network deep learning method

  • Feb 25, 2022
  • Measurement Science and Technology
  • Canyi Du +6
  • PDF
  • Research Article
  • Citations5

Automating intersection marking data collection and condition assessment at scale with an artificial intelligence-powered system

  • Jul 13, 2023
  • Computational Urban Science
  • Kun Xie +4
  • Conference Article

Safe Deep Reinforcement Learning Based on Sample Value Evaluation

  • Dec 02, 2022
  • Rongjun Ye +2
  • PDF
  • Research Article
  • Citations3

Analysis and Design of Production Monitoring Information Systems on Label Shoe Manufacturing Companies

  • Dec 02, 2022
  • Komputasi: Jurnal Ilmiah Ilmu Komputer dan Matematika
  • Jansen Wiratama
  • Dissertation

Web Security Detection Tool

  • Jan 01, 2008
  • Abhishek Agashe
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.