Automatic Generation of Software Test Cases
An Empirical Evaluation in the Use of Evosuite and Randoop Tools
DOI:
https://doi.org/10.5281/zenodo.13367669Keywords:
Software Testing, Test Automation, Evosuite, Randoop, Software QualityAbstract
Software Testing is one of the main activities in the software development life cycle to control quality. Usually, the testing activity is performed manually and has a high cost in the software development process. Tools for automating software testing activities can reduce the effort and costs associated with improving the development process and consequently the product quality. The main objective of this work is to investigate the use of tools for automatic generation of test scripts. An empirical study was conducted to evaluate the effectiveness in revealing faults, code coverage and quality of test conditions comparing two tools for generating automated test cases: EvoSuite and Randoop. The tools were submitted to the same project and the code coverage as well as the quality of the test cases were analyzed. The results show that there is still a need for more research and improvements for automated tools in the generation of test cases to be widely adopted in the software development community.
Downloads
References
AMMANN, P.; OFFUTT, J. Introduction to software testing. 2. ed. Cambridge: Cambridge University Press, 2017.ASTOS, A.; RIOS, E.; CRISTALLI, R.; MOREIRA, T. Base de conhecimento em teste de software. 2. ed. São Paulo: Martins, 2007.
CAMPOS, J.; PANICHELLA, A.; FRASER, G. EvoSuite at the SBST 2019 tool competition. In: 2019 I CHICANELLI, Rachel et al. Aspectos sociais, humanos e econômicos da utilização de testes automatizados no desenvolvimento de sistemas. In: Décima Oitava Conferência Ibero Americana de Sistemas Cibernética e Informática. 2019.EEE/ACM 12th International Workshop on Search-Based Software Testing (SBST). IEEE, 2019. p. 29-32.
CHOUDHARY, D.; KUMAR, V. Software testing. Journal of Computational Simulation and Modeling, v. 1, n. 1, p. 1, 2011.
COLES, H. et al. Pit: a practical mutation testing tool for java. In: Proceedings of the 25th international symposium on software testing and analysis. 2016. p. 449-452.
DELAMARO, Marcio; JINO, Mario; MALDONADO, Jose. Introdução ao teste de software. Elsevier Brasil, 2013.
ELBERZHAGER, F., MÜNCH, J., & NHA, V. T. (2012). A systematic mapping study on the combination of static and dynamic quality assurance techniques. Information and Software Technology. 54(1), 1-15.
FREITAS, E. C.; PRODANOV, C.C. Metodologia do trabalho de pesquisa: métodos e técnicas de pesquisa e do trabalho científico. 2 ed. Novo
FRASER, G.; ARCURI, A. Evosuite: automatic test suite generation for object-oriented software. In: Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering. 2011. p. 416-419.
FRASER, Gordon; ARCURI, Andrea. Evosuite at the second unit testing tool competition. In: Future Internet Testing: First International Workshop, FITTEST 2013, Istanbul, Turkey, November 12, 2013, Revised Selected Papers 1. Springer International Publishing, 2014. p. 95-100.
FRASER, Gordon; ARCURI, Andrea. Whole test suite generation. IEEE Transactions on Software Engineering, v. 39, n. 2, p. 276-291, 2012.
GAROUSI, Vahid; MÄNTYLÄ, Mika V. A systematic literature review of literature reviews in software testing. Information and Software Technology, v. 80, p. 195-216, 2016.
GIL, A. C. Métodos e técnicas do conhecimento científico. São Paulo: Atlas, 2000.
JIA, Y.; HARMAN, M. An analysis and survey of the development of mutation testing. IEEE Transactions on Software Engineering, v. 37, n. 5, p. 649–678, 2011.
KITCHENHAM, B.; MENDES, E. Software productivity measurement using multiple size measures. IEEE Transactions on Software Engineering, v. 30, n. 12, p. 1023-1035, 2004.
MYERS, G. J.; SANDLER, C.; BADGETT, T. The art of software testing. 3. ed. Hoboken, NJ: John Wiley & Sons, 2011.
PACHECO, C.; LAHIRI, S. K.; ERNST, M. D.; BALL, T. Feedback-directed random test generation. In: Proceedings of the 29th international conference on Software Engineering. [S.l.]: IEEE Computer Society, 2007. p. 75–84.
SERNA, E. M.; MARTÍNEZ, R. M.; TAMAYO, P. O. A review of reality of software test automation | Una revisión a la realidad de la automatización de las pruebas del software. Computacion y Sistemas, [s. l.], v. 23, n. 1, p. 169–183, 2019.
SILVA, André et al. Flacoco: Fault localization for java based on industry-grade coverage. arXiv preprint arXiv:2111.12513, 2021.
SILVA, I. P. S. C.; ALVES, E. L. G.; ANDRADE, W. L. Analyzing automatic test generation tools for refactoring validation. In: 2017 IEEE/ACM 12th International Workshop on Automation of Software Testing (AST). IEEE, 2017. p. 38-44.
SMEETS, N.; SIMONS, A. J. Automated unit testing with Randoop, JWalk and µJava versus manual JUnit testing. Research report, Department of Computer Science, University of Sheffield/University of Antwerp, Sheffield, Antwerp, 2011.
SOMMERVILLE, I. Engenharia de Software. 8ª ed. São Paulo: Pearson Education Brasil, 2007.
TORRES, D. G. Specnl: Uma ferramenta para gerar descrições em linguagem natural a partir de especificações de casos de teste. 2006. Dissertação de Mestrado. Universidade Federal de Pernambuco.
VERA-PÉREZ, O. L.; MONPERRUS, M.; BAUDRY, B. Descartes: A pitest engine to detect pseudo-tested methods: Tool demonstration. In: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering. 2018. p. 908-911.
AMMANN, P.; OFFUTT, J. Introduction to software testing. 2. ed. Cambridge: Cambridge University Press, 2017.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Ana Caroline Vitória de Lima Bastos , Edson Saraiva De Almeida
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Engetec em Revisa © 2024 by Fatec da Zona Leste is licensed under CC BY-NC-SA 4.0
Copyright Policy
By submitting a manuscript for publication in EnGeTec em Revista, the authors agree, in advance and unrestrictedly, to the following terms:
- The authors retain the copyright and grant EnGeTec em Revista the right of first publication of the manuscript, without any financial burden, and renounce any other remuneration for its publication in EnGeTec em Revista.
- When submitted to EnGeTec em Revista, the manuscript is automatically licensed under the Creative Commons Attribution License, which allows the sharing of the work with acknowledgment of authorship and initial publication in EnGeTec em Revista.
- Authors are authorized to enter into additional contracts separately, for non-exclusive distribution of the version of the work published in EnGeTec em Revista (publish in repositories or as a book chapter), with acknowledgment of the initial publication in EnGeTec em Revista, provided that such agreement does not imply an endorsement of the content of the manuscript or of the new vehicle by EnGeTec em Revista.
- Authors are allowed and encouraged to publish and distribute their work online, in institutional repositories, for example after the editorial process is completed.
- The authors warrant that they have obtained proper permission from their employers for the transfer of rights under this agreement, if those employers own any copyright in the manuscript. In addition, the authors assume any and all responsibility for possible infringements of the copyright of these employers, exempting EnGeTec em Revista from any and all liability in this regard.
- The authors assume all responsibility for the content of the work, including the due and necessary authorizations for data disclosure. collected and results obtained, exempting EnGeTec em Revista from any and all responsibility in this regard.
