Unsupervised Machine Learning Approaches for Test Suite Reduction

References

• Ahmad, K., M. Abdelrazek, C. Arora, M. Bano, and J. Grundy. 2023. Requirements engineering for artificial intelligence systems: A systematic mapping study. Information and Software Technology 158:107176. doi:10.1016/j.infsof.2023.107176.
   Web of Science ®Google Scholar
• Ali, N. B., E. Engström, M. Taromirad, M. R. Mousavi, N. M. Minhas, D. Helgesson, and S. Kunze, M. Varshosaz. 2019. On the search for industry-relevant regression testing research. Empirical Software Engineering 24 (4):2020–31. doi:10.1007/s10664-018-9670-1.
   Web of Science ®Google Scholar
• Alkawaz, M. H., and A. Silvarajoo. 2019, December. A survey on test case prioritization and optimization techniques in software regression testing. Proceeding - 2019 IEEE 7th Conference on Systems, Process and Control, ICSPC 2019, 59–64. doi:10.1109/ICSPC47137.2019.9068003.
   Google Scholar
• Al-Sabbagh, K. W., M. Staron, M. Ochodek, R. Hebig, and W. Meding. 2020. Selective regression testing based on big data: Comparing feature extraction techniques. Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2020, 322–29. doi:10.1109/ICSTW50294.2020.00058.
   Google Scholar
• Amalfitano, D., S. Faralli, J. C. R. Hauck, S. Matalonga, and D. Distante. 2023. Artificial intelligence applied to software testing: A tertiary study. ACM Computing Surveys 56 (3):1–38. doi:10.1145/3616372.
   Web of Science ®Google Scholar
• Anwar, Z., and A. Ahsan. 2014. Exploration and analysis of regression test suite optimization. ACM SIGSOFT Software Engineering Notes 39 (1):1–5. doi:10.1145/2557833.2557841.
   Google Scholar
• Azuaje, F., I. Witten, and E. Frank. 2006. Witten IH, Frank E: Data mining: Practical machine learning tools and techniques. Biomedical Engineering Online 5 (1):1–2. doi:10.1186/1475-925X-5-51.
   Google Scholar
• Breit, A., L. Waltersdorfer, F. J. Ekaputra, M. Sabou, A. Ekelhart, A. Iana, and F. van Harmelen. 2023. Combining machine learning and semantic web: A systematic mapping study. New York, NY: ACM Computing Surveys.
   Google Scholar
• Catal, C. 2011. Software fault prediction: A literature review and Current trends. Expert Systems with Applications 38 (4):4626–36. doi:10.1016/j.eswa.2010.10.024.
   Web of Science ®Google Scholar
• Catal, C., and D. Mishra. 2013. Test case prioritization: A systematic mapping study. Software Quality Journal 21 (3):445–478. doi:10.1007/s11219-012-9181-z.
   Web of Science ®Google Scholar
• Chen, T. Y., and M. F. Lau. 1998. A simulation study on some heuristics for test suite reduction. Information and Software Technology 40 (13):777–87. doi:10.1016/S0950-5849(98)00094-9.
   Web of Science ®Google Scholar
• Coviello, C., S. Romano, G. Scanniello, A. Marchetto, A. Corazza, and G. Antoniol. 2020. Adequate vs. Inadequate test suite reduction approaches. Information and Software Technology 119:106224. doi:10.1016/j.infsof.2019.106224.
   Web of Science ®Google Scholar
• Dempster, A. P., N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological) 39 (1):1–22. doi:10.1111/J.2517-6161.1977.TB01600.X.
   Web of Science ®Google Scholar
• Dickinson, W., D. Leon, and A. Podgurski. 2001 May. Finding failures by cluster analysis of execution profiles. Proceedings - International Conference on Software Engineering, 2001, 339–48. doi:10.1109/ICSE.2001.919107.
   Google Scholar
• Felbinger, H., F. Wotawa, and M. Nica - 2017 IEEE International, and undefined 2017. IEEE International, and undefined 2017 Mutation score, coverage, Model inference: Quality assessment for t-Way Combinatorial Test-Suites. Ieeexplore.Ieee.Org, Tokyo, Japan.
   Google Scholar
• Felbinger, H., F. Wotawa, and M. Nica. 2016 IEEE International, and undefined 2016. n.d. Test-suite reduction does not necessarily require executing the program under test. Ieeexplore.Ieee.Org.
   Google Scholar
• Ganter, B. and R. Wille. Formal concept analysis -… - google scholar. n.d.
   Google Scholar
• Golagha, M., C. Lehnhoff, A. Pretschner, and H. Ilmberger. 2019. Failure clustering without coverage. Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, 134–145. ISSTA 2019. New York, NY, USA: Association for Computing Machinery. doi:10.1145/3293882.3330561.
   Google Scholar
• Gupta, N., A. Sharma, and M. K. Pachariya. 2022. Multi-objective test suite optimization for detection and localization of software faults. Journal of King Saud University-Computer & Information Sciences 34 (6):2897–909. doi:10.1016/j.jksuci.2020.01.009.
   Web of Science ®Google Scholar
• Habib, A. S., S. U. R. Khan, and E. A. Felix. 2023. A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions. IET Software 17 (2):93–136. doi:10.1049/sfw2.12104.
   Web of Science ®Google Scholar
• Harrold, M. J. 2000. Testing: A Roadmap. Proceedings of the Conference on The Future of Software Engineering, 61–72. ICSE ’00. New York, NY, USA: Association for Computing Machinery. doi:10.1145/336512.336532.
   Google Scholar
• Harrold, M., J. R. Gupta, and M. Lou Soffa. 1993. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering & Methodology (TOSEM) 2 (3):270–85. doi:10.1145/152388.152391.
   Google Scholar
• Holcombe, M., F. Ipate, and A. Grondoudis. 1995. Complete functional testing of safety critical systems. IFAC Proceedings Volumes 28 (25):199–204. doi:10.1016/S1474-6670(17)44845-2.
   Google Scholar
• Hsueh, C. H., Y. Pin Cheng, and W. Cheng Pan. 2011. Intrusive test automation with failed test case clustering. Proceedings - Asia-Pacific Software Engineering Conference, APSEC, 89–96. 10.1109/APSEC.2011.31.
   Google Scholar
• Iannino, A., and D. M. John. 1990. Software reliability. In Advances in Computers, ed. M. C. Yovits, vol. 30, 85–170. Elsevier. doi:10.1016/S0065-2458(08)60299-5.
   Google Scholar
• Jehan, S., and F. Wotawa. 2023. An empirical study of greedy test suite minimization techniques using mutation coverage. New York City, United States: IEEE Access.
   Google Scholar
• Khalilian, A., and S. Parsa. 2009, October. Bi-criteria test suite reduction by cluster analysis of execution profiles. ( LNCS) Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 7054:243–56. doi:10.1007/978-3-642-28038-2_19.
   Google Scholar
• Khan, S. U. R., S. Peck Lee, R. Wasim Ahmad, A. Akhunzada, and V. Chang. 2016. A survey on test suite reduction frameworks and tools. International Journal of Information Management 36 (6):963–75. doi:10.1016/J.IJINFOMGT.2016.05.025.
   Web of Science ®Google Scholar
• Khan, K., S. Ur Rehman, K. Aziz, S. S. Simon Fong, and A. Vishwa. 2014. DBSCAN: Past, Present and Future. 5th International Conference on the Applications of Digital Information and Web Technologies, ICADIWT 2014, 232–38. doi:10.1109/ICADIWT.2014.6814687.
   Google Scholar
• Khoder, A., and F. Dornaika. 2021. Ensemble learning via feature selection and multiple transformed subsets: Application to image classification. Applied Soft Computing 113:108006. doi:10.1016/j.asoc.2021.108006.
   Web of Science ®Google Scholar
• Kiran, A., W. Haider Butt, M. Waseem Anwar, F. Azam, and B. Maqbool. 2019. A comprehensive investigation of modern test suite optimization trends, tools and techniques. Institute of Electrical and Electronics Engineers Access 7:89093–117. doi:10.1109/ACCESS.2019.2926384.
   Google Scholar
• Kitchenham, B., and S. Charters. 2007. Guidelines for performing systematic literature reviews in software engineering version 2.3. Engineering 45 (4ve):1051.
   Google Scholar
• Lewis, W. E. 2004. Software testing and continuous quality improvement. Boca Raton, FL, USA: Auerbach publications.
   Google Scholar
• Martins, R., R. Abreu, M. Lopes, and J. Nadkarni. 2021. Supervised learning for test suit selection in continuous integration. Proceedings - 2021 IEEE 14th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2021, 239–46. doi:10.1109/ICSTW52544.2021.00048.
   Google Scholar
• Miller, B. P., L. Fredriksen, and S. Bryan. 1990. An empirical study of the reliability of UNIX utilities. Communications of the ACM 33 (12):32–44. doi:10.1145/96267.96279.
   Web of Science ®Google Scholar
• Mottaghi, N., and M. Reza Keyvanpour. 2018. Test suite reduction using data mining techniques: A review article. 18th CSI International Symposium on Computer Science and Software Engineering, CSSE 2017 2018-Janua (March), 61–66. 10.1109/CSICSSE.2017.8320118.
   Google Scholar
• Oded, M. and L. Rokach. 2010. Data Mining and… - Google Scholar. n.d.
   Google Scholar
• On, J. M. n.d. Proceedings of the fifth Berkeley symposium, and undefined 1967. Some Methods for Classification and Analysis of Multivariate Observations, Oakland, CA, USA. Books.Google.Com.
   Google Scholar
• Orso, A., and G. Rothermel. 2014 May. Software testing: A research travelogue (2000-2014). Future of Software Engineering, FOSE 2014 - Proceedings, 117–32. 10.1145/2593882.2593885.
   Google Scholar
• Petersen, K., R. Feldt, S. Mujtaba, and M. Mattsson. 2008, June. Systematic mapping studies in software engineering. 12th International Conference on Evaluation and Assessment in Software Engineering (EASE) 12, Bari, Italy, 1–10.
   Google Scholar
• Raamesh, L., and G. V. Uma. 2011. Method to improve the efficiency of the software by the effective selection of the test cases from test suite using data mining techniques.
   Google Scholar
• Rebala, G., A. Ravi, and S. Churiwala. 2019. Machine learning definition and basics. An Introduction to Machine Learning 1–17. doi:10.1007/978-3-030-15729-6_1.
   Google Scholar
• Rehman, K., U. Saif, S. P. Lee, N. Javaid, and W. Abdul. 2018. A systematic review on test suite reduction: Approaches, experiment’s quality evaluation, and guidelines. Institute of Electrical and Electronics Engineers Access 6 (February):11816–41. doi:10.1109/ACCESS.2018.2809600.
   Google Scholar
• Rothermel, G., R. H. Untch, C. Chu, and M. Jean Harrold. 1999. Test case prioritization: An empirical study. Proceedings IEEE International Conference on Software Maintenance-1999 (ICSM’99).’Software Maintenance for Business Change’(Cat No. 99CB36360), Oxford, England, 179–88.
   Google Scholar
• Sampath, S., and R. C. Bryce. 2012. Information and software technology, and undefined 2012. Information and Software Technology 54 (7):724–38. doi:10.1016/j.infsof.2012.01.007. Improving the Effectiveness of Test Suite Reduction for User-Session-Based Testing of Web Applications.
   Google Scholar
• Saraswat, P., A. Singhal, and A. Bansal. 2019. A review of test case prioritization and optimization techniques. Advances in Intelligent Systems & Computing 731:507–16. doi:10.1007/978-981-10-8848-3_48/TABLES/3.
   Google Scholar
• Shahamiri, S. R., W. Mohd Nasir Wan Kadir, and S. Zaiton Mohd-Hashim. 2009. A comparative study on automated software test oracle methods. 2009 Fourth International Conference on Software Engineering Advances, 140–45. doi:10.1109/ICSEA.2009.29.
   Google Scholar
• Shi, A., A. Gyori, M. Gligoric, A. Zaytsev, and D. Marinov. 2014. Balancing trade-offs in test-suite reduction. Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering 16-21-Nove (November): 246–56. doi:10.1145/2635868.2635921.
   Google Scholar
• Sun, H., X. Chenchen, and H. Suominen. 2021. Analyzing the granularity and cost of annotation in clinical sequence labeling. http://arxiv.org/abs/2108.09913.
   Google Scholar
• Yager, R. R. 2000. Intelligent control of the hierarchical agglomerative clustering process. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 30 (6):835–45. doi:10.1109/3477.891145.
   Web of Science ®Google Scholar
• Yoo, S., and M. Harman. 2012. Regression testing minimization, selection and prioritization: A survey. Software Testing Verification and Reliability 22 (2):67–120. doi:10.1002/stvr.430.
   Web of Science ®Google Scholar
• Zhang, C., Z. Chen, Z. Zhao, S. Yan, J. Zhang, and X. Baowen. 2010. An Improved Regression Test Selection Technique by Clustering Execution Profiles. 2010 10th International Conference on Quality Software, 171–79. doi:10.1109/QSIC.2010.16.
   Google Scholar
• Zhou, B., Y. Ying, and S. Skiena. 2020. Online AUC optimization for sparse high-dimensional datasets. Proceedings - IEEE International Conference on Data Mining, ICDM 2020-November, 881–90. doi:10.1109/ICDM50108.2020.00097.
   Google Scholar