測試在軟體開發過程一直扮演很重要的角色，隨著近二十年來網頁應用程式技術的演進，傳統的人工測試的局限性也越來越明顯，因此網頁自動化測試的需求日益提高。而在網頁自動化測試工具中，如何準確地在適當時間點回播所錄製出的每一個指令是相關工具很熱門的研究議題，SideeX對於等待時間這個問題是透過Auto-Wait的技術來計算指令所觸發的事件需等待時間，此外，對變數的支援性也是一個強大測試工具的基礎，適當的變數引用可以提高測試案例的維護性，透過變數也可以很輕鬆的實現資料驅動測試。本研究針對SideeX現行Auto-Wait技術所遇到的問題提出改善方法並針對測試需求提出等待類指令，同時針對SideeX變數的局限提出新的機制。

Testing has always played an important role in the software development process. With the evolution of web application technology in the past two decades, the limitations of traditional manual testing have become more and more obvious. Therefore, there is an increasing demand for web automation testing. In the web automation testing tools, how to accurately play back each recorded command at the right time is a very popular research topic for related tools. SideeX's approach to calculate waiting time for the events triggered by commands is through the Auto-Wait technique. In addition, the support of variables is the basis of a powerful testing tool, and the proper use of variables can improve the maintenance of test cases, even Data-Driven Testing can be easily implemented through variables. This study intends to propose improvement methods for the problems encountered in the current version of SideeX's Auto-Wait, offer wait-for commands for testing requirements, and provide new mechanisms for the limitations of SideeX's variables.

[1] S. Ivanova and G. Georgiev, "Using Modern Web Frameworks When Developing an Education Application: A Practical Approach," 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1485-1491, 2019.
[2] M. Kaluža, K. Troskot and B. Vukelić, "Comparison of Front-End Frameworks for Web Applications Development," Journal of the Polytechnic of Rijeka, vol. 6, no. 1, pp. 261-282, 2018.
[3] J. Bau, E. Bursztein, D. Gupta and J. Mitchell, "State of the Art: Automated Black-Box Web Application Vulnerability Testing," 2010 IEEE Symposium on Security and Privacy, pp. 332-345, 2010.
[4] A. P. Felt, K. Greenwood and D. Wagner, "The Effectiveness of Application Permissions," Proceedings of the 2nd USENIX Conference on Web Application Development, pp. 75-86, 2011.
[5] S. Nagpure and S. Kurkure, "Vulnerability Assessment and Penetration Testing of Web Application," 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA), 2017.
[6] S. Ahamed, "Studying the Feasibility and Importance of Software Testing: An Analysis," International Journal of Environmental Science and Technology, vol. 1, no. 3, pp. 119-128, 2009.
[7] M. Polo, P. Reales, M. Piattini and C. Ebert, "Test Automation," IEEE Software, vol. 30, no. 1, pp. 84-89, 2013.
[8] S. Doğan, A. Betin-Can and V. Garousi, "Web Application Testing: A Systematic Literature Review," Journal of Systems and Software, vol. 91, pp. 174-201, 2014.
[9] V. Garousi, A. Mesbah, A. Betin-Can and S. Mirshokraie, "A Systematic Mapping Study of Web Application Testing," Information and Software Technology, vol. 55, no. 8, pp. 1374-1396, 2014.
[10] V. Garousi and J. Zhi, "A Survey of Software Testing Practices in Canada," Journal of Systems and Software, vol. 86, no. 5, pp. 1354-1376, 2013.
[11] Y.-F. Li, P. K. Das and D. L. Dowe, "Two Decades of Web Application Testing—A Survey of Recent Advances," Information Systems, vol. 43, pp. 20-54, 2014.
[12] M. J. Aamir and A. Mansoor, "Testing Web Application from Usability Perspective," 2013 3rd IEEE International Conference on Computer, Control and Communication (IC4), 2013.
[13] R. Hametner, D. Winkler and A. Zoitl, "Agile Testing Concepts Based on Keyword-Driven Testing for Industrial Automation Systems," IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society, pp. 3727-3732, 2012.
[14] K. Zhu, J. Fu and Y. Li, "Research the Performance Testing and Performance Improvement Strategy in Web Application," 2010 2nd International Conference on Education Technology and Computer, pp. 328-332, 2010.
[15] A. Beer and R. Ramler, "The Role of Experience in Software Testing Practice," 2008 34th Euromicro Conference Software Engineering and Advanced Applications, pp. 258-265, 2008.
[16] R. Florea and V. Stray, "A Global View on the Hard Skills and Testing Tools in Software Testing," 2019 ACM/IEEE 14th International Conference on Global Software Engineering (ICGSE), pp. 143-151, 2019.
[17] F. Shull, G. Melnik, B. Turhan, L. Layman, M. Diep and H. Erdogmus, "What Do We Know about Test-Driven Development?," IEEE Software, vol. 27, no. 6, pp. 16-19, 2010.
[18] R. Angmo and M. Sharma, "Performance Evaluation of Web Based Automation Testing Tools," 2014 5th International Conference - Confluence The Next Generation Information Technology Summit (Confluence), pp. 731-735, 2014.
[19] S. Dhir and D. Kumar, "Automation Software Testing on Web-Based Application," Software Engineering, pp. 691-698, 2019.
[20] D. R. Lakshmi and S. S. Mallika, "A Review on Web Application Testing and Its Current Research Directions," International Journal of Electrical and Computer Engineering (IJECE), vol. 7, no. 4, pp. 2132-2141, 2017.
[21] M. Sharma and R. Angmo, "Web Based Automation Testing and Tools," International Journal of Computer Science and Information Technologies, vol. 5, no. 1, pp. 908-912, 2014.
[22] K. Sneha and G. M. Malle, "Research on Software Testing Techniques and Software Automation Testing Tools," 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), pp. 77-81, 2017.
[23] D. Kumar and K. K. Mishra, "The Impacts of Test Automation on Software's Cost, Quality and Time to Market," Procedia Computer Science, vol. 79, pp. 8-15, 2016.
[24] S. Gojare, R. Joshi and D. Gaigaware, "Analysis and Design of Selenium WebDriver Automation Testing Framework," Procedia Computer Science, vol. 50, pp. 341-346, 2015.
[25] E. Vila, G. Novakova and D. Todorova, "Automation Testing Framework for Web Applications with Selenium WebDriver: Opportunities and Threats," Proceedings of the International Conference on Advances in Image Processing, pp. 144-150, 2017.
[26] M. Leotta, D. Clerissi, F. Ricca and P. Tonella, "Capture-Replay vs. Programmable Web Testing: An Empirical Assessment during Test Case Evolution," 2013 20th Working Conference on Reverse Engineering (WCRE), pp. 272-281, 2013.
[27] A. M. Memon and B. N. Nguyen, "Advances in Automated Model-Based System Testing of Software Applications with a GUI Front-End," Advances in Computers, vol. 80, pp. 121-162, 2010.
[28] G. Meszaros, "Agile Regression Testing Using Record & Playback," Companion of the 18th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, pp. 353-360, 2003.
[29] M. Leotta, A. Stocco, F. Ricca and P. Tonella, "Using Multi-Locators to Increase the Robustness of Web Test Cases," 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST), 2015.
[30] S. R. Choudhary, D. Zhao, H. Versee and A. Orso, "WATER: Web Application TEst Repair," Proceedings of the First International Workshop on End-to-End Test Script Engineering, pp. 24-29, 2011.
[31] M. Leotta, A. Stocco, F. Ricca and P. Tonella, "Reducing Web Test Cases Aging by means of Robust XPath Locators," 2014 IEEE International Symposium on Software Reliability Engineering Workshops, pp. 449-454, 2014.
[32] R. Yandrapally, S. Thummalapenta, S. Sinha and S. Chandra, "Robust Test Automation Using Contextual Clues," Proceedings of the 2014 International Symposium on Software Testing and Analysis, pp. 304-314, 2014.
[33] A. Arora and M. Sinha, "Web Application Testing: A Review on Techniques, Tools and State of Art," International Journal of Scientific & Engineering Research, vol. 3, no. 2, 2012.
[34] E. Habibi and S.-H. Mirian-Hosseinabadi, "Event-Driven Web Application Testing Based on Model-Based Mutation Testing," Information and Software Technology, vol. 67, pp. 159-179, 2015.
[35] S.-J. Lee, Y.-X. Chen, S.-P. Ma and W.-T. Lee, "Test Command Auto-Wait Mechanisms for Record and Playback-Style Web Application Testing," 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), pp. 75-80, 2018.
[36] C.-H. Liu, C.-J. Wu and H.-M. Chen, "Testing of AJAX-Based Web Applications Using Hierarchical State Model," 2016 IEEE 13th International Conference on e-Business Engineering (ICEBE), pp. 250-256, 2016.
[37] A. Marchetto, P. Tonella and F. Ricca, "State-Based Testing of Ajax Web Applications," 2008 1st International Conference on Software Testing, Verification, and Validation, pp. 121-130, 2008.
[38] A. Mesbah, A. v. Deursen and D. Roest, "Invariant-Based Automatic Testing of Modern Web Applications," IEEE Transactions on Software Engineering, vol. 38, no. 1, pp. 35-53, 2012.
[39] B. Yu, L. Ma and C. Zhang, "Incremental Web Application Testing Using Page Object," 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb), pp. 1-6, 2015.
[40] Y. Li, Z.-a. Sun and J.-Y. Fang, "Generating an Automated Test Suite by Variable Strength Combinatorial Testing for Web Services," Journal of Computing and Information Technology, vol. 24, no. 3, pp. 271-282, 2016.
[41] Chandraprabha, A. Kumar and S. Saxena, "Data Driven Testing Framework using Selenium WebDriver," International Journal of Computer Applications, vol. 118, no. 18, pp. 18-23, 2015.