| 研究生: |
李偉強 Lee, Wai-Keung |
|---|---|
| 論文名稱: |
網頁自動化測試之測試報告及數據驅動設計與實作 Design and Implementation of Data-Driven Testing and Test Report in Record-Playback Web Test Automation |
| 指導教授: |
李信杰
Lee, Shin-Jie |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 資訊工程學系 Department of Computer Science and Information Engineering |
| 論文出版年: | 2021 |
| 畢業學年度: | 109 |
| 語文別: | 英文 |
| 論文頁數: | 49 |
| 中文關鍵詞: | 網頁自動化測試 、自動化測試 、數據驅動 、整合報告 、測試報告 |
| 外文關鍵詞: | Web automation testing, Automation testing tools, Data-driven Testing, Integrated Reporting, Report |
| 相關次數: | 點閱:207 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
網際網路的興起與發達逐漸成為人們生活中不可或缺的一部分,日常所接觸到的資訊藉由網頁快速地傳遞,而使人們越來越需要網頁的建立與測試。網頁自動化測試元件改善了以往需要人工一步一步測試問題的高工時與低效率問題,透過腳本大大提高測試效率,減少人力消耗同時降低人為的錯誤率。
本研究建立在網頁自動化測試元件SideeX Recorder上,提出兩大功能的建立方法:一、擴充變數輸入方式,以CSV或JSON格式匯入變數,以數據驅動方式進行網站自動化的回歸測試。二、整合自動化測試結果,成生以執行次序、測試所使用之瀏覽器,以及測試語言分類之綜合報告。此兩功能可帶給使用者更直觀簡便的使用體驗,提升網頁測試的自動化及效率,實施符合成本效益的自動化測試。
The rise and development of the Internet have gradually become an indispensable part of people's lives. The information in our daily life is quickly transmitted through web pages, which makes people rely on the creation and testing of web pages increasingly. The webpage automated testing tools improves efficiency and decrease the working hours that required manual step-by-step test in the past. In addition, the script dramatically improves the test efficiency while reducing Testing cost and human error probability.
This research is based on SideeX Recorder, a webpage automated testing tool. We propose two methods for establishing two major functions. First, we expand the variable input method, import variables in CSV or JSON format, and perform automated regression testing of the website in a data-driven manner. Second, integrate automated test results, and generate a comprehensive report based on the execution period, the browser used for the test, and the test language classification. These two functions can bring users a more intuitive and convenient experience, improve the automation and efficiency of web page testing. At its heart, to conduct cost-effective automated testing.
[1] S. Elbaum, G. Rothermel, S. Karre, and M. Fisher II, “Leveraging user-session data to support web application testing,” IEEE Trans. Softw. Eng., vol. 31, pp. 187–202, 2005.
[2] Z. Qian, H. Miao, and H. Zeng, “A practical web testing model for web application testing,” 2007 Third Int. IEEE Conf. Signal-Image Technol. Internet-Based Syst. IEEE 2007, pp. 434–441.
[3] Y.-F. Li, P. K. Das, and D. L. Dowe, “Two decades of Web application testing—A survey of recent advances,” Inf. Syst., vol. 43, pp. 20–54, Jul. 2014, doi: 10.1016/j.is.2014.02.001.
[4] D. Benslimane, S. Dustdar, and A. Sheth, “Services Mashups: The New Generation of Web Applications,” IEEE Internet Comput., vol. 12, no. 5, pp. 13–15, Sep. 2008, doi: 10.1109/MIC.2008.110.
[5] J. Bau, E. Bursztein, D. Gupta, and J. Mitchell, “State of the art: Automated black-box web application vulnerability testing,” 2010 IEEE Symp. Secur. Priv. 2010.
[6] L. Martin, “Usability analysis and visualization of Web 2.0 applications,” in 2008 10th International Symposium on Web Site Evolution, Oct. 2008, pp. 121–124. doi: 10.1109/WSE.2008.4655404.
[7] S. Xu and H. Zeng, “Static Analysis Technique of Cross-Browser Compatibility Detecting,” in 2015 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence, Jul. 2015, pp. 103–107. doi: 10.1109/ACIT-CSI.2015.26.
[8] T. Murathan, “Identification of Internet Usage and Dependency Level of Physical Education and Sport Teaching Students.,” Int. Educ. Stud., vol. 11, pp. 14–22, 2018.
[9] T. A. Khan and R. Heckel, “A Methodology for Model-Based Regression Testing of Web Services,” in 2009 Testing: Academic and Industrial Conference - Practice and Research Techniques, Sep. 2009, pp. 123–124. doi: 10.1109/TAICPART.2009.23.
[10] R. Tetali, J. Bose, and T. Arif, “Browser with Clustering of Web Documents,” in 2013 2nd International Conference on Advanced Computing, Networking and Security, Dec. 2013, pp. 164–168. doi: 10.1109/ADCONS.2013.20.
[11] B. Popp, F. Sweiss, D. Barsan, G. Stasa, and S. Niyogi, “Automated system for tresting a web application,” US Pat. 10972162 11 5 2006.
[12] F. Ricca and P. Tonella, “Analysis and testing of web applications,” Proc. 23rd Int. Conf. Softw. Eng. ICSE 2001, 2001.
[13] V. Stoyanova, D. Petrova-Antonova, and S. Ilieva, “Automation of Test Case Generation and Execution for Testing Web Service Orchestrations,” in 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering, Mar. 2013, pp. 274–279. doi: 10.1109/SOSE.2013.9.
[14] R. Gupta and N. Bajpai, “A Keyword-Driven Tool for Testing Web Applications (KeyDriver),” IEEE Potentials, vol. 33, no. 5, pp. 35–42, Sep. 2014, doi: 10.1109/MPOT.2012.2202135.
[15] M. Hanna, A. E. Aboutabl, and M.-S. M. Mostafa, “Automated software testing framework for web applications,” Int. J. Appl. Eng. Res., vol. 13, no. 11, pp. 9758–9767, 2018.
[16] S. Gojare, R. Joshi, and D. Gaigaware, “Analysis and Design of Selenium WebDriver Automation Testing Framework,” Procedia Comput. Sci., vol. 50, pp. 341–346, Jan. 2015, doi: 10.1016/j.procs.2015.04.038.
[17] P. Ramya, V. Sindhura, and P. V. Sagar, “Testing using selenium web driver,” in 2017 Second International Conference on Electrical, Computer and Communication Technologies (ICECCT), Feb. 2017, pp. 1–7. doi: 10.1109/ICECCT.2017.8117878.
[18] M. Leotta, D. Clerissi, F. Ricca, and P. Tonella, “Chapter Five - Approaches and Tools for Automated End-to-End Web Testing,” in Advances in Computers, vol. 101, A. Memon, Ed. Elsevier, 2016, pp. 193–237. doi: 10.1016/bs.adcom.2015.11.007.
[19] J. Imtiaz, M. Z. Iqbal, and M. U. khan, “An automated model-based approach to repair test suites of evolving web applications,” J. Syst. Softw., vol. 171, p. 110841, Jan. 2021, doi: 10.1016/j.jss.2020.110841.
[20] X.-F. Qi, Y.-L. Hua, P. Wang, and Z.-Y. Wang, “Leveraging keyword-guided exploration to build test models for web applications,” Inf. Softw. Technol., vol. 111, pp. 110–119, Jul. 2019, doi: 10.1016/j.infsof.2019.03.016.
[21] K. V. Arya and H. Verma, “Keyword driven automated testing framework for web application,” in 2014 9th International Conference on Industrial and Information Systems (ICIIS), Dec. 2014, pp. 1–6. doi: 10.1109/ICIINFS.2014.7036478.
[22] “ISO/IEC/IEEE International Standard - Software and systems engineering – Software testing – Part 5: Keyword-Driven Testing,” ISOIECIEEE 29119-5 First Ed. 2016-11-15, pp. 1–69, Nov. 2016, doi: 10.1109/IEEESTD.2016.7750539.
[23] “Improving Web Application Testing with User Session Data,” 25th Int. Conf. Softw. Eng. 2003 Proc. IEEE 2003, pp. 49–59.
[24] S.-J. Lee, Y.-X. Chen, S.-P. Ma, and W.-T. Lee, “Test Command Auto-Wait Mechanisms for Record and Playback-Style Web Application Testing,” in 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Jul. 2018, vol. 02, pp. 75–80. doi: 10.1109/COMPSAC.2018.10206.
[25] B. Mehta and M. Narvekar, “DOM tree based approach for Web content extraction,” in 2015 International Conference on Communication, Information Computing Technology (ICCICT), Jan. 2015, pp. 1–6. doi: 10.1109/ICCICT.2015.7045706.
[26] D. Meister, “The nature of human error,” in 1989 IEEE Global Telecommunications Conference and Exhibition “Communications Technology for the 1990s and Beyond,” Nov. 1989, pp. 783–786 vol.2. doi: 10.1109/GLOCOM.1989.64071.
[27] T. Wu, Y. Wan, Y. Xi, and C. Chen, “Study on the Automatic Test Framework Based on Three-tier Data Driven Mechanism,” in 2009 Eighth IEEE/ACIS International Conference on Computer and Information Science, Jun. 2009, pp. 996–1001. doi: 10.1109/ICIS.2009.26.
[28] X. Wang and G. He, “The research of data-driven testing based on QTP,” in 2014 9th International Conference on Computer Science Education, Aug. 2014, pp. 1063–1066. doi: 10.1109/ICCSE.2014.6926625.
[29] Z. Sun, Y. Zhang, and Y. Yan, “A Web Testing Platform Based on Hybrid Automated Testing Framework,” in 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Dec. 2019, vol. 1, pp. 689–692. doi: 10.1109/IAEAC47372.2019.8997684.
[30] W. Guo, X. Fu, and J. Feng, “A Data-Driven Software Testing Tools Integration System,” in 2010 International Conference on Computational Intelligence and Software Engineering, Dec. 2010, pp. 1–4. doi: 10.1109/CISE.2010.5676878.
[31] “IEEE Standard for Software Test Documentation,” IEEE Std 829-1998, pp. 1–64, Dec. 1998, doi: 10.1109/IEEESTD.1998.88820.
[32] S. Bullock, “Report on a pilot project successfully implementing a design-to-test methodology,” in Proceedings of 1995 IEEE International Test Conference (ITC), Oct. 1995, pp. 771–780. doi: 10.1109/TEST.1995.529908.
[33] S. Huang, H. Chen, Z. Hui, and Y. Liu, “A Survey of the Use of Test Report in Crowdsourced Testing,” in 2020 IEEE 20th International Conference on Software Quality, Reliability and Security (QRS), Dec. 2020, pp. 430–441. doi: 10.1109/QRS51102.2020.00062.
[34] C. Klammer and R. Ramler, “A Journey from Manual Testing to Automated Test Generation in an Industry Project,” in 2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C), Jul. 2017, pp. 591–592. doi: 10.1109/QRS-C.2017.108.
[35] A. Najafi, W. Shang, and P. C. Rigby, “Improving Test Effectiveness Using Test Executions History: An Industrial Experience Report,” in 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), May 2019, pp. 213–222. doi: 10.1109/ICSE-SEIP.2019.00031.
[36] M. Bures and M. Filipsky, “SmartDriver: Extension of Selenium WebDriver to Create More Efficient Automated Tests,” in 2016 6th International Conference on IT Convergence and Security (ICITCS), Sep. 2016, pp. 1–4. doi: 10.1109/ICITCS.2016.7740370.
[37] A. Mesbah and M. R. Prasad, “Automated cross-browser compatibility testing,” in 2011 33rd International Conference on Software Engineering (ICSE), May 2011, pp. 561–570. doi: 10.1145/1985793.1985870.
[38] R. Ramler and R. Hoschek, “How to Test in Sixteen Languages? Automation Support for Localization Testing,” in 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST), Mar. 2017, pp. 542–543. doi: 10.1109/ICST.2017.63.
[39] A. Alameer and W. G. J. Halfond, “An Empirical Study of Internationalization Failures in the Web,” in 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME), Oct. 2016, pp. 88–98. doi: 10.1109/ICSME.2016.55.
[40] P. Kunte and D. Mane, “Automation Testing of Web based application with Selenium and HP UFT (QTP),” Int. Res. J. Eng. Technol. IRJET, vol. 406, no. 2395–0072, pp. 2579–2583, 2017.