簡易檢索 / 詳目顯示

研究生: 劉恣惠
Liu, Zih-Hui
論文名稱: 建構英文學習網站之多面向評量準則—以大學生使用族群為例
Constructing Multidimensional Evaluation Criteria of English Learning Websites for University Students
指導教授: 劉繼仁
Liu, Gi-Zen
學位類別: 碩士
Master
系所名稱: 文學院 - 外國語文學系
Department of Foreign Languages and Literature
論文出版年: 2009
畢業學年度: 97
語文別: 英文
論文頁數: 146
中文關鍵詞: 輔助教學英文學習網站評量準則網站使用性科技整合
外文關鍵詞: evaluation criteria, English learning websites, web usability, technology integration, four language skills, learner preferences, language areas, learning materials
相關次數: 點閱:143下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 個人電腦和網際網路的普及化,無疑對現今的世界帶來了巨大的變化,而電腦與不同專業領域的結合,也激發了不同的創意,進而帶來新的契機!語言學習與電腦的結合,正是一例;這樣的跨領域合作,同時也促進了語言學習網站的發展與增加,尤其是以外語學習網站為大宗。在台灣,英文是教育部規定的官方外語,使用英文學習網站學英文,對台灣的學生而言,也並不完全陌生。然而,與日俱增的英文學習網站的數量與其網站品質並不一定能劃上等號,對英文學習網站的使用者而言,選擇一個高品質且合適的網站,似乎不是一件易事。因此,本研究旨在建構英文學習網站的多面向評量準則,所謂的多面向評量準則,則是研究者考量下列相關概念,所衍生之準則─網站使用性、學習教材、協助語言學習功能,科技整合,及學習者偏好。
    為了達到此一目的,本研究採用四階段式的研究流程,進而衍生及篩選評量準則。在第一階段,研究者針對先前文獻及自身經驗,建立初步的評量準則。在第二階段,研究者鎖定有英文學習網站半年以上使用經驗的大學生為主要研究對象,利用線上問卷系統,詢問他們對初步評量準則的重要性的偏好為何,在此階段,研究者共蒐集到160份有效問卷。在第三階段,研究者針對問卷結果,進行專家訪談,進而篩選掉重要性偏低的評量準則。因為英文學習網站為跨領域與跨學科的結合成果,研究者一同邀請3位英語教學老師以及4位電腦輔助教學專家,進行訪談,以期得到更全面性的分析。最後,在第四階段,研究者將統整第二階段的問卷結果和第三階段的訪談結果,篩選評量準則,並進而建構英文學習網站的多面向評量準則。此外,有鑑於評量準則的使用及評量結果判定有相當的難度,因此研究者也提供了英文網站的評量示範及評量結果說明,以供參考。
    本研究結果,不單只是建構英文學習網站的評量準則,同時也指出了英文學習網站的架構是多層次及多面向,因此,整合各方相關概念所衍生的評量準則,不但有其重要性,同時對於老師或學生評量及選擇英文學習網站這方面,才能有效率更有效益。

    The widespread use of computers and the Internet has naturally had effects on the practices of English language learning and teaching. One aspect of this is the rapid proliferation of language learning websites. However, one problem is that are as yet no firm criteria to evaluate such websites, making it difficult for learners to decide which best suit their needs (Yang & Chan, 2008). Although Yang and Chan noted that many researchers have constructed evaluation guidelines for English learning websites, they also reported that these are often inadequate.
    Therefore, the main purpose of this study is to construct a multidimensional set of criteria to help learners and teachers evaluate the quality of English learning websites. In addition, these evaluation guidelines should be derived under the consideration of web usability, learning materials, functionality of assisting language learning, technology integration, and learner preferences. In order to achieve this goal, the researcher conducts a four-phase procedure and utilizes both qualitative and quantitative research methods to construct and refine the evaluation criteria.
    In the first phase, the researcher synthesized and established a preliminary set of evaluation criteria based on the review of previously related studies. In the second phase, an online survey was distributed in order to obtain information on English learning website users’ preferences towards the preliminary set of evaluation criteria. The participants were college students with more than six months of experience in using English learning websites. After the distribution of the online questionnaire, the researcher received 160 valid surveys. In the third phase, the researcher recruited seven experts to discuss the survey results. Three of them came from the English learning and teaching field, while the other four were computer-assisted language learning (CALL) experts. In the fourth phase, the researcher validated and finalized the evaluation criteria based on both experts’ and participants’ opinions. In addition, when evaluating existing English learning websites, there is a degree of difficulties to apply the derived criteria and explain what the result indicates. Therefore, the researcher also provided a demonstration of evaluating an existing English learning website with the derived criteria and the explanation of what the result indicated.
    It is expected that the present study can bring forth a multidimensional set of evaluation criteria derived from the notions of web usability, learning materials, functionality of assisting language learning, and technology integration. In addition, the results of the study not only lead to the construction of the evaluation criteria, but also a prove that since the structure of English learning websites is multi-layered and diversified, such a multidimensional set of criteria is necessary for their evaluation.

    Abstract (Chinese) i Abstract (English) iii Acknowledgement v Table of Contents vi List of Tables xi List of Figures xv CHAPTER ONE INTRODUCTION 1 Background of the Study 1 The Importance of Deriving an Integrated Set of Evaluation Criteria for English Learning Websites 3 Purpose of the Study 4 Significance of the Study 5 Definition of Terms 6 CHAPTER TWO LITERATURE REVIEW 8 Second/Foreign Language Learning and Teaching 8 Second Language Acquisition (SLA) 9 Second Language Teaching Methods 9 Linguistic Competence and Communicative Competence 10 Four Language Skills and Major Language Areas 12 The Standards of the American Council on the Teaching of Foreign Languages (ACTFL) for Foreign Language Learning 12 Classroom Culture of SLA and Vygotsky’s Sociocultural Theory 14 English Learning and Teaching in Taiwan 15 Internet-based Technology Integrated in SLA Curricula 18 General Categorization of Internet-based Technology (IBT) 18 The Reason for Integrating IBT in SLA Curricula 20 The Innovation of Technology and Its Impact on SLA 21 The Incorporation of English Learning Websites in English Courses in Taiwan 23 Evaluation of Language Learning Websites 24 Web usability 24 Evaluation of Learning Materials 28 Language Leaner’s Preferences and Satisfaction 32 The Advantages and Disadvantages of Online Survey Research 34 Research questions 36 CHAPTER THREE METHODOLOGY 38 Research design 38 Phase I— Synthesizing and Establishing a Preliminary Set of Evaluation Criteria Based on a Review of the Literature 40 The Classification of Variables for the Construction of Evaluation Criteria 42 Evaluation Criteria for Web Usability 44 Evaluation Criteria for Learning Materials 45 Evaluation Criteria for English Learning Websites’ Functionality With Regard to Assisting Language Learning 46 Evaluation Criteria for Technology Integration 48 Phase II—A Survey of English Learning Website Users 49 Participants 49 Data Analysis 49 Phase III—Discussions with Experts 50 Participants 51 Data Instruments 52 Data Analysis 53 Phase IV—finalizing the evaluation criteria for English learning websites 53 CHAPTER FOUR RESULTS AND FINDINGS 54 Synthesizing and Establishing a Preliminary Set of Evaluation Criteria Based on a Review of Related Studies—Samples of the Derivation of Evaluation Criteria 55 RQ-1.1: Based on related studies and learner preferences, what are the evaluation criteria for the web usability of English learning websites? 55 RQ-2.1: Based on the notion of the four language skills, major language areas, ACTFL’s Standards for Foreign Language Learning (1996), and learner preferences, what are the evaluation criteria for the learning materials presented in English learning websites? 56 RQ-3.1: Based on related studies and learner preferences, what are the evaluation criteria for English learning websites’ functionality in assisting language learning? 58 RQ-4.1: Based on related studies and learner preferences, what are the evaluation criteria for the technology integrated in English learning websites? 59 Conducting a Survey to Obtain the Opinions of English Learning Website Users About the Preliminary Set of Evaluation Criteria 60 The Reliability and Validity of the Survey and Results 60 The Analysis of the Survey Results 62 Background Information on the Participants 62 The Preservation of the Preliminary Evaluation Criteria in Responding to RQs-1.2, 2.2, 3.2, and 4.2 64 Pearson Chi-square Analysis for the Criteria that Less than 60% of the Participants Considered Important 67 Discussion with Experts on the Selection and Elimination of the Evaluation Criteria 71 The Revision and Finalization of Evaluation Criteria for English Learning Websites in Response to RQ-5 80 The Two Major Types of English Learning Websites 80 RQ-5: Taking both the website users’ and experts’ opinions into consideration, what are the refined and finalized evaluation criteria for web usability, learning materials, functionality, and technology integration of English learning websites? 81 CHAPTER FIVE DISCUSSION AND CONCLUSION 90 A Multi-layered and Multi-dimensional Combination— The Tree Structure of English Learning Websites 91 The Multi-dimensionality and Flexibility of Evaluation Criteria 93 The Reliability of Survey Results and How to Reduce the Rate of Invalid Responses to an Online Survey 95 The Tendency of Online Learners Being Isolated Learners 97 Most Website Users’ Perceptions of English Learning Websites 99 English Learning Websites for Fun or Learning/ for Young or Adult Learners 101 Evaluation Criteria in Real Use—Demonstration of Evaluating Existing English Learning Websites 104 Conclusions 109 Limitation of the Study 110 Recommendations 110 Recommendations for Practitioners and English Teachers 110 Recommendations for Website Sponsors and Website Managers 112 Recommendations for Further Studies 112 References 114 Appendixes 119 Appendix A: The preliminary set of evaluation criteria 119 Appendix B: The Chinese version of preliminary evaluation criteria 123 Appendix C: The complete version of survey questions 126 Appendix D: The cross tabulation regarding variables majors and school grade 137 Appendix E: Consent Form 138 Appendix F: Tables of the Range of Evaluation Criteria Passed and the Degree of Qualification Suggested by the Researcher 139 Appendix G: A Sample of the Derived Evaluation Criteria Combined with the Five-point Likert Scale 141 Appendix H: Tables of the Score Received for the evaluation of English Learning Websites and the Degree of Qualification Suggested by the Researcher 143

    American Council on the Teaching of Foreign Languages. (1996). Standards for foreign language learning: Executive summary. Retrieved September 10, 2008 from http://www.actfl.org/i4a/pages/index.cfm?pageid=3324
    Aggarwal, A. (2000). Web-based learning and teaching technologies: Opportunities and challenges. Hershey, PA: Idea Group Pub.
    Biesenbach-Lucas, S. (2005). Communication topics and strategies in e-mail consultation: comparison between American and international university students. Language Learning & Technology, 9(2), 24-46.
    Burns, C., & Myhill, D. (2004). Interactive or inactive? A consideration of the nature of interaction in whole class teaching. Cambridge Journal of Education, 34, 35-49.
    Carmines, E. G., & Zeller, R. A. (1988), Reliability and validity assessment. Sage, Beverly Hills, CA..
    Chang, S., & Chang, Y.-C. (2004). Computer assisted language learning based on corpora and natural language processing: the experience of project CANDLE. Paper presented at the Interactive Workshop on Language E-Learning.
    ChanLin, L., Hong , J., Horng, J., Chang , S., & Chu , H. (2006). Factors influencing technology integration in teaching—A Taiwanese perspective. Journal of Innovations in Education and Teaching International, 43(1), 57-68.
    Chern, C.-L. (2002). English language teaching in Taiwan today. Asia-Pacific Journal of Education, 22(2), 97-105.
    Coyle, D. (2007). Strategic classrooms: learning communities which nurture the development of learner strategies Language Learning Journal, 35(1), 65-79.
    Gass, S. M., & Selinker, L. (1994). Second language acquisition: An introductory course. Hillsdale, NJ: Lawrence Erlbaum Associates.
    Driscoll, M. P. (2005). Psychology of learning for instruction (3rd ed.). Boston: Pearson Allyn and Bacon.
    Graddol, D. (2004). The future of language. Science, 303, 1329-1331.
    Hu, H.-P., & Deng, L.-J. (2007). Vocabulary acquisition in multimedia environment. US-China Foreign Language, 5, 55-59.
    Hughes, J., Mcavinia, C., & King, T. (2004). What really makes students like a web site? What are the implications for designing web-based language learning sites? ReCALL, 16(1), 85-102.
    Karoulis, A., Demetriadis, S., & Pombortsis, A. (2006). Comparison of expert-based and empirical evaluation methodologies in the case of a CBL environment: The 'Orestis' experience. Computers & Education, 47(2), 172-185.
    Larsen-Freeman, D. (2000). Techniques and principles in language teaching. New York, N.Y: Oxford University Press.
    Levy, M. (2007). Research and technological innovation in CALL. Innovation in Language Learning and Teaching, 1, 180-190.
    Levy, M., & Stockwell, G. (2006). CALL Dimensions: options and issues in computer assisted language learning. Mahwah, NJ: L. Erbaum Associates.
    Liang, J.-K., Liu, T.-C., Wang, H.-Y., Chang, B., Deng, Y.-C., Yang, J.-C., Chou, C.-Y., Ko, H.-W., Yang, S., & Chan, T.-W. (2005). A few design perspectives on one-on-one digital classroom environment. Computer Assisted Learning, 21, 181-189.
    Liaw, M.-L. (2006). E-learning and the development of intercultural competence. Language Learning & Technology, 10(3), 49-64.
    Liou, H. (2000). Development of the ELT in Taiwan-Website for English learning and teaching. Paper presented at the Proceedings of ICCE/ICCAI 2000 (the 8th Int’l conference on Computers in Education: Learning societies in the new millennium: creativity, caring and commitments) Taipei: Grand Hotel.
    Liu, G. Z., & Chen, S. W. (2007). A taxonomy of Internet-based technologies integrated in language curricula. British Journal of Educational Technology, 38 (5), 934-938.
    Liu, G. Z. (2005). The trend and challenge for teaching EFL at Taiwanese Universities. RELC Journal, 36 (2), 211-221.
    Liu, G. Z. (2009). Review: Conacher, Jean E. & Kelly-Holmes, Helen (eds.). New learning environments for language learning: Moving beyond the classroom?. Peter Lang (Frankfurt & New York). British Journal of Educational Technology, 40(1), 185-186.
    O'Dowd, R. (2003). Understanding the "other side": Intercultural learning in a Spanish-English e-mail exchange. Language Learning & Technology, 7(2), 118-144.
    Pituch, K. A., & Lee, Y.-K. (2006). The influence of system characteristics on e-learning use. Computers & Education, 47, 222-244.
    Preece, J. (1995). Human-computer interaction. Wokingham, England ; Reading, Mass.: Addison-Wesley Pub. Co.
    Richards, J. C., & Rodgers, T. S. (2001). Approaches and methods in language teaching (2nd ed.). New York: Cambridge University Press.
    Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Ruch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27 (2), 94-104.
    Saville-Troike, M. (2006). Introducing second language acquisition. New York: Cambridge University Press.
    Shee, Y., & Wang, Y.-S. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 5(3), 894-905.
    Shen, W.-W. (2003). Current trends of vocabulary teaching and learning strategies for EFL settings. Feng Chia Journal of Humanities and Social Sciences, 7, 187-224.
    Shield, L., & Kukulska-Hulme, A. (2006). Are language learning websites special? Towards a research agenda for discipline-specific usability. Journal of Educational Multimedia and Hypermedia, 15(3), 349-369.
    Sykes, J. M., & Cohen, A. D. (2008). Observed learner behavior, reported use, and evaluation of a website for learning Spanish pragmatics. Paper presented at the Proceedings of the 2007 Second Language Research Forum, Somerville.
    Tsou, W., Wang, W., & Tzeng, Y. (2006). Applying a multimedia storytelling website in foreign language learning. Computers & Education, 47, 17-28.
    Tu, C.-H.,& Twu, H.-L. (2002). Educational technology in Taiwan. Educational Media International, 39(2), 153-164.
    Volle, L. M. (2005). Analyzing oral skills in voice e-mail and online interviews. Language Learning & Technology, 9(3), 146-163.
    Vygotsky, L. (1986). Thought and language. Cambridge, Mass. :MIT Press.
    Watanabe, Y., & M., S. (2007). Effects of proficiency differences and patterns of pair interaction on second language learning: collaborative dialogue between adult ESL learners. Language Teaching Research, 11(2), 121-142.
    Wörde, R. V. (2003). Students’ perspectives on foreign language anxiety. Inquiry, 8(3). Retrieved from http://www.vccaedu.org/inquiry/inquiry-spring2003/i-81-worde.html
    Wright, K. B. (2005). Researching Internet-based populations: Advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web survey services. Journal of Computer-Mediated Communication, 10(3), article 11. Retrieved from http://jcmc.indiana.edu/vol10/issue3/wright.html.
    Wu, W.-S. (2005a). Use and helpfulness rankings of vocabulary learning strategies employed by EFL learners in Taiwan. Journal of Humanities and Social Sciences, 1(2), 7-13.
    Wu, W.-S. (2005b). Web-based English learning and teaching in Taiwan: Possibilities and challenges. Paper presented at the First Hsiang-shan Area Intercollegiate International Conference on English Language Teaching.
    Yang, S. C., & Chen, Y. (2007). Technology-enhanced language learning: A case study. Computers in Human Behavior, 23, 860-879.
    Yang, Y.-T., & Chan, C.-Y. (2008). Comprehensive evaluation criteria for English learning websites using expert validity surveys. Computers & Education, 51(1), 403-422.
    Zapata G., & Sagarra, N. (2007). CALL on hold: the delayed benefits of an online workbook on L2 vocabulary learning. Computer Assisted Language Learning, 20(2), 153-171.
    Liu, G. Z. (2007). 數位語言學習之現況與類型. 教育研究月刊, 163, 61-76頁。
    Wu, T. S. (1985). 態度與行為研究的信度與效度:理論、應用、反省. 民意學術專刊,夏季刊,10-60頁。

    下載圖示 校內:2010-07-21公開
    校外:2010-07-21公開
    QR CODE