{"id":857,"date":"2019-02-08T14:57:52","date_gmt":"2019-02-08T05:57:52","guid":{"rendered":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/?page_id=857"},"modified":"2020-09-14T10:13:19","modified_gmt":"2020-09-14T01:13:19","slug":"moore_et_al_2","status":"publish","type":"page","link":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/issues\/jan19\/moore_et_al_2\/","title":{"rendered":"Machine Translation for EFL"},"content":{"rendered":"<p><span style=\"color: #000000;\"><strong>Paul J. Moore (University of Queensland), Phil Murphy, Luann Pascucci, and Scott Sustenance (Kanda University of International Studies)<\/strong><\/span><\/p>\n<p>Moore, P.J., Murphy, P., Pascucci, L., &amp; Sustenance, S. (2019).\u00a0Machine translation for EFL.\u00a0<em>Relay Journal, 2<\/em>(1), 228-235.\u00a0https:\/\/doi.org\/10.37237\/relay\/020127<\/p>\n<p>[<a href=\"https:\/\/drive.google.com\/file\/d\/1cV_cNFotaKyrZ018Dj6_TztOevr6hCJ7\/view?usp=sharing\" target=\"_blank\" rel=\"noopener\">Download paginated PDF version<\/a>]<\/p>\n<p><span style=\"color: #ff0000;\">*This page reflects the original version of this document. Please see PDF for most recent and updated version.<\/span><\/p>\n<p><span style=\"color: #000000;\">Abstract<\/span><\/p>\n<p><span style=\"color: #000000;\">This paper reports on an ongoing study into the affordances of free online machine translation for students learning English as a foreign language (EFL) at the tertiary level in Japan. The researchers are currently collecting data from a questionnaire, task performance, and interviews with 10-15 EFL learners in an English Language Institute in a university in Japan. The paper provides some background on the changing role of translation in language learning theory and pedagogy, before focusing literature related to technical developments in machine translation technology, and its application to foreign language learning. An overview of the research methodology is provided, along with some insights into potential findings. Findings will be presented in subsequent publications.<\/span><\/p>\n<p><span style=\"color: #000000;\"><em>Keywords<\/em>: online machine translation, EFL, Japanese university<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #000000;\">The study reported here investigates the interaction between language learner, technology and task in evaluating the affordances of Google Translate in second language task performance (Chapelle, 2001), to ascertain how the technology mediates task performance in a Japanese university context, across tasks of varying complexity and modality. In line with the broader focus on how second language production and interaction are mediated by technology in the field of computer-assisted language learning there have been recent calls to investigate how computer-based speaking performance is influenced by learners\u2019 interaction through and with technology (Chung, 2017; Iwashita, May &amp; Moore, 2017). Reflecting on how communication is increasingly technologically mediated in broader society (and second language learning), Chapelle and her colleagues (e.g., Sauro &amp; Chapelle, 2017) argue that the construct of L2 communicative competence should be broadened to include technological competence in cultural contexts. By investigating the complex interactions among test-taker, task and technology in a Japanese context, this study has the potential to provide further insights into technologically mediated communicative competence.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Literature Review<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\"><em><strong>The role of translation in foreign language learning<\/strong><\/em><\/span><\/p>\n<p><span style=\"color: #000000;\">Informed by the prominence of communicative language teaching (CLT) in second language acquisition (SLA) theory, as well as a general rejection of traditional grammar translation methodology (e.g., Howatt, 1984), translation was generally discounted as a pedagogical tool from a cognitive SLA perspective. This perspective has included an assumption that maximal exposure to the second language is necessary for second language development, and that use of the first language in second language pedagogy interferes with the development of second language proficiency. Recent perspectives on second language learning (e.g., Cook, 2010, Moore, 2013, 2017, 2018; Ortega, 2014), have led to a reconsideration of the supporting roles that the L1 play in the development of second (bi\/multilingual) language proficiency.<\/span><\/p>\n<p><span style=\"color: #000000;\"><em><strong>Online machine translation<\/strong><\/em><\/span><\/p>\n<p><span style=\"color: #000000;\">As with the introduction of all new technologies, there is a long held distinction between the hype, often created in the first instance by the creators of the technology (including MT language service providers), and the reality. Historically, the hype of emerging technologies has been met with polarizing views on their potential influence on society, and education. From the field of translation education, Cronin (2013, p. 2) distinguishes between \u2018the backwards look\u2019, which laments the lost skills (and jobs) brought about by automation and \u2018the forwards look\u2019 which sees technological advances as miraculous panacea. In tracing the development of machine translation, from IBM\u2019s 1954 \u2018electronic brain\u2019 Georgetown experiment to Google\u2019s 2016 introduction of neural machine translation (NMT), Moorkens (2018) argues that that there has been some improvement in accuracy, though the hype surrounding NMT is somewhat responsible for a boom in its by translation service providers. In professional translation, MT is commonly used in conjunction with human translation, and May (2018) draws on the concept of \u2018fitness for purpose\u2019 to establish conditions regarding when and how MT may be utilised. This concept is also useful for second language learning and use, in that critical awareness of the affordances of such tools may be important in determining the conditions under which they may support language learning.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong><em>Online machine translation and foreign language learning<\/em><\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">Little research has been undertaken into the use of online machine translation (OMT) for foreign language learning, and the existing research generally relies on self-report data. Such an approach suggests the exploratory nature of this relatively new research area. Recent research has focused on the role of MT in post-editing of academic writing (O\u2019Brien et al., 2018) for EFL writers, finding that participants had mixed views as to the effectiveness of MT in comparison with self-editing of their written work. Groves &amp; Mundt (2015) argue that regardless of teachers\u2019 and researchers\u2019 perspectives, learners of English will draw on tools like Google Translate if they perceive them as useful. Briggs (2018) reports on a survey of 80 Korean learners of EFL regarding their use of and perceptions as to the effectiveness of OMT in supporting their language learning. Approximately half of the participants reported believing that OMT was beneficial for language learning, and that their use should be permitted in EFL classrooms.<\/span><\/p>\n<p><span style=\"color: #000000;\">The fact that learners perceive OMT favourably supports their continued use for language learning purposes, and learners and teachers should be critically aware of the affordances of such tools. Interestingly, learners in recent studies reported above seem to be less aware of the capability of OMT to analyse spoken language, and its speech-to-text capabilities, the former of which was a major focus of the hype generated during the launch of Google\u2019s Pixel 2 in October 2017.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Research Questions<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">RQ1. How does GT mediate learners\u2019 performance on a range of second language tasks, varying in complexity and modality?<\/span><\/p>\n<ol style=\"list-style: lower-alpha;\">\n<li><span style=\"color: #000000;\">A one-way oral task (giving directions);<\/span><\/li>\n<li><span style=\"color: #000000;\">A multimodal task (interpreting a sign);<\/span><\/li>\n<li><span style=\"color: #000000;\">A writing task (based on prompts);<\/span><\/li>\n<li><span style=\"color: #000000;\">A narrative task (recounting experience).<\/span><\/li>\n<\/ol>\n<p><span style=\"color: #000000;\">RQ2. How effectively does GT perform in translating language learners\u2019 L1 or L2 output in each task?<\/span><\/p>\n<p><span style=\"color: #000000;\">RQ3. How effective is GT in supporting (a) task performance and (b) independent language learning, as perceived by the learners.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Overview of the Methodology<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">The research follows a qualitative design with a focus on an empirical evaluation of the affordances of Google Translate (GT) for independent CALL (Chapelle, 2001; Levy &amp; Moore, 2018). Data from four sources will be triangulated to answer the three research questions. In addition to allowing for data collection over a short period of time, such a design also allows for validation of findings from a range of perspectives.<\/span><\/p>\n<p><span style=\"color: #000000;\"><em><strong>Participants<\/strong><\/em><\/span><\/p>\n<p><span style=\"color: #000000;\">The study is being conducted in an English Language Institute in a small private university in Japan, where students major in languages as well as related programs in international studies. Data are being collected from ten first or second year students of English as a foreign language (aged 18-21), enrolled in English language courses at the university. As such, recruitment will be based on a convenience sample of potential participants who fit the purpose of the study (D\u00f6rnyei &amp; Taguchi, 2010). Student participants\u2019 language proficiency will be at the intermediate level (A2 or B1 on the internationally recognised Common European Framework for Languages CEFR).<\/span><\/p>\n<p><span style=\"color: #000000;\"><em><strong>Data collection<\/strong><\/em><\/span><\/p>\n<p><span style=\"color: #000000;\">This study will draw upon three major data sources:<\/span><\/p>\n<ul>\n<li><span style=\"color: #000000;\">A background survey<\/span><\/li>\n<li><span style=\"color: #000000;\">Video-recorded reflection meetings between students and learning advisors (both LAs are co-investigators on the project);<\/span><\/li>\n<li><span style=\"color: #000000;\">A follow-up semi-structured interview, where participants reflect on their experience with the technology<\/span><\/li>\n<\/ul>\n<p><span style=\"color: #000000;\"><em><strong>Data analysis<\/strong><\/em><\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Background survey. <\/strong>Survey data will provide background data on participants\u2019 age, language learning experience, second language proficiency, and experience with and preliminary perceptions of OMT technologies.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Analysis of recorded interactions. <\/strong>(i) <em>GT output<\/em>: Following Briggs (2018) and Moorkens et al. (2018) the quality of the GT output will be analysed for quality, including errors in inflection morphology, word order, omission, addition, or mistranslation. (ii) <em>Learners\u2019 task-based technology-mediated interaction<\/em>: The recorded interactions will be analysed inductively for instances where and how the learners use the technology, and how the technology may influence the interaction. This analysis will be triangulated against learners\u2019 perceptions provided in the follow-up interviews.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Analysis of interview data.<\/strong> Interview data will be coded and analysed collaboratively in an iterative process, using NVivo10. Transcripts will be read and re-read independently by two of the researchers before meeting to compare, reach agreement, and develop categories which represent both expected themes and those arising from the data. The approach taken here, following King and Horrocks (2010), is to code for concepts arising from the framework provided by the research questions (and the literature they were based on), and for those which emerge from the data (to be initially tracked through the use of memos in NVivo), and then to cluster related codes into themes representing aspects of the data more broadly (Miles &amp; Huberman, 1994).<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Preliminary Observations<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">Data analysis will commence after the completion of data collection in January, 2019. It is expected that all learners will be aware of the text translation capability of GT, but they will be less familiar with the voice recognition and augmented-reality-supported camera functions. Text-based translation is expected to be more accurate than other functions, which convert audio or visual data to text before translation occurs. Across all modalities, it is expected that increases in task and language complexity will result in reduced accuracy. It is also expected that learners will trust the accuracy of the output of GT, except for glaring errors, in line with their levels of language proficiency. Learners\u2019 feedback on the affordances and appropriacy of using GT in their language learning are expected to be influenced by their prior experience with similar tools, as well as personal and institutional language ideologies and policies.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Notes on the Contributors<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">Paul J. Moore lectures in and coordinates the Master of Applied Linguistics program in The School of Languages and Cultures, University of Queensland. His research interests include task-based interaction in face-to-face and technologically mediated contexts, intercultural discourse, and the dynamic roles of the L1 in L2 interaction. His research interests include sociocognitive perspectives on task-based interaction in classroom and online contexts, intercultural communication, and the dynamic roles of the L1 in L2 interaction. <a style=\"color: #000000;\" href=\"mailto:P.moore5@uq.edu.au\">P.moore5@uq.edu.au<\/a><\/span><\/p>\n<p><span style=\"color: #000000;\">Phil Murphy is Professor of English and Director of the English Language Institute at Kanda University of International Studies. His research interests include computer-mediated interaction and feedback, collaborative reading, as well as the application of augmented reality to second language learning.<\/span><\/p>\n<p><span style=\"color: #000000;\">Luann Pascucci is a Senior Lecturer at Kanda University of International Studies. She has a Master of Arts in Linguistics from the University of South Florida, and her research interests include digital game-based language learning, CLIL\/CBLT, translation, and pragmatics.<\/span><\/p>\n<p><span style=\"color: #000000;\">Scott Sustenance is a Senior Lecturer in the English Language Institute at Kanda University of International Studies in Japan. He has a Master of Arts in Applied Linguistics from Griffith University, Australia, and his research interests include vocabulary retention, linguistic landscapes and technology in the classroom.<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>References<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">Briggs, M. (2018). Neural machine translation tools in the language learning classroom: Students\u2019 use, perceptions, and analyses. <em>JALT CALL Journal 14<\/em>(1), 3-24.<\/span><\/p>\n<p><span style=\"color: #000000;\">Chapelle, C. A. (2001). <em>Computer applications in second language acquisition: Foundations for teaching, testing and research<\/em>. Cambridge: Cambridge University Press.<\/span><\/p>\n<p><span style=\"color: #000000;\">Chung, Y.-R. (2017). Validation of technology-assisted language tests. In C. Chapelle &amp; S Sauro (Eds.), <em>The Handbook of technology and second language teaching and learning<\/em> (pp. 332-347). Hoboken, NJ: John Wiley &amp; Sons, Inc.<\/span><\/p>\n<p><span style=\"color: #000000;\">Cook, G. (2010). <em>Translation in language teaching.<\/em> Oxford: Oxford University Press.<\/span><\/p>\n<p><span style=\"color: #000000;\">Cronin, M. (2013). <em>Translation in the digital age<\/em>. London and New York: Routledge.<\/span><\/p>\n<p><span style=\"color: #000000;\">D\u00f6rnyei, Z., &amp; Taguchi. T. (2010). <em>Questionnaires in second language research<\/em> (2<sup>nd<\/sup> ed.). London and New York: Routledge.<\/span><\/p>\n<p><span style=\"color: #000000;\">Groves, M., &amp; Mundt, K. (2015). Friend or foe? Google Translate in language for academic purposes. <em>English for Specific Purposes, 37<\/em>, 112-121. doi: 10.1016\/j.esp.2014.09.001<\/span><\/p>\n<p><span style=\"color: #000000;\">Howatt, A. (1984). <em>A history of English language teaching.<\/em> Oxford: Oxford University Press.<\/span><\/p>\n<p><span style=\"color: #000000;\">Iwashita, N., May, L. &amp; Moore, P. J. (2017) Features of discourse and lexical richness at different performance levels in the APTIS speaking test (Final report). <em>The<\/em> <em>British Council\/University of Cambridge Local Examinations Syndicate<\/em>.<\/span><\/p>\n<p><span style=\"color: #000000;\">King, N. &amp; Horrocks, C. (2010). <em>Interviewing in qualitative research<\/em>. London: Sage.<\/span><\/p>\n<p><span style=\"color: #000000;\">Levy, M. &amp; Moore, P. J. (2018). Qualitative Research in CALL. L<em>anguage Learning and Technology 22<\/em>(2), 1-8.<\/span><\/p>\n<p><span style=\"color: #000000;\">Miles, M. B., &amp; Huberman, A. M. (1994). <em>Qualitative data analysis<\/em> (2<sup>nd<\/sup> ed.). Thousand Oaks, CA: Sage Publications.<\/span><\/p>\n<p><span style=\"color: #000000;\">Moore, P. J. (2013). An emergent perspective on the use of the first language in the EFL classroom. <em>The<\/em> <em>Modern Language Journal<\/em> <em>97<\/em>(1): 239-253. DOI: 10.1111\/j.1540-4781.2013.01429.x0026 7902\/13\/239\u2013253<\/span><\/p>\n<p><span style=\"color: #000000;\">Moore, P. J. (2017). Unwritten rules: Code choice in task-based EFL learner discourse. In Fenton-Smith, B., Humphreys, P. &amp; Walkinshaw, I. (eds.) <em>English as a medium of instruction in higher education in the Asia-Pacific<\/em> (pp. 299-320). Dordrecht: Springer. doi: 10.1007\/978-3-319-51976-0_16<\/span><\/p>\n<p><span style=\"color: #000000;\">Moore, P. J. (2018). Task-based language teaching (TBLT). In Liontas, J. I. (ed.) <em>TESOL encyclopedia of English language teaching<\/em>. New Jersey: Wiley. doi: 10.1002\/9781118784235.eelt0175<\/span><\/p>\n<p><span style=\"color: #000000;\">Moorkens, J. (2018). Machine translation: Evolution and quality expectations. Keynote presented at <em>Google Translate &amp; Modern Languages Education<\/em>, University of Nottingham, UK, 29 June.<\/span><\/p>\n<p><span style=\"color: #000000;\">Murray, L., &amp; Barnes, A. (1998). Beyond the \u201cwow\u201d factor\u2014evaluating multimedia language learning software from a pedagogical viewpoint. <em>System 26<\/em>, 249-259.<\/span><\/p>\n<p><span style=\"color: #000000;\">Ortega, L. (2014). SLA for the 21st century: Disciplinary progress, transdisciplinary relevance, and the bi\/multilingual turn. <em>Language Learning, 63<\/em> (Supplement 1), 1\u201324.<\/span><\/p>\n<p><span style=\"color: #000000;\">Sauro, S., &amp; Chapelle, C. (2017). Toward langua-technocultural competence. In C. Chapelle &amp; S Sauro (Eds.), <em>The Handbook of technology and second language teaching and learning<\/em> (pp. 459-472). Hoboken, NJ: John Wiley &amp; Sons, Inc.van Lier, L. (2004). <em>The ecology and semiotics of language learning. A sociocultural perspective<\/em>. Dordrecht: Klewer.<\/span><\/p>\n<p><span style=\"color: #000000;\">Way, A. (2018). Quality expectations in machine translation. In Moorkens, J., Castilho, S., Gaspari, F., and Doherty, S. (Eds.), T<em>ranslation quality assessment: From principles to practice<\/em> (pp. 159-178). Cham, Switzerland: Springer Nature.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Paul J. Moore (University of Queensland), Phil Murphy, Luann Pascucci, and Scott Sustenance (Kanda University of International Studies) Moore, P.J., Murphy, P., Pascucci, L., &amp; Sustenance, S. (2019).\u00a0Machine translation for EFL.\u00a0Relay Journal, 2(1), 228-235.\u00a0https:\/\/doi.org\/10.37237\/relay\/020127 [Download paginated PDF version] *This page reflects the original version of this document. Please see PDF for most recent and updated &hellip; <a href=\"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/issues\/jan19\/moore_et_al_2\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Machine Translation for EFL&#8221;<\/span><\/a><\/p>\n","protected":false},"author":5,"featured_media":0,"parent":831,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/pages\/857"}],"collection":[{"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/comments?post=857"}],"version-history":[{"count":7,"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/pages\/857\/revisions"}],"predecessor-version":[{"id":1843,"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/pages\/857\/revisions\/1843"}],"up":[{"embeddable":true,"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/pages\/831"}],"wp:attachment":[{"href":"https:\/\/kuis.kandagaigo.ac.jp\/relayjournal\/wp-json\/wp\/v2\/media?parent=857"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}