The Effect of Text to Image Artificial Intelligence on Vocabulary Development
Kubra Okumus Dagdeler
Discipline: Education
Abstract:
Vocabulary acquisition is one of the fundamental components of second language learning, yet many students encounter difficulties in effectively using newly learned words in meaningful contexts. With the rapid advancement of educational technologies, innovative tools have emerged to support language learners in more interactive and engaging ways. One such innovation is text-to-image artificial intelligence, which has the potential to enhance vocabulary learning by providing visual representations of words, thereby fostering deeper cognitive associations. This study aimed to investigate the effectiveness of text-to-image AI tools in supporting English vocabulary acquisition among high school students learning English as a foreign language. Employing a mixed-method research design, the study included both quantitative and qualitative components. An experimental design was implemented, where the experimental group was exposed to vocabulary instruction through a text-to-image AI tool, while the control group received traditional instruction without visual AI support. Data were collected using vocabulary recognition and production tests, along with semi-structured interviews to capture the implementing teacher’s perceptions of the process. The results indicated that students in the experimental group demonstrated significant improvement in vocabulary use in the production test, although no statistically significant difference was observed in the recognition test. Moreover, the teacher's feedback highlighted the motivational benefits of AI-enhanced instruction, while also noting practical challenges, such as the occasional generation of irrelevant or misleading images and time constraints during classroom use. These findings suggest that while text-to-image AI tools hold promise for enriching vocabulary instruction, careful implementation and tool refinement are necessary to maximize their educational value.
References:
- Alharbi, K. & Khalil, L. (2023). Artificial Intelligence (AI) In ESL vocabulary learning: An exploratory study on students and teachers’ perspectives. Migration Letter, 20 (12), 1030-1045.
- Ansari, M., & Sabouri, N. B. (2016) The relationship between the use of vocabulary learning strategies and gender of Iranian EFL learners. Research in English Language Pedagogy, 4(1), 88–100.
- Carpenter, S. K., & Olson, K. M. (2012). Are pictures good for learning new vocabulary in a foreign language? Only if you think they are not. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(1), 92–101. https://doi.org/10.1037/a0024828.
- Combs, K. & Bihl, T. J. (2024). A preliminary look at Generative AI for the creation of abstract verbal-to visual analogies. Proceedings of the 57th Hawaii International Conference on System Sciences. 1180-1189. https://hdl.handle.net/10125/106520
- Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55, 2503–2529. https://doi.org/10.1111/bjet.13460.
- Dell’Acqua F, et al. 2023. Navigating the jagged technological frontier: field experimental evidence of the effects of AI on knowledge worker productivity and quality (September 15, 2023). Harvard Business School Technology & Operations Mgt. Unit Working Paper No. 24-013, The Wharton School Research Paper, Available at SSRN: https://ssrn.com/abstract=4573321 or http://dx.doi.org/10.2139/ssrn.4573321
- Edmett, A., Ichaporia, N., Crompton, H., & Crichton, R. (2024). Artificial intelligence and English language teaching: Preparing for the future (Second edition). British Council. https://doi.org/10.57884/78EA-3C69.
- Fitria, T. N. (2021). The use technology based on artificial intelligence in English teaching and learning. ELT Echo: The Journal of English Language Teaching in Foreign Language Context, 6(2), 213-223. https://doi.org/10.24235/eltecho.v%vi%i.9299
- Gallacher, A., Thompson, A. and Howarth, M. (2018) ‘“My robot is an idiot!” – Students’ perceptions of AI in the L2 classroom’, in P. Taalas (edt), Future-proof CALL: language learning as exploration and encounters – short papers from EUROCALL 2018, pp. 70–76. https://doi.org/10.14705/rpnet.2018.26.815.
- Gkountara, D. N. & and Prasad, R. (November, 2022). A review of Artificial Intelligence in Foreign Language Learning. Paper presented in 25th International Symposium on Wireless Personal Multimedia Communications (WPMC), Denmark.
- Henriksen, B. (1999). Three dimensions of vocabulary development. Studies in Second Language Acquisition, 21, 303–317. https://doi.org/10.1017/S0272263199002089
- Hsu, T-C. & Chang, C. & Tien-Hsiu Jen (2024). Artificial Intelligence image recognition using self-regulation learning strategies: effects on vocabulary acquisition, learning anxiety, and learning behaviours of English language learners, Interactive Learning Environments, 32(6), 3060-3078. https://doi.org/10.1080/10494820.2023.2165508
- Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, Research Issues and Applications of Artificial Intelligence in Education. https://doi.org/10.30191/ETS.202301_26(1).0009
- Hutauruk, B.S., Purba, R., Sihombing, S., Nainggolan, M. (2024). The effectiveness of artificial intelligence by chatbot in enhancing the students’ vocabulary. JETAL: Journal of English Teachıng & Applied Linguistics, 6(1), 13-19.
- Jomaa, N., Attamimi, R. & Al Mahri, M. (2024). Utilising Artificial Intelligence (AI) in vocabulary learning by EFL Omani students: the effect of age, gender, and level of study. Forum for Linguistic Studies, 6 (5), 171-186. https://doi.org/10.30564/fls.v6i5.6968.
- Keerthiwansha, N. W. B. S. (2018). Artificial Intelligence Education (AIEd) in English as a Second Language (ESL) Classroom in Sri Lanka. International Journal of Conceptions on Computing and Information Technology, 6 (1), 31-36.
- Krashen, S. (1989) We acquire vocabulary and spelling by reading: Additional evidence for the input hypothesis. The Modern Language Journal, 73(4), 440–464. https://doi.org/10.1111/j.1540-4781.1989.tb05325.x
- Lee, Y.-F., Hwang, G.-J. & Chen, P.-Y. (2022). Impacts of an AI-based chatbot on college students’ after-class review, academic performance, self-efficacy, learning attitude, and motivation. Educational Technology Research and Development, 70(5), 1843–1865. https://doi.org/10.1007/s11423-022-10142-8.
- Lei, H. (2021). High school students’ foreign language vocabulary acquisition in the era of Artificial Intelligence. Advances in Social Science, Education and Humanities Research, 637, 659-662.
- Losi, R. V., Putra, E., Ali, N., & Dewi, A. S. (2024). Investigating Artificial Intelligence (AI) as a vocabulary learning tool: students’ perception to use ChatGPT. Proceeding International Conference on Religion, Science and Education, 3, 561–566. Available at http://sunankalijaga.org/prosiding/index.php/icrse/article/view/1208.
- Lu, X. (2018). Natural language processing and Intelligent Computer Assisted Language Learning (ICALL). The TESOL Encyclopaedia of English Language Teaching, 1–6. https://doi.org/10.1002/9781118784235.eelt0422
- Mayer, R. E. (2001). Multimedia learning. Cambridge University Press.
-
- Mayer, R. (2014). Cognitive Theory of Multimedia Learning. In The Cambridge Handbook of Multimedia Learning , R. Mayer (Ed.) pp. 43 – 71, Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005[Opens in a new window]
- Mayer, R. E., Heiser, J., & Lonn, S. (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187–198.
- McCarthy, J. (2007). What is artificial intelligence? Basic Questions. Computer Science Department, Stanford University. Available at https://stanford. io/2lSo373.
- Nation, I. S. P. (2001). Learning vocabulary in another language. Cambridge University Press.
- Nation, P. (2017). How vocabulary is learned. Indonesian Journal of English Language Teaching, 12(1), 1-14.
- Noy S, Zhang W. 2023. Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192.
- Oktadela, R., Elida, Y., Ismail, S., 2023. Improving English Vocabulary through Artificial Intelligence (AI) Chatbot Application. Journal of English Language and Education. 8(2), 63–67.
- Paivio, A. (1971). Imagery and Verbal Processes. New York: Holt, Rinehart & Winston.
- Paivio, A. (1986). Mental Representations. New York: Oxford University Press.
- Peker H.; Regalla M. & Cox, T.D (2018). Teaching and learning vocabulary in context: Examining engagement in three prekindergarten French classroom. Foreign Language Annals, 51, 472–483. https://doi.org/10.1111/flan.1233
- Pignot-Shahov, V. (2012). Measuring L2 receptive and productive vocabulary knowledge. Language Studies Working Papers, 4, 37-45.
- Quan, T. K. (2024). The effects of integrating Artificial Intelligence into learning academic vocabulary among masters in English Studies Students. International Journal of AI in Language Education, 1(1), 1-19. https://doi.org/10.54855/ijaile.24111
- Saunders, R. J., & Solman, R. T. (1984). The effect of pictures on the acquisition of a small vocabulary of similar sight‐words. British Journal of Educational Psychology, 54(3), 265–275. https://doi.org/ 10.1111/j.2044-8279.1984.tb02590.x
- Shadiev, R.; Wu, T-T. & Huang Y-M. (2020). Using image-to-text recognition technology to facilitate vocabulary acquisition in authentic contexts. ReCALL, 32(2), 195-212. httpss://doi.org//10.1017/S0958344020000038
- Shaheen, F.;Hussain, K. G.; Jahan, M. & Azam, L. A. (2024). Exploring Artificial Intelligence’s role in second language vocabulary acquisition: insights from students’ and teachers’ Perspectives. Al-Qanṭara, 400–419. Available at http://alqantarajournal.com/index.php/Journal/article/view/580
- Spitale G, Biller-Andorno, N, Germani, F. (2023). AI model GPT-3 (dis)informs us better than humans. Science Advances. 9(26). https://doi.org// 10.1126/sciadv.adh1850
- Sumakul, D. T., Hamied, F. A., & Sukyadi, D. (2022). Artificial intelligence in EFL classrooms: Friend or foe? LEARN Journal: Language Education and Acquisition Research Network, 15(1), 232-256.
- Swain, M. (1985) Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In Gass, S. M. & Madden, C. G. (eds.), Input in second language acquisition, pp. (235-256). Cambridge, MA: Newbury House Publishers.
- UNESCO (2023). Ministerial roundtable on generative AI in education. Available at: https://www.unesco. org/en/articles/ministerial-roundtable-generativeai education
- Underwood, J., Luckin, R., (2011). What is AIED and why does Education need it? Available at https://www.researchgate.net/publication/241698223_What_is_AIED_a nd_why_does_Education_need_it
- Wang, R. (2019). Research on Artificial Intelligence Promoting English Learning Change. Proceedings of the 3rd International Conference on Economics and Management, Education, Humanities and Social Sciences (EMEHSS 2019). Proceedings of the 3rd International Conference on Economics and Management, Education, Humanities and Social Sciences. https://doi.org/10.2991/emehss-19.2019.79 2019.
- Wilkins, David A. (1972). Linguistics in Language Teaching. Cambridge, MA: MIT Press.
- Wu, R., & Yu, Z. (2023). Do AI chatbots improve students learning outcomes? Evidence from a meta-analysis. British Journal of Educational Technology, 1–24. https:// doi.org/10.1111/bjet.13334. 00.
- Xu, Z., Wijekumar, K., Kay, Ramirez, G., Hu, X., & Irey, R. (2019). The effectiveness of intelligent tutoring systems on K-12 students’ reading comprehension: A meta- analysis. British Journal of Educational Technology, 50(6), 3119–3137. https://doi.org/10.1111/bjet.12758
- Xu, T. & Wang, H. (2024). The effectiveness of artificial intelligence on English language learning achievement. System, 125, https://doi.org/10.1016/j.system.2024.103428.
- Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation technology with micro-learning: The impact of chatbot-based learning on students’ learning motivation and performance. Journal of Educational Computing Research, 59(1), 154-177. https://doi.org/10.1177%2F0735633120952067
- Zhou, E. & Lee, D. (2024). Generative artificial intelligence, human creativity, and art. PNAS Nexus, 3(3). https://doi.org/10.1093/pnasnexus/pgae052
- Zou, D., Huang, Y., & Xie, H. (2021). Digital game-based vocabulary learning: where are we and where are we going? Computer Assisted Language Learning, 34(5-6), 751–777. https://doi. org//10.1080/09588221.2019.1640745
ISSN 2960-3722 (Online)
ISSN 2960-3714 (Print)