Home⇛Psychology and Education: A Multidisciplinary Journal⇛vol. 39 no. 10 (2025)

Revisiting Subject-Verb Agreement Mastery: The Effectiveness of Chatbots as Practice Tools

Mark Anthony Rodriguez | Ronalyn Langam

Discipline: Education

 

Abstract:

With AI tools such as ChatGPT in the fast-changing education domain, there is a potential scope for improving student learning through integration. The effectiveness of ChatGPT as a practice partner in enabling mastery of subject-verb agreement among senior high school students was investigated in this study. A quasi-experimental pretest-posttest design was ut which involved eighty (80) eighty senior high school students from Lala Proper Integrated School. The learners accessed ChatGPT for one hour per day for five consecutive days to answer subject-verb agreement exercise questions. Their grammatical ability was measured using a teacher-made test before and after the intervention. The mean score rose from 15.6 (pretest “Fair”) to 21.4 (posttest “Good”), so the mean difference reaped is 6.00 points. This mean difference signifies considerably higher average pretest to posttest scores or very likely an academic gain coincidence with the intervention. Since the assumption of normality was not met, a Wilcoxon signed-rank test was used in lieu of a parametric test. The fact that the test statistic value is 0.00?, meaning the sum of the ranks of the differences is so extremely small, occurs when most of the students scored better on the posttest than the pretest to an extreme degree – a strong indication of consistent improvement throughout the sample. The accompanying p-value of <.001 implies that there exists less than a 0.1% chance that this consistent upward trend was a result of mere chance. In other words, results are statistically very significant, the probability of such a level of change occurring, through random chance is low extreme. These findings confirm that ChatGPT used as a practice partner, positively and quantitatively affected student competence for mastery in the subject-verb agreement. The interactive and reactive nature of the chatbot may have also been influential to the students’ engagement, confidence and the understanding of grammar rules. Therefore AI-based instruments such as ChatGPT demonstrate a lot of promise in helping to supplement traditional instruction and to solve persistent problems associated with grammar in the classroom.



References:

  1. Abeywickrama, D. D., & Amaraweera, S. (2023). Exploring Subject-Verb Agreement Challenges in the Writing of ESL Learners: An Action Research Study in Sri Lanka. https://doi.org/10.54389/qnad1556
  2. Albaar, M. R., Kapita, S. N., & Mamonto, A. (2024). The effect of gpt chat on the learning outcomes of khairun university informatics study program students. IJIS (Indonesian Journal on Information System), 9(2), 154. https://doi.org/10.36549/ijis.v9i2.335
  3. Alsayed, W. O., Al-Hafdi, F. S., & Alhalafawy, W. S. (2024). Chatbots in education. In Advances in Educational Technologies and Instructional Design (pp. 137–154). IGI Global. https://doi.org/10.4018/979-8-3693-9806-7.ch006
  4. Al-Tamimi, A.-K., Moore, R. W., Javed, Y., Babu, S., & Freeman, E. (2024). Chatbots in education. In Chatbots in Education (pp. 99–127). IGI Global. https://doi.org/10.4018/979-8-3693-5483-4.ch006
  5. Chen, H., Widarso, G., & Sutrisno, H. (2020). A chatbot for learning Chinese: Learning achievement and technology acceptance. Journal of Educational Computing Research, 58, 1161-1189. https://doi.org/10.1177/0735633120929622
  6. Chuah, K., & Kabilan, M. (2021). Teachers’ views on the use of chatbots to support English language teaching in a mobile environment. International Journal of Emerging Technologies in Learning, 16. https://doi.org/10.3991/ijet.v16i20.24917
  7. Du, J., & Daniel, B. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers in Education: Artificial Intelligence, 6, 100230. https://doi.org/10.1016/j.caeai.2024.100230
  8. Gökçearslan, Ş., Tosun, C., & Erdemir, Z. (2024). Benefits, challenges, and methods of artificial intelligence (AI) chatbots in education: A systematic literature review. International Journal of Technology in Education. https://doi.org/10.46328/ijte.600
  9. Haristiani, N., & Rifa’i, M. (2020). Combining chatbot and social media: Enhancing personal learning environment (PLE) in language learning. Indonesian Journal of Science and Technology, 5(3), 28687. https://doi.org/10.17509/IJOST.V5I3.28687
  10. Haristiani, N., & Rifai, M. (2021). Chatbot-based application development and implementation as an autonomous language learning medium. Indonesian Journal of Science and Technology, 6(3), 39150. https://doi.org/10.17509/ijost.v6i3.39150
  11. Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 37, 1-26. https://doi.org/10.1080/09588221.2021.2021241
  12. Kerby, D. S. (2014). The simple difference formula: An approach to teaching nonparametric correlation. Comprehensive Psychology, 3, 2165–2228.
  13. Kharis, M., Schaffert, S., Hidayat, E., Ardiansyah, R., & Ebner, M. (2022). Development of a chatbot app for interactive German grammar learning. International Journal of Emerging Technologies in Learning, 17, 52-63. https://doi.org/10.3991/ijet.v17i14.31323
  14. Maghamil, M., & Sieras, S. (2024). Impact of ChatGPT on the Academic Writing Quality of Senior High School Students. Journal of English Language Teaching and Applied Linguistics, 6(2), 115–128. https://doi.org/10.32996/jeltal.2024.6.2.14
  15. Nguyen, Q., Sidorova, A., & Torres, R. (2021). User interactions with chatbot interfaces vs. menu-based interfaces: An empirical study. Computers in Human Behavior, 128, 107093. https://doi.org/10.1016/j.chb.2021.107093
  16. Pandapatan, A. M. (2020). Analysis of the Subject-Verb Agreement Ability among Indonesian English Major Students as EFL Learners. Journal of English Language Studies, 5(2), 127–143. https://doi.org/10.30870/JELS.V5I2.8135
  17. R Core Team (2024). R: A Language and environment for statistical computing. (Version 4.4) [Computer software]. Retrieved from https://cran.r-project.org. (R packages retrieved from CRAN snapshot 2024-08-07).
  18. Rosas, R. A., & Rodríguez, E. J. (2024). Chatbots: The future of education? International Journal of Engineering Pedagogy (iJEP), 14(8), 107–119. https://doi.org/10.3991/ijep.v14i8.49715
  19. Rueda, R.B. (2022). Subject-Verb Agreement Errors and Performance of the Bachelor of Arts in English Language Studies (BAELS) Students: An Input for the Development of A Remediation Program. International Multidisciplinary Research Journal, 4(3), 109–115. https://doi.org/10.54476/ioer-imrj/89928
  20. The jamovi project (2024). jamovi. (Version 2.6) [Computer Software]. Retrieved from https://www.jamovi.org.
  21. Vázquez-Cano, E., Mengual-Andrés, S., & López-Meneses, E. (2021). Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. International Journal of Educational Technology in Higher Education, 18. https://doi.org/10.1186/s41239-021-00269-8
  22. Wu, E., Lin, C., Ou, Y., Liu, C., Wang, W., & Chao, C. (2020). Advantages and constraints of a hybrid model K-12 e-learning assistant chatbot. IEEE Access, 8, 77788-77801. https://doi.org/10.1109/ACCESS.2020.2988252
  23. Xu, X., Wang, Y., Shang, Z., Jiang, L., & Luo, H. (2024). Using chatbots to teach English as a foreign language: A systematic literature review from 2010 to 2023. In 2024 International Symposium on Educational Technology (ISET), 97-102. https://doi.org/10.1109/ISET61814.2024.00028
  24. Yang, H., Kim, H., Lee, J., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34, 327-343. https://doi.org/10.1017/S0958344022000039 

Tools


Copyright © 2025  KITE Digital Educational Solutions |  Exclusively distributed by CE-Logic