HomeInternational Journal of Transformative Multidisciplinary Studiesvol. 2 no. 2 (2026)

Enhancing the Writing Proficiency of Non-English Major Students Using Artificial Intelligence (AI) Language Tools

Michael B. Garcia

Discipline: Education

 

Abstract:

1 Pangasinan State University, School of Advanced Studies, Philippines * michaelgarcia @ucu.edu.ph Volume 2, Issue 2, June 2026 The rapid adoption of Artificial Intelligence language tools has fundamentally transformed educational practices, creating a critical need to evaluate their specific impact on the higher-order writing skills of non-English- major college students. This study examined the writing proficiency reflected in the written outputs of non-English major students before and after AI-assisted revision across five distinct dimensions and tested for significant differences to propose a targeted instructional intervention program. Utilizing a quasi-experimental single-group pretest-posttest design, researchers evaluated a purposively selected sample of seventy-seven first-year students enrolled in a general education course. Participants composed an initial unassisted academic essay and a subsequently revised essay guided by Artificial Intelligence feedback, which were then scored using an expert-validated analytic rubric and analyzed using repeated measures ANOVA. The AI-assisted revision intervention was associated with statistically significant improvements in the quality of respondents' written outputs, elevating the overall mean score from a baseline of 25.55 to 29.97 with a substantial effect size. Despite these gains, originality and creativity, critical thinking, and tone and style remained at the emerging proficiency level, along with contextual understanding, which achieved a proficient mean but still saw the majority of the population at emerging proficiency. However, the observed improvements reflect short-term performance within AI-assisted revision tasks and should not be interpreted as conclusive evidence of permanent Garcia, IJTMS, 2 (2), 766-782, 2026 767 1.



References:

  1. Ahmed, A. (2024, September 10). ChatGPT tops AI tools among students, 86% use AI for studies: Survey. Digital Information World. Retrieved from https://www.digitalinformationworld.com/2024/09/chatgpt-tops-ai-tools-among-students-86.html
  2. Archana, S. N., Renjith, V. R., Padmakumar, P. K., C, S., & Aboobaker, N. (2025). AI assisted learning and research: An exploratory study among university students and scholars. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00814-x.
  3. Barnett, A. G., van der Pols, J. C., Dobson, A. J. (2004). Regression to the mean: What it is and how to deal with it. International Journal of Epidemiology, 34(1), 215–220. https://doi.org/10.1093/ije/dyh299.
  4. Coracero, R. M. M. (2024). The utilization of artificial intelligence (AI) writing assistants to the writing proficiency. International Journal of Research Publications, 50(1). https://doi.org/10.47119/ijrp1001501620246659.
  5. Council of Europe. (n.d.). Common European framework of reference for languages (CEFR): Level descriptions. Retrieved from https://www.coe.int/en/web/common-european-framework-referencelanguages/level-descriptions
  6. Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications, Incorporated. https://books.google.com/books?hl=en&lr=&id=335ZDwAAQBAJ&oi=fnd&pg=PT16&dq=Creswell,+J.+W.,+%26+Creswell,+J.+D.+(2018).+Research+design:+Qualitative,+quantitative,+and+mixed++%09methods+approaches.+SAGE+Publications,+Incorporated.+&ots=YEAPKQsstH&sig=lpixwKxlMcuuxg7Y37yBiUFJEqY
  7. Department of Education. (2012). DepEd order no. 31, s. 2012: Policy guidelines on the implementation of the grades 1 to 10 of the K to 12 basic education curriculum (BEC) effective school year 2012-2013. Retrieved from https://www.scribd.com/document/231788446/DO-No-31-s-2012
  8. Dingal, S. M. L., Balbin, C. J. P., Buenafe, S. G. L., Buenavista, P. E. M., Cabrera, C. A., Lorica, V. M. T., Olalo, A. M., Pataganao, L. a. A., Wahing, M. R. A., Clamares, K. J. M., & Pelandas, A. M. O. (2024). Artificial intelligence (AI) usage and its influence to the students’ academic writing: A quantitative – correlation investigation. International Journal of Research and Innovation in Social Science, VIII(IV), 1621–1627. https://doi.org/10.47772/ijriss.2024.804216.
  9. Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00425-2.
  10. Espartinez, A. S. (2024). Exploring student and teacher perceptions of ChatGPT use in higher education: A Q-Methodology study. Computers and Education Artificial Intelligence, 7, 100264. https://doi.org/10.1016/j.caeai.2024.100264.
  11. Flynn, L. E., & Allen, L. K. (2025). Disentangling the influences of creativity and verbal fluency on writing. Journal of Learning Analytics, 12(2), 67–82. https://doi.org/10.18608/jla.2025.8857.
  12. Fraenkel, J., Hyun, H., & Wallen, N. (2011). How to design and evaluate research in education. McGrawHill Education. https://studentebookhub.com/wpcontent/uploads/2024/preview/9781259913839.pdf
  13. Freeman, J. (2025). Student generative AI survey 2025. Higher Education Policy Institute. Retrieved from https://www.hepi.ac.uk/reports/student-generative-ai-survey-2025/
  14. Garcia, N. P. D., Maghanoy, N. D. R. G., Ahmad, N. F. S. H., Manabat, N. a. D., & Arnoco, N. J. P. P. (2025). Chatgpt, Grammarly, and Quillbot: Perceptions of students and teachers towards the use of AI tools in writing. Journal of English Language Teaching and Applied Linguistics, 7(3), 161–167. https://doi.org/10.32996/jeltal.2025.7.3.16.
  15. Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. https://www.academia.edu/download/56454923/Communicative_Approach_by_Stephen_Crashen.pdf
  16. Li, Y., Sha, L., Yan, L., Lin, J., Raković, M., Galbraith, K., Lyons, K., Gašević, D., & Chen, G. (2023). Can large language models write reflectively?. Computers and Education Artificial Intelligence, 4, 100140. https://doi.org/10.1016/j.caeai.2023.100140.
  17. Mekheimer, M. (2025). Generative AI-assisted feedback and EFL writing: A study on proficiency, revision frequency and writing quality. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00602-7
  18. Mollick, E. R., & Mollick, L. (2023). Assigning AI: Seven approaches for students, with prompts. Social Science Research Network (SSRN). https://doi.org/10.2139/ssrn.4475995.
  19. Russell, S. J., & Norvig, P. (2021). Artificial Intelligence: A modern approach (Pearson series in Artificial Intelligence). Amazon.com: Books. Retrieved from https://www.amazon.com/ArtificialIntelligence-A-Modern-Approach/dp/0134610997
  20. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin. https://www.tandfonline.com/doi/pdf/10.1198/jasa.2005.s22
  21. Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843.
  22. Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://www.jstor.org/stable/j.ctvjf9vz4
  23. Zhu, Y., Zhang, Y., & Yao, C. (2026). Navigating emotional resonance and language identity through world Englishes education: An experimental intervention with EFL learners in China. Frontiers in Psychology, 17, 1793431. https://doi.org/10.3389/fpsyg.2026.1793431