Enhancing the Writing Proficiency of Non-English Major Students Using Artificial Intelligence (AI) Language Tools
Michael B. Garcia
Discipline: Education
Abstract:
1 Pangasinan State University, School of Advanced Studies, Philippines * michaelgarcia @ucu.edu.ph Volume 2, Issue 2, June 2026 The rapid adoption of Artificial Intelligence language tools has fundamentally transformed educational practices, creating a critical need to evaluate their specific impact on the higher-order writing skills of non-English- major college students. This study examined the writing proficiency reflected in the written outputs of non-English major students before and after AI-assisted revision across five distinct dimensions and tested for significant differences to propose a targeted instructional intervention program. Utilizing a quasi-experimental single-group pretest-posttest design, researchers evaluated a purposively selected sample of seventy-seven first-year students enrolled in a general education course. Participants composed an initial unassisted academic essay and a subsequently revised essay guided by Artificial Intelligence feedback, which were then scored using an expert-validated analytic rubric and analyzed using repeated measures ANOVA. The AI-assisted revision intervention was associated with statistically significant improvements in the quality of respondents' written outputs, elevating the overall mean score from a baseline of 25.55 to 29.97 with a substantial effect size. Despite these gains, originality and creativity, critical thinking, and tone and style remained at the emerging proficiency level, along with contextual understanding, which achieved a proficient mean but still saw the majority of the population at emerging proficiency. However, the observed improvements reflect short-term performance within AI-assisted revision tasks and should not be interpreted as conclusive evidence of permanent Garcia, IJTMS, 2 (2), 766-782, 2026 767 1.
References:
- Ahmed, A. (2024, September 10). ChatGPT tops AI tools among students, 86% use AI for studies: Survey. Digital Information World. Retrieved from https://www.digitalinformationworld.com/2024/09/chatgpt-tops-ai-tools-among-students-86.html
- Archana, S. N., Renjith, V. R., Padmakumar, P. K., C, S., & Aboobaker, N. (2025). AI assisted learning and research: An exploratory study among university students and scholars. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00814-x.
- Barnett, A. G., van der Pols, J. C., Dobson, A. J. (2004). Regression to the mean: What it is and how to deal with it. International Journal of Epidemiology, 34(1), 215–220. https://doi.org/10.1093/ije/dyh299.
- Coracero, R. M. M. (2024). The utilization of artificial intelligence (AI) writing assistants to the writing proficiency. International Journal of Research Publications, 50(1). https://doi.org/10.47119/ijrp1001501620246659.
- Council of Europe. (n.d.). Common European framework of reference for languages (CEFR): Level descriptions. Retrieved from https://www.coe.int/en/web/common-european-framework-referencelanguages/level-descriptions
- Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications, Incorporated. https://books.google.com/books?hl=en&lr=&id=335ZDwAAQBAJ&oi=fnd&pg=PT16&dq=Creswell,+J.+W.,+%26+Creswell,+J.+D.+(2018).+Research+design:+Qualitative,+quantitative,+and+mixed++%09methods+approaches.+SAGE+Publications,+Incorporated.+&ots=YEAPKQsstH&sig=lpixwKxlMcuuxg7Y37yBiUFJEqY
- Department of Education. (2012). DepEd order no. 31, s. 2012: Policy guidelines on the implementation of the grades 1 to 10 of the K to 12 basic education curriculum (BEC) effective school year 2012-2013. Retrieved from https://www.scribd.com/document/231788446/DO-No-31-s-2012
- Dingal, S. M. L., Balbin, C. J. P., Buenafe, S. G. L., Buenavista, P. E. M., Cabrera, C. A., Lorica, V. M. T., Olalo, A. M., Pataganao, L. a. A., Wahing, M. R. A., Clamares, K. J. M., & Pelandas, A. M. O. (2024). Artificial intelligence (AI) usage and its influence to the students’ academic writing: A quantitative – correlation investigation. International Journal of Research and Innovation in Social Science, VIII(IV), 1621–1627. https://doi.org/10.47772/ijriss.2024.804216.
- Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00425-2.
- Espartinez, A. S. (2024). Exploring student and teacher perceptions of ChatGPT use in higher education: A Q-Methodology study. Computers and Education Artificial Intelligence, 7, 100264. https://doi.org/10.1016/j.caeai.2024.100264.
- Flynn, L. E., & Allen, L. K. (2025). Disentangling the influences of creativity and verbal fluency on writing. Journal of Learning Analytics, 12(2), 67–82. https://doi.org/10.18608/jla.2025.8857.
- Fraenkel, J., Hyun, H., & Wallen, N. (2011). How to design and evaluate research in education. McGrawHill Education. https://studentebookhub.com/wpcontent/uploads/2024/preview/9781259913839.pdf
- Freeman, J. (2025). Student generative AI survey 2025. Higher Education Policy Institute. Retrieved from https://www.hepi.ac.uk/reports/student-generative-ai-survey-2025/
- Garcia, N. P. D., Maghanoy, N. D. R. G., Ahmad, N. F. S. H., Manabat, N. a. D., & Arnoco, N. J. P. P. (2025). Chatgpt, Grammarly, and Quillbot: Perceptions of students and teachers towards the use of AI tools in writing. Journal of English Language Teaching and Applied Linguistics, 7(3), 161–167. https://doi.org/10.32996/jeltal.2025.7.3.16.
- Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. https://www.academia.edu/download/56454923/Communicative_Approach_by_Stephen_Crashen.pdf
- Li, Y., Sha, L., Yan, L., Lin, J., Raković, M., Galbraith, K., Lyons, K., Gašević, D., & Chen, G. (2023). Can large language models write reflectively?. Computers and Education Artificial Intelligence, 4, 100140. https://doi.org/10.1016/j.caeai.2023.100140.
- Mekheimer, M. (2025). Generative AI-assisted feedback and EFL writing: A study on proficiency, revision frequency and writing quality. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00602-7
- Mollick, E. R., & Mollick, L. (2023). Assigning AI: Seven approaches for students, with prompts. Social Science Research Network (SSRN). https://doi.org/10.2139/ssrn.4475995.
- Russell, S. J., & Norvig, P. (2021). Artificial Intelligence: A modern approach (Pearson series in Artificial Intelligence). Amazon.com: Books. Retrieved from https://www.amazon.com/ArtificialIntelligence-A-Modern-Approach/dp/0134610997
- Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin. https://www.tandfonline.com/doi/pdf/10.1198/jasa.2005.s22
- Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843.
- Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://www.jstor.org/stable/j.ctvjf9vz4
- Zhu, Y., Zhang, Y., & Yao, C. (2026). Navigating emotional resonance and language identity through world Englishes education: An experimental intervention with EFL learners in China. Frontiers in Psychology, 17, 1793431. https://doi.org/10.3389/fpsyg.2026.1793431
ISSN 3116-3017 (Online)
ISSN 3116-3009 (Print)