HomeUswag Journal: Philippine Journal of Multidisciplinary Researchvol. 2 no. 1 (2024)

Perceptions of Language Assessment Literacy Among SUC English Language Educators in a Flexible Learning Environment

Jimmylen Z. Tonio | Romeleen S. Go-Vela | Ma. Sofia S. Llaguno

Discipline: Teacher Training

 

Abstract:

The sudden shift to flexible learning due to COVID-19 necessitated a reevaluation of assessment practices in higher education. This study explored State Universities and Colleges' (SUCs) English Language Educators' (ELEs) perceptions of their Language Assessment Literacy (LAL) within flexible learning environments. Employing a quantitative approach, a questionnaire adapted from Grialdo's (2018) LAL checklist was used. Frequency analysis of data collected from SUC ELEs examined their perceptions across various LAL domains. Thirty (30) SUC ELEs were chosen to participate in the study using non-probability sampling, specifically purposive-convenience sampling. They answered yes/no questions about their knowledge, skills, and ethical considerations related to assessment. Findings revealed a strong foundation in knowledge related to applied linguistics and assessment theory among SUC ELEs. They emphasized diverse and formative assessment practices, prioritizing ethical considerations. However, variability existed in data analysis skills, and not all participants utilized advanced statistical software. However, the study relied on self-reported perceptions, potentially not reflecting actual practices. Additionally, using a single model (Giraldo's) might limit capturing the full range of LAL skills. Finally, focusing on SUC ELEs in the Philippines restricts generalizability to other educational contexts. Despite these limitations, the study suggests a generally strong foundation in LAL among SUC ELEs. This study highlights the overall strength of LAL among SUC ELEs, particularly in knowledge and ethical considerations. It also identifies areas for development in advanced data analysis and technology integration for assessment design and interpretation. These findings inform the need for targeted professional development programs to further enhance SUC ELEs' LAL and empower them to design effective assessments in flexible learning environments.



References:

  1. Adalberon, E. (2020). Providing assessment feedback to pre-service teachers: a study of examiners’ comments. Assessment & Evaluation in Higher Education, 46(4), 601–614. https://doi.org/10.1080/02602938.2020.1795081
  2. Adarkwa, M. (2021). The power of assessment feedback in teaching and learning: A narrative review and synthesis of the literature. SN Soc Sci 1, 75. https://doi.org/10.1007/s43545-021-00086-w  
  3. Arias, C. & Maturana, L. (2005). Assessment in language teaching: Discourse and practices. Íkala, Revista de Lenguaje y Cultura, 10(1), 63-91.
  4. Arias, C., Maturana, L., & Restrepo, M. (2012). Evaluation in foreign language learning: Towards fair and democratic practices. Lenguaje, 40(1), 99-126.
  5. Bachman, L. (2002). Some reflections on task-based language performance assessment. Language Testing, 19(4), 453-476. https://doi.org/10.1191/0265532202lt240oa.
  6. Bachman, L. (2004). Statistical analyses for language assessment. Cambridge University Press. https://doi.org/10.1017/CBO9780511667350.
  7. Black, P & William, D. (2006). Assessment and classroom learning. Assessment in education: Principles, Policy & Practices, 5(1), 7-74, https://doi.org/10.1080/0969595980050102
  8. Brookhart, S. (2023). Assessment literacy in a better assessment future. Chinese Journal of Applied Linguistics, 46(2), 162-179. https://doi.org/10.1515/CJAL-2023-0202  
  9. Bryan, C. & Clegg, K. (Eds.) (2019). Innovative assessment in higher education: A handbook for academic practitioners. Routledge.
  10. Chapelle, C. A. & Voss, E. (2017). Utilizing technology in language assessment. In E. Shohamy & Or, I. G., & May, S. (Eds.), Encyclopaedia of language and education, 3rd Ed., Vol. 7: Language testing and assessment.
  11. Corcoran, C. A., Dershimer, E. I., & Tichenor, M. S. (2004). A teacher’s guide to alternative assessment: Taking the first steps. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 77(5), 213–218. https://doi.org/10.3200/TCHS.77.5.213-218
  12. Davidson, F., & Lynch, B. (2001). Testcraft: A teacher’s guide to writing and using language test specifications. Yale University Press.
  13. Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327-347. https://doi.org/10.1177/026553220809015  
  14. Griskell, H. (2018). Assessing English language learners’ motivation in participate in classroom discussion.  [Master’s Thesis]. Loyola Univesrity Chicago. https://ecommons.luc.edu/cgi/viewcontent.cgi?article=4674&context=luc_theses  
  15. Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. https://doi.org/10.1080/15434303.2011.642041.
  16. Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20(1), 179-195. https://doi.org/10.15446/profile.v20n1.62089   
  17. Guangul, F.M., Suhail. A.H., Khalit, M.I., & Khidhir, B.A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East college. Educ Assess Eval Account, 32(4), 519–535.  https://doi.org/10.1007/s11092-020-09340-w
  18. Perro, W., Harris, A. & Panesar-Aguilar, S. (2020). How formative assessments derive instructional decision making in the classroom. Journal of Education & Social Policy, 7(1), 1-7.  https://doi.org/10.30845/jesp.v7n1p1       
  19. Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385-402.  https://doi.org/10.1177/0265532208090158.
  20. López, A., & Bernal, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile: Issues in Teachers’ Professional Development, 11(2), 55-70.
  21. Marshall, S., Baj-Ward, L., Dreamson, N., Nyanjom, J & Bertuol, M.T. (2024). The reshaping of higher education: Technological impacts, pedagogical change, and future projections. Higher Education Research & Development, 43(4), 521-541, https://doi.org/10.1080/07294360.2024.2329393  
  22. McNamara, T., & Hill, K. (2011). Developing a comprehensive, empirically based research framework for classroom-based assessment. Language Testing, 29(3), 395-420.
  23. Ozan, C. & Kincal, R.Y. (2018). The effects of formative assessment on academic achievement, attitudes toward the lesson and self-regulations skills. International Journal of Progressive Education 14(2), 77-92. https://doi.org/10.12738/estp.2018.1.0216     
  24. Popham, W. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory Into Practice, 48(1), 4-11.  https://doi.org/10.1080/00405840802577536
  25. Rea-Dickins, P. (2001). Mirror, mirror on the wall: Identifying processes of classroom assessment. Language Testing, 18(4), 429-462.
  26. Rudner, L., & Schafer, W. (Eds.). (2002). What teachers need to know about assessment. National Education Association.
  27. Sabrina, F., Azad, S., Sohail, S. & Tahkir, S. (2022). Ensuring academic integrity in online assessments: A literature review and recommendations.  International Journal of Information and Education Technology, 12(1). https://doi.org/10.18178/ijiet.2022.12.1.1587
  28. Schafer, W. (1993). Assessment literacy for teachers. Theory Into Practice, 32(2), 118-126. https://doi.org/10.1080/00405849309543585    
  29. Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374-402. https://doi.org/10.1080/15434303.2014.960046  
  30. Xu, Y. & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58(1), 149-162. https://www.sciencedirect.com/science/article/abs/pii/S0742051X16300907