Practices in Integrating Higher-Order Thinking Skills in English 7 Quarterly Assessment
Jessa May Adao | Elaine Morong
Discipline: Education
Abstract:
Developing the higher-order thinking skills (HOTS) of learners has been a key focus of current educational goals,
aiming to foster students’ abilities to analyze, evaluate, and create beyond memorization. Despite this, Filipino learners
have scored low in national and international assessments that measure critical and creative thinking. Furthermore,
teacher-made assessments have been found to focus primarily on lower-order cognitive skills. This study analyzed
fifteen Grade 7 English quarterly assessments using Bloom’s two-dimensional taxonomy and explored the practices
and challenges encountered by fifteen English teachers in integrating HOTS. The objective was to design a suitable
capacity-building program. Using a qualitative case study design, the study collected data from fifteen quarterly
assessments and conducted semi-structured interviews with the respective teachers. Content analysis was employed
to categorize the assessment items based on Bloom’s taxonomy, with frequency and percentage used to quantify HOTS
integration. Thematic analysis following Braun and Clarke’s approach was used to analyze interview data and identify
patterns in teacher practices and challenges. Findings revealed that assessments were largely dominated by the
remember cognitive domain and factual knowledge. However, HOTS items were also present in most assessments,
most frequently under the analyze cognitive domain and procedural knowledge. Assessments relied heavily on
traditional modes, particularly multiple-choice questions. Teachers reported various practices to integrate HOTS, such
as using competency-based tools, aligning items with instruction, and structuring questions from simple to complex.
Challenges included difficulty in constructing authentic HOTS items, students’ low reading and thinking levels, and
limited time. The study concluded that some participants have knowledge of creating HOTS items; however, they
were more inclined to use traditional modes of assessment. Moreover, despite the different practices employed by the
participants to integrate HOTS, notable challenges were still encountered.
References:
- Abosalem, Y. (2016). Assessment techniques and students’ higher-order thinking skills. International Journal of Secondary Education, 4(1), 1-11.
- Alkhatib, O. J. (2022, February). An Effective Assessment Method of Higher-Order Thinking Skills (Problem-Solving, Critical Thinking, Creative Thinking, and Decision-Making) in Engineering and Humanities. In 2022 Advances in Science and Engineering Technology International Conferences (ASET) (pp. 1-6). IEEE.
- Amali, L. N., Bharati, D. A. L., & Rozi, F. (2022). The Implementation of High Order Thinking Skills (HOTS) Assessment to Evaluate the Students’ Reading Comprehension Achievement. English Education Journal, 12(1), 10-18.
- Ansori, M., Nurkamto, J., & Suparno, S. (2019). Teacher’s beliefs and practices in the integration of higher order thinking skills in teaching reading.
- Antonio, R. P., & Prudente, M. S. (2024). Effects of inquiry-based approaches on students’ higher-order thinking skills in science: A meta-analysis. International Journal of Education in Mathematics, Science and Technology, 12(1), 251-281.
- Arellano, E. L., Camarista, G., Labis, S. F., Arellano, N. A., & Cachuela, G. C. (2019). Development of exemplars in teaching and assessment: An exploration of solutions to TIMSS-related problems in Mathematics. WVSU Research Journal, 8(1), 26-47.
- Armstrong, S., Chan, S., Malfroy, J., & Thomson, R. (2015). Assessment Guide Implementing criteria and standards-based assessment. University of Western Sydney. Retrieved from https://www.westernsydney.edu.au/__data/assets/pdf_file/0004/449860/PVC5557_Assessment_Guide_LR3.pdf
- Astrid, A., & Hasanah, A. (2022). Integrating Higher Order Thinking Skills (HOTS) Into English Language Teaching for Elementary School Students: Teachers’ Perspectives and Challenges. 3L: Southeast Asian Journal of English Language Studies, 28(3).
- Aziz, M. N. A., Yusoff, N. M., & Yaakob, M. F. M. (2020). Challenges in Using Authentic Assessment in 21st Century ESL Classrooms. International Journal of Evaluation and Research in Education, 9(3), 759-768.
- Aziz, M., & Rawian, R. (2022, September). Modeling higher order thinking skills and metacognitive awareness in English reading comprehension among university learners. In Frontiers in Education (Vol. 7, p. 991015). Frontiers.
- Bakić, L. (2024, February 16). How to create a capacity building plan. Productive.io. Retrieved February 27, 2025, from https://productive.io/blog/capacity-building-plan/
- Baylon Jr, D. M. (2014). Effects of classroom assessment on the critical thinking and academic performance of students. Asia Pacific Journal of Multidisciplinary Research, 2(1).
- Bhandari, P. (2020). An introduction to qualitative research. Retrieved 23 Jan from https: //www.scribbr.com/methodology/qualitative-research/
- Brix, J. (2019). Innovation capacity building: An approach to maintaining balance between exploration and exploitation in organizational learning. The Learning Organization, 26(1), 12-26.
- Callingham, R., Pegg, J., & Wright, T. (2009). Changing teachers’ classroom practice through developmental assessment: Constraints, concerns and unintended impacts. Crossing divides, 81-88.
- Chin, J. M. C., Ching, G. S., del Castillo, F., Wen, T. H., Huang, Y. C., del Castillo, C. D., ... & Trajera, S. M. (2022). Perspectives on the Barriers to and Needs of Teachers’ Professional Development in the Philippines during COVID-19. Sustainability, 14(1), 470.
- Chinedu, C. C., Olabiyi, O. S., & Kamin, Y. B. (2015). Strategies for improving higher order thinking skills in teaching and learning of design and technology education. Journal of technical education and training, 7(2).
- Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE Publications.
- Cruz, J. D. (2023). Classroom Assessment Thoughts, Skills, and Practices of Secondary School Mathematics Teachers: An In-Depth Analysis.
- De Ruisseau, L. R. (2016). The flipped classroom allows for more class time devoted to critical thinking. Advances in physiology education, 40(4), 522-528.
- DEPED QUEZON. (2023). Memorandum No. 535. Division roll-out of Higher Order Thinking Skills Professional Learning Packages (HOTS-PLPs) for English, Science, Mathematics. Retrieved from https://www.depedquezon.com.ph/data_files/uploaded_memo/DM%20535,%20S.%202023-SOy0fNtHKQBa3ucwEzrt.pdf
- DEPED. (2015). Policy Guidelines on Classroom Assessment for the K to 12 Basic Education Program
- DEPED. (2023). Multi-year Guidelines on the Results-Based Performance Management System-Philippine Professional Standards for Teachers
- Enhanced Basic Education Act of 2013, Republic Act No. 10533, Sec. 2 (2013). Retrieved from https://www.officialgazette.gov.ph/2013/05/15/republic-act-no-10533/
- Frey, B. B., Schmitt, V. L., & Allen, J. P. (2019). Defining authentic classroom assessment. Practical Assessment, Research, and Evaluation, 17(1), 2.
- Ganapathy, M., & Kaur, S. (2014). ESL students’ perceptions of the use of higher order thinking skills in English language writing. Advances in Language and Literary Studies, 5(5), 80-87.
- Garcia, L. C. (2015). Environmental science issues for higher-order thinking skills (hots) development: A case study in the Philippines. In Biology Education and Research in a Changing Planet: Selected Papers from the 25th Biennial Asian Association for Biology Education Conference (pp. 45-54). Springer Singapore.
- Garillo, M. M. (2019). A Content Analysis of the Assessment Practices of Grade 3 Teachers. SMCC Higher Education Research Journal (Teacher Education Journal), 1(1), 1-1.
- Geraldine, D., De Mello, O. J. P., Omar, N. H., Izza, I., Esa, M., & Ariffin, K. (2021). An Analysis of Higher-Order Thinking Skills (HOTS) in Malaysian University English Test Report Writing.
- Gradini, E. (2022). Development of Rubric of Higher Order Thinking Skills Assessment on Mathematics Learning. JTAM (Jurnal Teori dan Aplikasi Matematika), 6(1), 61-74.
- Halverson, A. (2018). 21st century skills and the” 4Cs” in the English language classroom.
- Handyani, A., Sari, S., Sumardi. (2019). Hots-Based Assessment: The Story Of English Teacher’s Knowledge, Beliefs, And Practices. Jurnal Bahasa Lingua Scientia, 11(2).
- Hennink, M., Hutter, I., & Bailey, A. (2020). Qualitative research methods. Sage.
- Hermayawati, H. (2020). Teachers’ Efforts In Understanding The Factual, Conceptual, Procedural And Metacognitive Assessment Using The Revised 2013 Curriculum. lnternational Journal of Learning, Teaching and Educational Research (IJLTER) Scopus lndexed Journal, 19(5), 156-199.
- Ichsan, I. Z., Hasanah, R., Ristanto, R. H., Rusdi, R., Cahapay, M. B., Widiyawati, Y., & Rahman, M. M. (2020). Designing an Innovative Assessment of HOTS in the Science Learning for the 21st Century. Jurnal Penelitian dan Pembelajaran IPA, 6(2), 211-224.
- Johansson, E. (2020). Higher-order thinking e-assessment in online EFL courses: Swedish instructors’ perceptions and experiences. Moderna språk, 114(2), 161-187.
- Keleman, M., Rasul, M. S., & Jalaludin, N. A. (2021). Assessment of higher order thinking skills through STEM integration project-based learning for elementary level. International Journal of Social Science and Human Research, 4(04), 835-846.
- Khaled, S., & El Khatib, S. (2020). Summative assessment in higher education: Feedback for better learning outcomes. In The International Arab Conference on Quality Assurance in Higher Education (IACQA’2019).
- Lantaca, A. (2014). Application of higher order thinking skills (HOTS) of the general education faculty basis for in-service training on test construction. Universidad de Zamboanga Journal: Official Peer Reviewed Journal Publication Vol. 3, no. 1 (2014), 83-103. Tuklas.up.edu.ph. Retrieved from https://tuklas.up.edu.ph/Record/IPP-00000194711/Description#tabnav
- Limpiado, A. M. V. (2021). Winning school publications’ training and workshop practices: Basis for a unified campus journalism training matrix in the Division of Quezon (Unpublished undergraduate thesis). [South Luzon State University].
- Linkedin. (2024). Bloom’s Taxonomy (Revised) Defined. https://www.linkedin.com/pulse/blooms-taxonomy-revised-defined-travis-sisson
- Lund, J. L., & Kirk, M. F. (2019). Performance-based assessment for middle and high school physical education. Human Kinetics Publishers.
- Mahendra, E. (2023). Oral Assessment In Triggering Student Higher-Order Thinking Skills (HOTS). JISAE: Journal of Indonesian Student Assessment and Evaluation, 9(1), 8-14.
- Mahendra, E. I. W. (2020). Teachers’ Formative Assessment: Accessing Students’ High Order Thinking Skills (HOTS)?. Teachers’ Formative Assessment: Accessing Students’ High Order Thinking Skills (HOTS)?, 12(12), 180-202.
- Mahmud, M. M., Yaacob, Y., Ramachandiran, C. R., Ching, W. S., & Ismail, O. (2018). Theories into Practices: Bloom’s Taxonomy, Comprehensive Learning Theories (CLT) And E-Assessments. ICEAP 2019, 2, 22-27.
- Majumdar, A. (2022). Thematic analysis in qualitative research. In Research anthology on innovative research methodologies and utilization across multiple disciplines (pp. 604-622). IGI Global.
- Mar, A. (2013). Strategy vs. Best Practice: The Real Difference. Business Simplicable. Retrieved from https://business.simplicable.com/business/new/strategy-vs-best-practice#:~:text=A%20strategy%20is%20an%20action,practices%20for%20new%20product%20development.
- Marquez, J. (2023). Processes, Practices and Strategies on the Utilization of Assessment: Basis for Enhanced Assessment Tool. Psych Educ, 11, 851-861.
- Melchor, M. B., & Simpliciano, S. K. (2020). Re-Aligning Higher Order Thinking Skills: Challenges of Teachers in this New Normal. The Rizalian Researcher, 7(1), 1-1.
- Mirabueno, D., & Basilio, M. (2023). Typology, Process, and Structure of POE Strategies of Science Teachers Toward the Development of the Critical Thinking Skills of Students. Psychology and Education: A Multidisciplinary Journal, 14(10), 1-1.
- Mishra, R., & Kotecha, K. (2016). Are we there yet! Inclusion of higher order thinking skills (HOTs) in assessment. Journal of Engineering Education Transformations, 29(2), 49-55.
- Mohamed, R., & Lebar, O. (2017). Authentic assessment in assessing higher order thinking skills. International Journal of Academic Research in Business and Social Sciences, 7(2), 466-476.
- Morgan, H. (2022). Conducting a qualitative document analysis. The Qualitative Report, 27(1), 64-77.
- OECD. PISA 2022 Results: Factsheets, Philippines. OECD.org. Retrieved from https://www.oecd.org/publication/pisa-2022-results/country-notes/philippines-a0882a2d/
- Polit, D. & Beck, C. T. (2017). Nursing research: generating and assessing evidence for nursing practice (10th ed.). Philadelphia, PA: Wolters Kluwer
- Pratama, G. S., & Retnawati, H. (2018, September). Urgency of higher order thinking skills (HOTS) content analysis in mathematics textbook. In Journal of Physics: Conference Series (Vol. 1097, No. 1, p. 012147). IOP Publishing.
- Putra, T. K., & Abdullah, D. F. (2019). Higher-order thinking skill (HOTS) questions in English national examination in Indonesia. The Journal of Educational Development, 7(3), 178-185.
- Rahayu, A. (2018). The analysis of students’ cognitive ability based on assessments of the revised Bloom’s Taxonomy on statistic materials. European Journal of Multidisciplinary Studies, 3(2), 80-85.
- Rahman, S. A., & Manaf, N. F. A. (2017). A Critical Analysis of Bloom’s Taxonomy in Teaching Creative and Critical Thinking Skills in Malaysia through English Literature. English Language Teaching, 10(9), 245-256.
- Reyes, E. C. (2017). Infusion of the Critical Thinking in Chemistry through Selected Teaching Strategies. JPAIR Multidisciplinary Research Journal, 29(1), 0. Retrieved from https://ejournals.ph/article.php?id=12188
- Rosaini, R., Budiyono, B., & Pratiwi, H. (2019, February). Mathematics teacher supporting higher order thinking skill of students through assessment as learning in instructional model. In Journal of Physics: Conference Series (Vol. 1157, No. 3, p. 032076). IOP Publishing.
- Ruslin, R., Mashuri, S., Rasak, M. S. A., Alhabsyi, F., & Syam, H. (2022). Semi-structured Interview: A methodological reflection on the development of a qualitative research instrument in educational studies. IOSR Journal of Research & Method in Education (IOSR-JRME), 12(1), 22-29.
- Sabijon Jr, A. C. (2021). Performance Assessment Task: A Point of Reference for Science Teachers-this Pandemic and Beyond. International Journal of Multidisciplinary: Applied Business and Education Research, 2(12), 1392-1409.
- Sacred Heart College of Lucena City, Inc. Graduate Education Department. (2023). Revised Guide to Thesis Writing 2023 (pp. 15-16)
- Sahronih, S., Purwanto, A., & Sumantri, M. S. (2019, March). The effect of interactive learning media on students’ science learning outcomes. In Proceedings of the 2019 7th International Conference on Information and Education Technology (pp. 20-24).
- Schumacher, M. G. (November 2022). Effects of Thinking Maps in the Development of Higher Order Thinking Skills among Elementary Science Students. AIDE Interdisciplinary Research Journal, 3(1), 130-138. Retrieved from https://ejournals.ph/article.php?id=18287
- Sena, R. Jr., Dames, X., Inojosa, R., Abadilla, R., Macatugob, C., Virge, J. (2019). An Evaluation of the Quarterly Assessment in the Public Secondary Schools, Lucena City. Sacred Heart College OF Lucena City, Inc., Research Repository. Retrieved from https://research.shc.edu.ph/research/show/Bgl0Q
- Setyarini, S. (2020, May). Teachers’ understanding in constructing higher order thinking-based assessments: Voice from English teachers’ experience. In 4th Asian Education Symposium (AES 2019) (pp. 39-42). Atlantis Press.
- Shafeei, K. N., Hassan, H., Ismail, F., & Aziz, A. A. (2017). Incorporating higher order thinking skill (HOTS) questions in ESL classroom contexts. LSP International Journal, 4(1).
- Singh, R. K. V., & Shaari, A. H. (2019). The analysis of Higher-Order Thinking skills in English reading comprehension tests in Malaysia. Geografia, 15(1).
- Stolle, S. (N.D.) Thematic Analysis – A 6 Step Guide for Academic Writing. Bachelor Print. Retrieved from https://www.bachelorprint.com/methodology/thematicanalysis/#:~:text=What%20are%20the%206%20key,%2C%20summarization%20(writing%20up).
- Teaching, C. E., & Environments, L. (2009). First results from TALIS. Teaching and Learning International Survey, OECD.
- Tirol, S. L. (2022). Spiral Progression Approach in the K to 12 Science Curriculum: A Literature Review. International Journal of Education (IJE), 10(4).
- Torres, J. M., Collantes, L. M., Millan, A. R., Alieto, E. O., Estigoy, E. B., & Barredo, C. P. (2021). Classification of learning outcomes and assessment activities in CHED prototype and SUC syllabi based on Kratwohl’s Taxonomy. Elementary Education Online, 20(5), 497-510.
- Torres, J. M., Collantes, L. M., Millan, A. R., Alieto, E. O., Estigoy, E. B., & Barredo, C. P. (2021). Classification of learning outcomes and assessment activities in CHED prototype and SUC syllabi based on Kratwohl’s Taxonomy. Elementary Education Online, 20(5), 497-510.
- Tyas, M. A., Nurkamto, J., Marmanto, S., & Laksani, H. (2019, October). Developing higher order thinking skills (HOTS)–Based questions: Indonesian EFL teachers’ challenges. In Proceedings of the International Conference on Future of Education (Vol. 2, No. 1, pp. 52-63).
- Ulfa, M., & Kuswanti, N. (2021). Development of assessment instrument based on higher order thinking skills of respiratory system of grade XI of senior high school. Berkala Ilmiah Pendidikan Biologi (BioEdu), 10(1), 1-11.
- Urgo, K., Arguello, J., & Capra, R. (2019, September). Anderson and Krathwohl’s two-dimensional taxonomy applied to task creation and learning assessment. In Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval (pp. 117-124).
- Utami, F. D., Nurkamto, J., & Marmanto, S. (2019). Higher-order thinking skills on test items designed by English teachers: A content analysis. International Journal of Educational Research Review, 4, 756-765.
- Wilson, D. M., & Narasuman, S. (2020). Investigating Teachers’ Implementation and Strategies on Higher Order Thinking Skills in School Based Assessment Instruments. Asian Journal of University Education, 16(1), 70-84.
- Wilson, L. O. (2016). Anderson and Krathwohl–Bloom’s taxonomy revised. Understanding the new version of Bloom’s taxonomy.
- Wiyaka, W., Prastikawati, E. F., & Adi, A. P. K. (2020). Higher-order thinking skills (hots)-based formative assessment: A proposed model for language learning assessment. Vision: Journal for Language and Foreign Language Learning, 9(2), 115-130.
- World Bank. (2020). PISA Programme for International Student Assessment 2018: Philippines Country Report. World Bank. Retrieved October 8, 2023 from https://documents1.worldbank.org/curated/en/184251593328815913/Main-Report.docx
- Yassir, M., Syam, H., & Nur, H. (2022). Higher Order Thinking Skills (HOTs) based Assessment for Learning: A Model for Computer Networks Learning in Vocational School. Asian Journal of Applied Sciences (ISSN: 2321–0893), 10(1).
- Yudha, R. P. (2023). Higher order thinking skills (HOTS) test instrument: Validity and reliability analysis with the rasch model. EduMa: Mathematics education learning and teaching, 12(1), 21-38.
- Yüksel, H. S., & Gündüz, N. (2017). Formative and summative assessment in higher education: Opinions and practices of instructors. European Journal of Education Studies.