HomeInternational Journal of Multidisciplinary Educational Research and Innovationvol. 3 no. 1 (2025)

Kirkpatrick’s Model as Evaluative Tool for the Master of Artsin Teaching in the Early Grades Program Assessment

Princess Gerbie C. Durante | Ruben E. Borja II | Remedios O. Azarcon

Discipline: Education

 

Abstract:

This study evaluates the effectiveness of the Master of Arts in Teaching in the Early Grades program using Kirkpatrick’s model. Employing a mixed methods triangulation design, the research allows for a comprehensive analysis of the data collected from program evaluations. Participants included faculty and students purposively selected from a state university in Central Luzon, Philippines. Data were collected through a survey questionnaire adapted from Alsalamah and Callinan to fit the study's context. The findings reveal that both students and faculty members have positive perceptions regarding three components of Kirkpatrick's Model: Reaction Level, Behavior Level, and Learning Level. However, the Results Level showed concerning downward trends in key areas such as enrollment, graduation rates, and completion rates. Additionally, challenges were identified in data collection and analysis, as well as issues related to language and concepts used in evaluating program outcomes. Based on these findings, recommendations are offered for ongoing enhancement of the program. These suggestions aim to address the identified issues and improve overall effectiveness, ensuring that the program continues to meet the needs of its participants and achieves its educational objectives.



References:

  1. Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s Four-Level Model of Training Criteria to evaluate training programs for head teachers. Education Sciences, 11(3), 116. https://doi.org/10.3390/educsci11030116
  2. Astin, A. W. (1993). What matters in college? Four critical years revisited. Jossey-Bass/Wiley.
  3. Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41(1), 63–105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x
  4. Blanco, R. (2021). Course Syllabus: Assessment in Teaching Early Grades (K to 3). Bulacan State University, Malolos City, Philippines.
  5. Broad, M. L., & Newstrom, J. W. (1992). Transfer of training: Action-packed strategies to ensure high payoff from training investments. Addison-Wesley.
  6. Brown, K. G., & Sitzmann, T. (2011). Training and employee development for improved performance. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology, Vol. 2. Selecting and developing members for the organization (pp. 469–503). American Psychological Association. https://doi.org/10.1037/12170-016
  7. Burke, L. A., & Hutchins, H. M. (2007). Training transfer: An integrative literature review. Human Resource Development Review, 6(3), 263–296. https://doi.org/10.1177/1534484307303035
  8. Cahapay, M. (2021). Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation.  International Journal of Assessment Tools in Education, 8(1), 135–144. https://doi.org/10.21449/ijate.856143
  9. Cohen,   J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
  10. Collins Dictionary. (2022). Definition of 'dropout rate'. Retrieved     from https://www.collinsdictionary.com/us/dictionary/english/dropout-rate on May 7, 2022.
  11. Commission on Higher Education. (2021). Policies, Standards, and Guidelines for Graduate Programs. CHED Memorandum Order No. 15 Series of 2019.
  12. Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approach (5th ed.). SAGE.
  13. Farrell, M. (2009). Foundations of special education: An      introduction. John Wiley & Sons. https://doi.org/10.1002/9780470744659
  14. Federal   Student Aid. (2022). What is graduation, retention, and transfer rates? Retrieved from https://studentaid.gov/help/graduation-retention-transfer-rates  on May 7, 2022.
  15. Holton, E. F., III. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7(1), 5–21. https://doi.org/10.1002/hrdq.3920070103
  16. Kirkpatrick, D. L. (1959). Techniques for evaluating training programs. Journal of the American Society of Training and Development, 13, 3-9.
  17. Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs: The four levels (3rd ed.). Berrett-Koehler Publishers.
  18. Merritt, D. J. (2007). Bias, the brain, and student evaluations of teaching. Ohio State Public Law Working Paper No. 87. https://ssrn.com/abstract=963196 or http://dx.doi.org/10.2139/ssrn.963196
  19. Noe, R. A. (2009). Employee training and development (5th ed.). McGraw Hill.
  20. Numan, S., Islam, A., & Sadat, A. (2007). Analytical views of student enrolment trend of different programs of Bangladesh Open University and its projection. The Turkish Online Journal of Distance Education, 8.
  21. Patton, M. Q. (1987). Qualitative Research & Evaluation Methods.Thousand Oaks, CA: Sage Publishers.
  22. Phillips, J. J. (2003). Return on investment in training and performance improvement programs (2nd ed.). Routledge. https://doi.org/10.4324/9780080516257
  23. Pineda, P. (2010). Evaluation of training in organizations: A proposal for an integrated model. Journal of European Industrial Training, 34(7), 673–693. https://doi.org/10.1108/03090591011070789
  24. Quiñones, M. A. (1997). Contextual influences on training effectiveness. In M. A. Quiñones & A. Ehrenstein (Eds.), Training for a rapidly changing workplace: Applications of psychological research (pp. 177–199). American Psychological Association. https://doi.org/10.1037/10260-007
  25. Sauro, J., & Lewis, J. R. (2016). Quantifying the User Experience (2nd ed.). Elsevier Inc.
  26. Srinivasacharlu, A. (2020). Using YouTube in Colleges of Education. Shanlax International Journal of Education, 8(2), 21-24.
  27. Than, W., & Khaing, N. (2020). A meta-analysis on factors influencing student satisfaction in higher education. [Journal Name], 18, 393–404.
  28. Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition (2nd ed.). University of Chicago Press. https://doi.org/10.7208/chicago/9780226922461.001.0001
  29. Tsyganenko, M. (2014). The effect of a leadership development program on behavioral and financial outcomes: Kazakhstani experience. Procedia - Social and Behavioral Sciences, 124, 486–495. https://doi.org/10.1016/j.sbspro.2014.02.511
  30. Walberg, H., & Paik, S. (2000). Effective educational practices. Educational Practices Series No. 3.
  31. World Health Organization. (2022). Persistence to last grade of primary (% of cohort). Retrieved from https://www.who.int/data/gho/indicator-metadata registry/imrdetails/5563#:~:text=Cohort%20survival%20rate%20is%20calculated,education%2C%20and%20multiplying%20by%20100 on May 7, 2022.
  32. Yardley, S., & Dornan, T. (2012). Kirkpatrick’s levels and education ‘evidence.’ Medical Education, 46(1), 97-106. https://doi.org/10.1111/j.1365-2923.2011.04076.x.