Modelling SMEA Implementation: The Implementers’ Perspectives
Jerelyn R. Amigo | Betelino V. Amigo
Discipline: Education
Abstract:
The challenges of school monitoring and evaluation (M&E) implementation and the scarcity of
literature discussing factors of successful SMEA implementation prompted this initiative to devise a
model illustrating how SMEA factors were directly influencing the efficiency of school improvement
processes. Using a sequential exploratory design to generate indicators and components of SMEA
from the implementers’ perspective, an exploratory factor analysis (EFA) was utilized to extract and
group the factors to determine the emerging components. Cronbach's alpha was used to assess the
reliability of the instrument. The model depicting interrelationship among SMEA components was
costumed fit using a structural equation modeling and was interpreted using Cohen’s effect size
strength of association. Five factors derived from varying perspectives of SMEA implementation
were extracted and were categorized as (1) the implementers’ appreciation of SMEA benefits, (2)
school engagement towards good SMEA practices, (3) SMEA’s support to quality instruction, (4)
SMEA challenges and limitations, and (5) knowledge and skills of SMEA implementers. Among
these, four components emerged as significantly interrelated and were contributory to successful
SMEA implementation. This strength of positive correlation was illustrated in a model which
described how the implementers’ appreciation of SMEA benefits supported the enhanced appraisal of
the quality of the teaching and learning process. Hence, extensive research is recommended for
deepening each component to sustain and refine the system.
References:
- Abdourahmane, B. (2021). How to measure monitoring and evaluation effectiveness? ResearchGate. African Evaluation Journal. R e t r i e v e d f r o m https://www.researchgate.net/journal/African-EvaluationVol9(No 1 | a553) DOI:10.4102/aej.v9i1.553
- Adaletey, E. J. & George, T. J. (2019). The Relevance of Monitoring, Supervision and Evaluation of Stakeholder Participation in Electronic Governance Projects Implemented in Public Sector Institutions: A Review of Literature. Journal of Humanities and Social Science (IOSR-JHSS) Volume, 24, pp. 52-60.
- Ann W. Frye & Paul A. Hemmer (2012) Program evaluation models and related theories: AMEE Guide No. 67, Medical Teacher, 34:5, e288-e299, DOI: 10.3109/0142159X.2012.668637
- Aziz, S. (2021). Implementation of CIPP Model for Quality Evaluation at School Level: A Case Study. Retrieved from EJ1180614.pdf (ed.gov) on September 10, 2021
- Bajaj, et al (2018). Total quality management: a critical literature rev iew u sing Pareto an aly si s. R et riev ed from h t t p s : / / w w w . e m e r a l d . c o m / insight/content/doi/10.1108/IJPPM-07-2016-0146/ on September 11, 2021.
- BrckaLorenz, A. (2017). Internal Consistency Reliability. Thousand Oaks, CA: Sage Publications, Inc. Retrieved from https://www.semanticscholar.org/paper/Internal-Consistency-Reliabi lity-Shuttleworth/6bd8727ad21790a48341349603ac8531b08a81b4
- Cavanaugh, C., McCarthy, A., & East, M. (2014). An innovation framework for holistic school transformation: ten critical conversations for the 21st century. Redmond, WA: Microsoft World Public Sector.
- Curray, D. (2019). Perspective on Monitoring and Evaluation. V o l u m e : 40 i s s u e : 1 , p a g e ( s ) : 1 4 7 - 1 5 0 . doi https://doi.org/10.1177 /1098214018775845
- Day, C. and Sammons, P. 2019. Successful school leadership. Retrieved from https://files.eric.ed.gov/fulltext/ED565740.pdf on September 4, 2021
- Edmund, S. (2012). Designing monitoring and evaluation systems in PEPs. Switzerland. ILO Publications (Rights and Permissions), International Labour Office, CH-1211 Geneva 22, Switzerland. ISBN 9789221267713; 9789221267720.
- Elacqua and Alves, (2015). Designing effective monitoring and evaluation of education systems for 2030: A global synthesis of policies and practices UNESCO Education Sector Division for Policies and Lifelong Learning Systems (ED/PLS) Section of Education Policy (ED/PLS/EDP. Retrieved on June 22, 2022 from http://designing_effective_monitoring_and_evaluation_of_education_systems_for_2030_a_global_synthesiss_of_policies_and_practices_unesco_education_sector_division_for_policies_and_lifelong_learning_systems_ed_pls_section_of_education_policy_ed_pls_edp./
- Hair, et al (2019). Revisiting Hair Et al.’s Multivariate Data Analysis: 40 Years Later. DOI: 10.1007/978-3-030-06031-2_15
- Holvoet, N. (2014). Taking stock of monitoring and evaluation systems in the health sector: findings from Rwanda and Uganda. 29(4):506-16. doi: 10.1093/heapol/czt038
- Kusek and Rist, (2004). Ten steps to a results-based monitoring and evaluation system: A handbook for Development Practitioners.
- R e t r i e v e d o n J u n e 2 5 , 2 0 2 2 athttps://books.google.com.ph/books?hl=en&lr=&id=AN1_ UBu0k1cC&oi=fnd&pg=PR1&dq=Kusek+and+Rist+2004+monitor i n g + a n d + e v a l u a t i o n + r e s e a r c h & o t s = P 1 G q q q T - V Q & s i g = 2 y 9 b k l e j Y f c Y g 3 g - E N 6 j M h 1 1 y z g & redir_esc=y#v=onepage&q=Kusek%20and%20Rist%202004%20m onitoring%20and%20evaluation%20research&f=false.
- Kyriakides. L. (2010). Using the Dynamic Model to develop an evidence-based and theory-driven approach to school improvement. R e t r i e v e d from https://www.ucy.ac.cy/esf/documents/data/esf/Publications/using_the_dynamic_model.pdf on July 26, 2021
- Khurniawan et al., 2021. The Collaborative Strategy of Total Quality management and School Governance to Improving Effectiveness of Vocational School-Based Enterprise. Retrieved f r o m h t t p s % 3 A % 2 F % 2 F w w w . r e s e a r c h g a t e . net%2Fpublication%2F350175589_The_Strategy_Improving_Schoo l - B a s e d _Enterprise_An_Analytic_Hierarchy_Process_Approach_In_Vocati onal_School_ Palarch%27s on September 8, 2021
- LLantos, M. & Pamatpat, F. 2016. Total Quality Management and School-Based Management Practices of School Principals: Their Implications to School Leadership and Improvement. Retrieved f r o m https://www.researchgate.net/publication/327665248TotalQuality on August 10, 2021
- OECD Chapter 8 Education system evaluation: Informing policies for system improvement
- OECD 2019. Evaluation and Assessment Frameworks for Improving School Outcomes. Retrieved from 46927511.pdf (oecd.org) on July 3, 2021
- Madzimure and Mashishi, (2020). Evaluating the Significance of Strategic Management on the Monitoring and Evaluation of Secondary Schools in Gauteng Province, South Africa. h t t p s : / / s c h o l a r . g o o g l e . c o m . p h /scholar?hl=en&as_sdt=0%2C5&as_vis=1&q=Madzimure+and+ma shishi%2C+2020+monitoring+and+evaluation+research&btnG=.
- Njama, A. (2015). Determinants of effectiveness of a monitoring and evaluation system for projects: A case of Amrep Kenya Wash P r o g ra mm e. R et riev ed on June 21, 2022 ,from http://erepository.uonbi.ac.ke//bitstream/handle/11295/92952/Njama,%20Amos%20W_Determinants%20of%20effectiveness%20of%20a%20monitoring%20and%20evaluation%20system%20for%20projects,%20%20a%20case%20of%20AMREF%20Kenya%20wash%20programme.pdf?sequence=3.
- Paragoso, S. & Barazon, L. 2019. School Monitoring, Evaluation, and Adjustment (SMEA) in Central Cebu, Philippines. Retrieved from School Monitoring, Evaluation, and Adjustment (SMEA) in Central Cebu, Philippines | Semantic Scholar
- Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in N u r s i n g & H e a l t h . 2 0 0 7 ; 3 0 ( 4 ) : 4 5 9 – 67. https://doi.org/10.1002/nur.20199
- Read, L. and Atinc, T. (2017). Investigations Into Using Data to Improve Learning: Philippines Case Study. Research Gate. Retrieved from (PDF) Investigations into Using Data to Improve Learning: Philippines Case Study (researchgate.net)
- UNESCO, (2018). Designing effective monitoring and evaluation of education systems for 2030: A global synthesis of policies and practices UNESCO Education Sector Division for Policies and Lifelong Learning Systems (ED/PLS) Section of Education Policy ( E D / P L S / E D P . R et rie v ed June 14, 2 022 , from https://www.academia.edu/34653270/Designing_effective_monitoring_and_evaluation_of_education_systems_for_2030_A_global_synthesiss_of_policies_and_practices_UNESCO_Education_Sector_Division_for_Policies_and_Lifelong_Learning_Systems_ED_PLS_Sect ion_of_Education_Policy_ED_PLS_EDP.
- UNESCO, (2015). Education for Al Global Monitoring Report 2015. R e t r i e v e d o n J u n e 1 6 , 2 0 2 2 , from https://reliefweb.int/report/world/education-all-global-monitoring-report-2015-education-all-2000-2015-achievements.
- Yusoff, M. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal. 2019;11(2):49–54. https://doi.org/10.21315/eimj2019.11.2.6