Home⇛International Journal of Multidisciplinary: Applied Business and Education Research⇛vol. 5 no. 7 (2024)

An Achievement Test in Mathematics in the Modern World Course: The Standardization Process

Jericho Y. Baybayan | Michelle R. Lacia

Discipline: education and teaching

 

Abstract:

This study aimed to construct and standardize an achievement test in Mathematics in the Modern World (MMW) course. Achievement test evaluates a student’s performance after a given period of instruction. Using the instrumentation research design, the data were gathered among 273 tertiary students of Notre Dame University enrolled during the second semester of Academic Year 2020-2021. Among these, 38 pilot tested and 213 tested the reliability of the instrument. This study further utilized the following: a 4-point Likert scale for the validation of the instrument, difficulty value and discrimination index formulas for the analysis of each item, and KR20 reliability for internal consistency. Furthermore, a test manual for the MMW achievement test was also established. The preliminary total number of Items before MMW teachers’ validation was 42 items covering the topics for the first 12 hours of the MMW Syllabus. These items were validated through Aiken’s Item Validity method which resulted in the acceptance of 42 items. After rigorous processes, it resulted in the acceptance of 34 items for the MMW achievement test. The instrument’s average validity is 0.935, and the reliability is 0.701 which means that this tool has high validity and acceptable reliability.



References:

  1. Beck, K. (2020). How to Calcuate a T-Score. Leaf Group Ltd. / Leaf Group Media. https://sciencing.com/calculate-tscore-5135749.html
  2. Bruce, L. (2021). Module 7: Study Skills - Common Types of Tests in College. Lumenwaymaker. https://courses.lumenlearning.com/waymaker-collegesuccess/chapter/text-common-types-of-tests-in-college/#:~:text=Common%20Test%20Types,tests%2C%20and%20physical%20skills%20tests
  3. Cengage Learning (2021). Understanding Standardized Assessment. https://www.shsu.edu/aao004/documents/15_005.pdf
  4. Cerezo (2021). Técnicas de evaluación: Standardized testing. Universidad de Murcia. https://webs.um.es/lourdesc/miwiki/lib/exe/fetch.php?media=standardized_testing.pdf
  5. Churchill, A. (2015). Bless the tests: Three reasons for standardizes testing. The Thomas B. Fordham Institute. https://fordhaminstitute.org/national/commentary/bless-tests-three-reasons-standardizedtesting
  6. Clay, B. (2001). Is This a Trick Question? A Short Guide to Writing Effective Test Questions. Kansas Curriculum Center of Kansas State University. https://www.k-state.edu/ksde/alp/resources/Handout-Module6.pdf
  7. Commission on Higher Education [CHED], (2017). KWF- Mathematics in the Modern World. https://ched.gov.ph/wp-content/uploads/2017/10/KWF-Mathematics-in-the-Modern-World.pdf
  8. Cortina, J. (1993). What Is Coefficient Alpha? An Examination of Theory and Applications. Journal of Applied Psychology 1993. Vol. 78., No. 1. pp. 98-104. https://www.psycholosphere.com/what%20is%20coefficient%20alpha%20by%20Cortina.pdf
  9. Ebel, R. L., & Frisbie, D. A. (1986). Essentials of education measurement. Englewood Cliffs, NJ: Prentice Hall.
  10. Educational Research Techniques (2017). Developing Standardized Tests.EducationalResearchTechniques.com. https://educationalresearchtechniques.com/2017/06/21/developing-standardized-tests/
  11. Evroro, E. (2015). Item Analysis of Test of Number Operations. Asian Journal of Educational Research Vol. 3, No. 1, 2015 ISSN 2311-6080. http://www.multidisciplinaryjournals.com/wpcontent/uploads/2015/01/ITEM-ANALYSIS-OF-TEST-OF-NUMBER-OPERATIONS.pdf
  12. Faremi, Y. A. (2016). Reliability Coefficient of Multiple Choice and Short Answer Objective Test Items in Basic Technology: Comparative Approach. Journal of Educational Policy and Entrepreneurial Research (JEPER), Vol. 3 (No. 3), 60-61. ISSN: 2408-770X (Print), ISSN: 2408-6231 (Online). https://www.zeetarz.com/Jee/wp-content/uploads/2018/01/Reliability-Coefficient-of-Multiple%E2%80%93Choice-and-Short-Answer-Objective-Test-Items-in-Basic-Technology-Comparative-Approach.pdf
  13. Frey, B. B. (2018). Achievement Tests. SAGE Publications. https://dx.doi.org/10.4135/9781506326139.n16.
  14. https://methods.sagepub.com/reference/the-sage-encyclopedia-of-educational-research-measurement-and-evaluation/i1967.xml
  15. Glen, S. (2017). Classical Test Theory: Definition. StatisticsHowTo.com: Elementary Statistics for the rest of us!. https://www.statisticshowto.com/classical-test-theory/
  16. Glen, S. (2020). Z-Score: Definition, Formula and Calculation. StatisticsHowTo.com: Elementary Statistics for the rest of us! https://www.statisticshowto.com/probability-and-statistics/z-score/
  17. Great Schools Partnership (2015). Standardized Test. Edglossary.org. https://www.edglossary.org/standardized-test/
  18. Haladyna, T. M. (2018). Developing Test Items for Course Examinations. IDEA Student Ratings System. https://www.ideaedu.org/Portals/0/Uploads/Documents/IDEA%20Papers/IDEA%20Papers/IDEA_Paper_70.pdf
  19. Ikhsanudin & Subali (2018). Content validity analysis of first semester formative test on biology subject for senior high school. Journal of Physics: Conference Series 1097012039. https://www.researchgate.net/publication/328258459_Content_validity_analysis_of_first_semester_formative_test_on_biology_subject_for_senior_high_school
  20. Irawan, E., & Wilujeng, H. (2020). Development of an online mathematical misconception instrument. Journal of Physics: Conference Series. https://www.researchgate.net/publication/345162423_Development_of_an_online_mathematical_misconception_instrument
  21. Katz, L. J., & Slomka, G. T. (2000). Achievement Testing. Handbook of Psychological Assessment (Third Edition) and Elsevier B. V. https://www.sciencedirect.com/topics/medicine-and-dentistry/achievement-test
  22. Kean, J., & Reilly, J. (2014). Classical Test Theory. https://static1.squarespace.com/static/514fd024e4b0d4d5c3e59e38/t/53bc6138e4b07f64b2496034/1404854584695/Kean+Reilly+%282014+in+press%29+Classical+Test+Design.Pdf
  23. Kpolovie, P. J. (2016). Single-Subject Research Method: The Needed Simplification. British Journal of Education (Vol. 4, No. 6, pp.68-95, June 2016). https://www.eajournals.org/wpcontent/uploads/Kpolovie-Peter-James.pdf
  24. Kumar, N. (2016). Construction and Standardization of an Achievement Test in English Grammar. International Journal of Current Research and Modern Education (Vol. I, Issue II) http://ijcrme.rdmodernresearch.com/wp-content/uploads/2017/01/141.pdf
  25. Lacia, M. (2007). The Notre Dame University Mathematics Qualifying Examination: An Analysis
  26. Logsdon (2020). Different Types of Scores on Standardized Tests. Very Well Family. https://www.verywellfamily.com/what-are-standard-scores-2162891
  27. Math is Fun (2017). Standard Deviation Formulas. MathsIsFun.com. https://www.mathsisfun.com/data/standard-deviation-formulas.html
  28. Metcalf, A. in ResearchGate (2017, October 25). Many sources say above 0.70 is acceptable. 0.80 or greater is preferred. Higher is better. [Comment on the post “What is the acceptable range for Cronbach alpha test of reliability?”]. ResearchGate GmbH. https://www.researchgate.net/post/What-is-the-acceptable-range-for-Cronbach-alpha-test-of-reliability
  29. Mitra N.K., Nagaraja, H.S., Ponnudurai, G., & Judson, J.P. (2009). The Levels Of Difficulty And Discrimination Indices In Type A Multiple Choice Questions Of Pre-clinical Semester 1 Multidisciplinary Summative Tests. IeJSME 2009: 3(1): 2-7. https://www.researchgate.net/publication/227858882_The_Levels_Of_Difficulty_And_DiscriminationIndices_In_Type_A_Multiple_Choice_Questions_Of_Preclinical_Semester_1_Multidisciplinary_Summative_Tests
  30. Nixon, B. (2021). The Pros and Cons of Standardized Testing. WHITBY School. https://www.whitbyschool.org/passionforlearning/the-pros-and-cons-of-standardized-testing
  31. Pam, M. S. (2013). ITEM VALIDITY. PsychologyDictionary.org. https://psychologydictionary.org/itemvalidity/
  32. Patock, J. (2004). Exam Scores: How to Interpret your Statistical Analysis Reports. University Testing Services Arizona State University. https://jcesom.marshall.edu/media/24101/Interpreting-Statistical-Information.pdf
  33. Schuwirth, L. W., & Van Der Vleuten, C. P. (2011). General overview of the theories used in assessment. T. Gibbs, Penyunt. Association for Medical Education in Europe (AMEE). https://www.tandfonline.com/doi/abs/10.3109/0142159X.2011.611022
  34. Sefcik, D. J., Bice, G., & Prerost, F. (2013). How to Study for Standardized Tests. Burlington, United States of America: Jones & Bartlett Learning. http://samples.jblearning.com/9780763773625/73625_FMXX_Final.pdf
  35. Sharma, H. L., & Sarita (2018). Construction and standardization of an achievement test in Science. International Journal of Research and Analytical Reviews. http://ijrar.com/upload_issue/ijrar_issue_1399.pdf
  36. Sharma, H.L., & Poonam (2017). Construction and Standardization of an achievement test in English grammar. International Journal of Advanced Educational Research (Vol. 2, Issue 5). http://www.educationjournal.org/archives/2017/vol2/issue5/2-5-108
  37. Siegle, D. (2021). Educational Research Basics: Standardized Scores. University of Connecticut Nega School of Education. https://researchbasics.education.uconn.edu/standardized-scores/
  38. Taber, K. (2016) The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res Sci Educ (2018) 48:1273–1296 DOI10.1007/s11165-016-9602-2. https://www.researchgate.net/publication/317777374_The_Use_of_Cronbach's_Alpha_When_Developing_and_Reporting_Research_Instruments_in_Science_Education
  39. The Glossary of Educational Reform (2015). Standardized Test. Great Schools Partnership. https://www.edglossary.org/standardizedtest/#:~:text=To%20evaluate%20whether%20students%20have,student%20learning%20and%20academic%20progress
  40. Tookoian, J. (2016). Deciding the length of a test. https://edulastic.com/blog/the-right-number-of-test-questions/
  41. UTHealth (2021) Lesson 1.6 Standard Scores. University of Texas-Houston Health Science Center. https://www.uth.tmc.edu/uth_orgs/educ_dev/oser/L1_6.HTM.
  42. Zucker, S. (2003). Fundamentals of Standardized Testing. Hardcourt Assessment, Inc. http://images.pearsonassessments.com/images/tmrs/tmrs_rg/Fundamentals_of_Standardized_Testing.pdf

Tools


Copyright © 2024  KITE Digital Educational Solutions |  Exclusively distributed by CE-Logic