HomeQCU The Star: Journal of Science, Engineering, and Information Technologyvol. 1 no. 1 (2023)

Test Item Analysis of Engineering Economy Subjected to Table of Specification: Input for Digital Test Bank and E-Class record for the College of Engineering

Fernando Omadto | Ryan F. Arago | Edgardo Jr R Tinio

Discipline: engineering (non-specific)

 

Abstract:

This study is aimed at analyzing the 50-item multiple choice test in engineering economy and subjecting it to test item analysis using the Table of Specifications. The substance of this research paper is derived from Bloom's taxonomy of learning, which includes Knowledge, Comprehension, Application, Analysis, synthesis, and evaluation, respectively. The analysis of the 50-item test was centered on the TOS specifically: (1) the list of course objectives; (2) the topics covered in class; (3) the amount of time spent on those topics; (4) textbook chapter topics; and (5) the emphasis and space, respectively. The statistical tools used in this study are: metrics of central tendency that include the average and standard deviation of students' scores after the final examination are subjected to graphical analysis of scores and hypothesis testing to determine if a significant difference exists between the academic performance in the final examination and the final grade of students. The hypothesis testing was done at a 5% level of significance relative to the numerical coefficient for degree of freedom. This study methodically employed a review of related studies and literature to categorize, describe, analyze, and interpret the borrowed materials from different authors both in the local and international domains, respectively. The end goal of this study was to develop a relevant and effective mechanism for a digital LMS intended for testing banking systems and metrics for the grading system. The study further employed CDAI (Categorizing, Describing, Analyzing, and Interpreting), a method that was originally developed by Johnny Saldana (2019). This study was conducted on Quezon City University's main campus during the school year 2023-2024.



References:

  1. Bichi (2015) Item Analysis using a Derived Science Achievement Test Data published by International Journal of Science and Research (IJSR)Volume 4 Issue 5, May 2015
  2. Camba et al. (2021) Does this OBE Count: Test Development and Item Analysis in High School Dressmaking Course
  3. Cooper et al. (retrieved june 23, 2023) Using Reliability, Validity, and Item Analysis to Evaluate a Teacher-Developed Test in International Business.
  4. Dichoso et al. (2020) Test Item Analyzer Using Point-Biserial Correlation and P-Values in the Philippines schools. Published by INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH VOLUME 9, ISSUE 04, APRIL 2020.
  5. Gnaldi (2013) Methods of Item Analysis in Standardized Student Assessment: an Application to an Italian Case Study. Published by ResearchGate (2013)
  6. Ignacio (2008) An Analysis of Test Item Pool in Selected Subjects in College Of Business Education TIP Research Journal Quezon City vol. 5 no. 1
  7. Jugar (2013) An Inquiry on the Roles of Personal Test Item Banking (PTIB) and Table of Specifications (TOS) in the Construction and Utilization of Classroom Tests published by International Journal of Education and Research Vol. 1 No. 12 December 2013 Lahza et al. (2022) Beyond item analysis: Connecting student behavior and performance using e-assessment logs published by British Journal of educational technology (BERA) (2023)
  8. Lloyd et al. (2021) Electricity Concepts' Test Construction, Validation, and Item Analysis for Senior High School General Physics 2 IN STEM students in a public national high school in Pangasinan, Philippines
  9. Mamolo (2021) Development of an Achievement Test to Measure Students' Competency in General Mathematics published by Anatolian Journal of Education April 2021 Vol.6, No.1
  10. Marie et al.(2015) RELEVANCE OF ITEM ANALYSIS IN STANDARDIZING ACHIEVEMENT TEST IN TEACHING OF PHYSICAL SCIENCE IN B.ED SYLLABUS published by i-manager's Journal of Educational Technology, Vol. 12 I No. 31 October - December 2015
  11. McCowan et al. (1999) Item Analysis for Criterion Referenced Tests published by Research Foundation of SUNY/Center for Development of Human Services. (1999) Olaso (2019) Test Construction and Item Analysis including Rubrics Development at G10- Antipolo's room on July 1-5, 2019
  12. Ole et al. (2021) DEVELOPMENT AND VALIDATION OF A PHYSICS CONCEPT TEST IN KINEMATICS FOR SENIOR HIGH SCHOOL STUDENTS of IOER INTERNATIONAL MULTIDISCIPLINARY RESEARCH JOURNAL (IIMRJ)
  13. Orongan (2020) Reliability Analysis on Teachers' Quarterly Classroom Assessment in Basic Education published by LDCU-REPI Asian Scientific Journals Vol 16, No 1 (2020)
  14. Patrimonio (2017) THE ETEST BUILDER: A RENAISSANCE IN EDUCATIONAL ASSESSMENT PRACTICE
  15. Perkins et al.(2018) An Item Analysis and a Reliability Estimate of a Classroom Kinesiology Achievement Test published by Research Foundation of SUNY/Center for Development of Human Services.(2018)
  16. Sabri et al. (2013) ITEM ANALYSIS OF STUDENT COMPREHENSIVE TEST FOR RESEARCH IN TEACHING BEGINNER STRING ENSEMBLE USING MODEL BASED TEACHING AMONG MUSIC STUDENTS IN
  17. PUBLIC UNIVERSITIES published by semantic scholar (2013)
  18. Sorby et al. (2013) The Development and Assessment of a Course for enhancing the 3-D Spatial Visualization Skills of First Year Engineering Students published by research journal of engineering education (2013)
  19. Tan et al. (2019) Development of Valid and Reliable Teacher-made Tests for Grade 10 Mathematics published by Academia.edu
  20. JOURNAL PUBLICATION & NEWS PAPERS INCLUDING ESSAYS Alade et al. (2014). TABLE OF SPECIFICATION AND ITS RELEVANCE IN
  21. EDUCATIONAL DEVELOPMENT ASSESSMENT Published by European Centre for Research Training and Development UK Vol.2, No.1, pp.1-17, March 2014 retrieved June 26, 2023
  22. Anunaobi, et al. (2022). Relevance of Table of Specification in Educational Assessment published by International Journal of Innovative Social Sciences & Humanities Research 10(1):73-80, Jan.-Mar., (2022).
  23. Ballado (2014). Development and Validation of a Teacher Education Aptitude Test published by International Journal of Interdisciplinary Research and Innovations Vol. 2, Issue 4, pp: (129-133), Month: October - December 2014 retrieved June 26, 2023
  24. Bautista et al. (2019). Construct Validity and Difficulty Index of Departmentalized Reading Comprehension Test for Grade 11 Students published by Asian EFL Journal Research Articles. Vol. 23 Issue No. 3.3 May 2019
  25. Cagape (2009). "Ethical Standards in Tests: Test Preparation and Administration in Philippine Education, A study in Zamboanga Del Sur" Published by scribd Zamboanga de sur Philippines. Retrieved June 26, 2023
  26. Dela Rama (2011). The Conformity of Test Construction of the Achievement Test Papers of College Teachers: A Case Study Published by Silliman journal Vol. 52 no. 2 (2011). Silliman University Philippines. Retrieved June 26, 2023
  27. Doctor (2017). Integrated Educational Management Tool for Adamson University. Published by International Journal of Computing Sciences Research (ISSN print: 2546-0552; ISSN online: 2546-115X) Vol. 1, No. 1, pp. 52-71. Manila, Philippines
  28. Doctor et al. (2019). DEVELOPMENT AND ACCEPTABILITY OF AN INTEGRATED ITEM ANALYSIS APPLICATION: AN ENHANCEMENT TO ADAMSON UNIVERSITY INTEGRATED EDUCATIONAL
  29. MANAGEMENT TOOL published by Journal of the World Federation of Associations of Teacher Education (2019) Manila, Philippines
  30. Fives et al. (2013). Classroom Test Construction: The Power of a Table of Specifications published by Montclair State University Montclair, New Jersey 07043. USA.
  31. Gochyyev et al. (2023). Item Analysis published by sage research methods. Retrieved June 26, 2023
  32. Lasaten (2016). Assessment Methods, Problems and Training Needs of Public High School Teachers in English published by International Journal of Languages, Literature and Linguistics, Vol. 2, No. 2, June 2016 Retrieved June 26, 2023
  33. Odukoya et al. (2017). Item analysis of university-wide multiple choice objective examinations: the experience of a Nigerian private university published by national library of medicine national center of biotechnology information (2017)
  34. Quaigrain et al. (2017). Using reliability and item analysis to evaluate a teacher- developed test in educational measurement and evaluation published by Taylor and Francis online cogent education vol. 4 issue 1
  35. Rezigalla (2022). Item Analysis: Concept and Application Published by Medical Education for the 21st Century Edited by Michael S. Firstenberg and Stanislaw P. Stawicki
  36. Roleda et al. (2018). The Effect of Language in Students' Performance in FCI. Presented at the DLSU Research Congress 2018 De La Salle University, Manila, Philippines June 20 to 22, 2018
  37. Siena College (2023). IMPORTANCE OF TABLE OF SPECIFICATION IN CONSTRUCTING TEST ITEMS. Published by sienna College of Quezon City. Article retrieved june 26, 2023. NCR Manila Philippines
  38. Silao et al. (2021). DEVELOPMENT OF AN AUTOMATED TEST ITEM ANALYSIS SYSTEM WITH OPTICAL MARK RECOGNITION (OMR). Published by IAEME Publication International Journal of Electrical Engineering and Technology (IJEET) Volume 12, Issue 1, January 2021, pp. 67-79. Nueva Ecija philippines
  39. Siri et al. (2011). The Use of Item Analysis for the Improvement of Objective Examinations published by research gate retrieve June 26 2023
  40. Tamayao et al. (2020). Design and Validation of the College Readiness Test (CRT) for Filipino K to 12 Graduates published by International Journal of Higher Education Vol. 9, No. 2; 2020. Tuguegarao City, Cagayan, Philippines
  41. Tardeo et al. (2015). ASSESSMENT OF PHYSICS QUALIFYING EXAMINATION FOR EE AND ECE COURSES: AN ITEM AND OPTION ANALYSIS published by LPU-Laguna Journal of Multidisciplinary Research Vol. 4 No.3 September 2015. Laguna province Philippines
  42. Thirakunkovit (2016). AN EVALUATION OF A POST-ENTRY TEST: AN ITEM ANALYSIS USING CLASSICAL TEST THEORY (CTT). Published by Purdue University Purdue e- Pubs Indiana USA
  43. Yahia (2021). Post-validation item analysis to assess the validity and reliability of multiple -choice questions at a medical college with an innovative curriculum published by pub med Natl Med J India 2021 Nov-Dec
  44. Snyder (2019) Literature review as a research methodology: An overview and guidelines published by Journal of Business Research Volume 104, November 2019, Pages 333- 339