Estimating the Students&rsquo; Mathematical Ability Using the Newton-Raphson Algorithm Under the Item Response Theory and the Classical Response Theory: A Comparative Study

Sisteta  Kamdon,; Nurijam Hanna  Mohammad,; Ummar  Sallil,

Estimating the Students’ Mathematical Ability Using the Newton-Raphson Algorithm Under the Item Response Theory and the Classical Response Theory: A Comparative Study

Sisteta Kamdon | Nurijam Hanna Mohammad | Ummar Sallil

Discipline: Education

Abstract:

This paper utilized the Newton-Raphson Algorithm in calibrating the Item-Response Theory (IRT) to estimate the mathematical abilities of the senior high school students of the Mindanao State University - Tawi-Tawi Campus. For comparison, we also employed the Classical Test Theory (CTT) for the same purpose. It was found out that more of the ability estimates of the concerned students were at the average or above average level in the IRT than in the CTT. Nevertheless, more passers were noted under the IRT than those under the CTT. Moreover, there was a significant difference between the transmuted grades under the IRT and the CTT among the STEM groups while no significant difference was noted among the HUMMS groups. Furthermore, ability estimates of all groups under the IRT and CTT showed significant relationship. The results appeared to support the strength of the IRT, particularly the Newton-Raphson Algorithm, over the CTT in estimating students’ mathematical abilities. Hence, the Newton-Raphson method of the IRT can be a better estimation method that teachers/educators can use in establishing the abilities/performances of their students.

References:

Ado Abdu Bichi, Rohaya Talib (2018) “Item Response Theory: An Introduction to Latent Trait Models to Test and Item Development”, International Journal of Evaluation and Research in Education, Vol.7, pp. 142~151
Andrew Schworer and Dr. Peter Hovey. Newton-Raphson Versus Fisher Scoring Algorithm in Calculating Maximum Likelihood Estimation.
Anna Zieba (2013). The Item Information Function in One and Two Parameter Logistic Models- A Comparison and Use in The Analysis of the Results of School Tests.
Bakari H.R, Adegoke T.M, and Yahya A.M (2016). Application of Newton Raphson Method to Non-Linear Models.
Baker, Frank B (2001). The Basics of Item Response Theory. 2 nd edition. Eric Clearinghouse on Assessment and Evaluation, USA.
Baker, Frank B., Seock-Ho Kim, Item Response Theory: Parameter Estimation Techniques, Second Edition, Revised and Expanded.
Ching Fung B (2012). Ability Estimation Under Different Item Parameterization and Scoring Models.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory principles and applications. Boston, MA: Kluwer-Nijhoff Publishing.
Hulya OLMUS, Ezgi,Nazman, Semra, Erbas, An Evaluation of the Two-Parameter (2-PL) IRT Models Through a Simulation Study”
Ilham Falani, Nisraeni, Iyan Irdiyansyah. The Ability of Estimation Stability and Item Parameter Characteristics Reviewed Item Response Theory Model.
In Jae Myung (2002). Tutorial on Maximum Likelihood Estimation.
Ivailo Partchev (2004). A Visual Guide to Item Response Theory.
Jumailiyah Mahmud, Item Response Theory: A Basic Concept.
James E. Carlson, Matthias von Davier (2013). Item Response Theory.
Kelly, Melissa (2017). School Testing Assesses Knowledge Gains and Gaps.
Norman Rose (2010). Maximum Likelihood and Bayes Modal Ability Estimation in Two-Parametric IRT Models: Derivations and implementation. Institute of Psychology. Friedrich Schiller University, Jena.
R.K. Humbleton, H. Swaminathan, H. Jane Rogers (1991). Fundamentals of Item Response Theory.
R.K. Humbleton, H. Swaminathan (1985). Item Response Theory: Principles and Applications.
Saba Akram, Qurrat ul Ann (2015). Newton Raphson Method. International Journal for Science and Engineering Research, Volume6.
Thompson, Nathan A. (2009). Ability Estimation with Item Response Theory. Assessment Corporation 2233Univiversity, Minnesota.
Tugba Karadavut (2017). Estimation of Item Response Theory Models When Ability is Uniformly Distributed.
W J van der Linden (2010). Item Response Theory, International Encyclopedia of Education (2010), vol.4, pp. 81-88
Ypma, Tjalling J. (1995). Historical Development of NewtonRaphson Method.