The Impact of Online Instruction During the Covid Pandemic on MFTB and CBE Testing Outcomes
William Hahn | Chris Fairchild
Discipline: Education
Abstract:
The present study examines how online instruction during the COVID pandemic
impacted learning and performs a partial replication of a study by Hahn et al. (2012),
which compared students’ testing outcomes of the Major Field Test in Business
(MFTB) and the Comprehensive Business Exam (CBE). Our results find that online
instruction during the 2020-2021 pandemic isolation period had no significant
impact on pre- and post-COVID testing outcomes for either exam. It was further
found that the question set employed by the CBE exam appears to have changed
from the pre- to the post-COVID testing timeframes, making this exam questionable
for assurance of learning purposes when comparing to prior year results.
References:
- Allen, J. S., & Bycio, P. (1997). An evaluation of the Educational Testing Service Major Field Achievement Test in Business. Journal of Accounting Education 15(4), 503-514. https://doi.org/10.1016/S0748-5751(97)00021-3
- American Psychological Association. (n.d.). Partial replication. In APA dictionary of psychology. Retrieved December 11, 2023 from: https://dictionary.apa.org/partial-replication
- Bagamery, B. D., Lasik, J. J. & Nixon, D. R. (2005). Determinants of success on the ETS Business Major Field Exam for students in an undergraduate multisite regional university business program. Journal of Education for Business 81(1): 55-63. https://doi:10.3200/JOEB.81.1.55-64
- Bielinska-Kwapisz, A., Brown, W., & Semenik, R. (2012). Is higher better? Determinants and comparisons of performance on the Major Field Test in Business. Journal of Education for Business, 87(3), 159-169. doi:10.1080/08832323.2011.582897
- Black, H. T., & Duhon, D. L. (2003). Evaluating and improving student achievement in business programs: The effective use of standardized assessment tests. Journal of Education for Business 79(2): 90-98. https://doi:10.1080/08832320309599095
- Bycio, P. J., & Allen, J. S. (2007). Factors associated with performance on the Educational Testing Service (ETS) Major Field Achievement Test in Business (MFAT-B). Journal of Education in Business 82(4), 196-201. http://dx.doi.org/10.3200/JOEB.82.4.196-201
- Educational Testing Service (ETS). 2023. Major field tests: Business. https://www.ets.org/pdfs/mft/bachelors-deg-bus-test-description.pdf
- Fairchild, C. & Hahn, W. (2020). Accounting and finance majors outperform other majors on the Major Field Test in Business and the Comprehensive Business Exam: An analysis of exam performance drivers. Journal of Education for Business, 95(6), 345-350. http://dx.doi.org/10.1080/08832323.2019.1653249
- Fisher, H. H., Hawkins, G. T., Hertz, M., Sliwa, S., & Beresovsky, V. (2022, November). Student and school characteristics associated with COVID-19—Related learning decline among middle and high school students in K-12 schools. Journal of School Health, (92)11, 1027-1039. http://dx.doi.org/10.1111/josh.13243
- Future Business Leaders of America (FBLA). (2023). Comprehensive business exam. https://fliphtml5.com/gdde/qkkm/basic
- Hahn, W. (2019). Assurance of learning: The impact of business core course reviews on students’ scores on the Comprehensive Business Exam for both internal and external comparative purposes. Journal of Education for Business, 94(1), 40-45. https://doi:10.1080/08832323.2018.1502740
- Hahn, W., Bowlin, L.L., & Welch, T. (2012). Outcomes assessment: An examination of the ETS Major Field Test and the Comprehensive Business Exam. Assessment & Evaluation in Higher Education 83(2), 77-86. https://doi:10.1080/02602938.2010.527917
- Hahn, W. & Leslie, B. (2017). The Comprehensive Business Exam: Usefulness for assessing instructional and student performance outcomes. Journal of Education for Business, 92(1), 23-28. https://doi:10.1080/08832323.2016.1270886
- Hahn, W. & Leslie, B. (2018). Capability matters: Relating student achievement on the Comprehensive Business Exam to skill and effort. Journal of Education for Business, 93(6), 276-284. https://doi.org/10.1080/08832323.2018.1472061
- Iqbal, Z. (2020). An analysis of the Educational Testing Service Major Field Tests for Business performance. Journal of Educational Research & Practice, 10(1), 242-253. https://doi.10.5590/JRTSP.2020.10.1.16
- Ketcham, D., Nigro, P., & Roberto, M. (2018). Do persistence and passion matter: Evidence from the Educational Testing Service Major Field Test in Business. Journal of Education for Business, (93)3, 112-118. https://doi10.1080/08832323.2018.1425284
- Laerd Statistics. (2015). Independent samples t-test. Tutorials for SPSS statistics. Retrieved from https://statistics.laerd.com/
- Marshall, L. L. (2007). Measuring assurance of learning at the degree program and academic major levels. Journal of Education for Business, 83(2), 101-109. http://dx.doi.org/10.3200/JOEB.83.2.101-109
- Mason, P. M., Coleman, B. J., Steagall, J. W., Gallo, A. A., & Fabritius, M. M. (2011). The use of the ETS Major Field Test for assurance of business content learning: Assurance of waste? Journal of Education for Business, 86(2), 71-77. doi:10.1080/08832323.2010.480988
- Messer, R. (2021). Analyzing student performance on the Major Field Test in Business at a Canadian university. International Journal of Instruction, 14(3), 629-644. http://dx.doi.org/10.1080/08832323.2015.1058736
- Mirchandani, D., Lynch, R., & Hamilton, D. (2001). Using the ETS Major Field Test in Business: Implication for assessment. Journal of Education for Business, 1, 51-56. doi:10.1080/0883232019599671
- Pringle, C. & Michel, M. (2007). Assessment practices in AACSB-accredited business schools. Journal of Education for Business, 82(4), 202-211. https://doi.org/10.3200/JOEB.82.4.202-211
- Simmons, S. A., Jones, W. M., & Bolt, C. E. (2015). The Major Field Test in Business: A direct measure of learning in common business disciplines. Journal of Education for Business, (90)2, 57-62. https://doi.10.1080/08832323.2014.973825
- Suh, J. (2014). The effect of transfer credit hours on the student learning outcomes. ASBBS eJournal, 10(1), 123-130. https://asbbs.org/files/ASBBS2014/PDF/J/JingyoS(P389-395).pdf.
- Varachotisate, P., Siritaweechai, N., Kositanurit, W., Thanprasertsuk, S., Chayanupatkul, M., Thongsricome, T., Bumphenkiatikul, T., Chuleerarux, N., Watanatada, P., Werawatganon, D., Somboonwong, J., Siriviriyakul, P., Sanguanrungsirikul, S., Bogsebandhu-Phubhakdi, S., Ratanasirisawad, V., Jaroenlapnopparat, A., Burana, C., Somsirivattana, P., Kulaputana, O., & Kaikaew, K. (2023). Student academic performance in non-lecture physiology topics following the abrupt change from traditional on-site teaching to online teaching during COVID-19 pandemic. Medical Education Online (28)21, 1-9. https://doi.10.1080/10872981.2022.2149292