Home⇛Journal of Interdisciplinary Perspectives⇛vol. 3 no. 9 (2025)

Designing a Teacher Recommender System: A Thematic Literature Review of Teacher Evaluation Systems

Marie Grace V. Ortiz | Menchita F. Dumlao

Discipline: Education

 

Abstract:

Teacher evaluation systems are limited in their ability to provide numerical ratings, often failing to analyze qualitative feedback to provide teachers with valuable insights to enhance performance. This paper conducts a thematic literature review of teacher evaluation systems and tools in articles in Google Scholar, IEEE, and Proquest databases between 2014 and 2024 to determine the most appropriate sentiment analysis (SA) and topic modeling (TM) algorithms for analyzing student feedback. The review of 48 articles found that a lexicon-based SA approach, specifically VADER with a customized Filipino lexicon, offers a robust and practical solution for sentiment detection in a multilingual context. For TM, Latent Dirichlet Allocation (LDA) with human intervention is the recommended approach, providing a balance between thematic granularity and computational feasibility. The efficacy and efficiency of both algorithms are found to improve by increasing the size of a domain-specific corpus of words. Based on these findings, the paper proposes the design of TeachAIRs. This teacher recommender system includes word cloud visualizations, sentiment scores per topic, and, most critically, actionable insights derived from the integrated analysis. The development of this system is highly recommended to provide teachers with valuable and constructive realtime feedback, ultimately enhancing teaching practices and improving student learning outcomes.



References:

  1. Abiodun Ayeni, O., Mercy, A., et al (2020). Web-based student opinion mining system using sentiment analysis. International Journal of Information Engineering and Electronic Business, 12(5), 33–46. https://doi.org/10.5815/ijieeb.2020.05.04
  2. Adinolfi, P., D’Avanzo, E., Lytras, M. D., Novo-Corti, I., & Picatoste, J. (2016). Sentiment analysis to evaluate teaching performance. International Journal of Knowledge Society Research, 7(4), 86–107. https://doi.org/10.4018/ijksr.2016100108
  3. Ahmed, N., Khouro, M. A., Khan, A., Dawood, M., Dootio, M. A., & Jan, N. U. (2023). Student textual feedback sentiment analysis using machine learning techniques to improve the quality of education. Pakistan Journal of Engineering, Technology & Science, 11(2), 32–40. https://doi.org/10.22555/pjets.v11i2.1039
  4. Al Bashaireh, R., Sabeeh, V., & Zohdy, M. (2019). Towards a new indicator for evaluating universities based on twitter sentiment analysis. Proceedings - 6th Annual Conference on Computational Science and Computational Intelligence, CSCI 2019, 1398–1404. https://doi.org/10.1109/CSCI49370.2019.00261
  5. Ali Kandhro, I., Ameen Chhajro, M., Kumar, K., Lashari, H. N., & Khan, U. (2019). Student feedback sentiment analysis model using various machine learning schemes: A review. Indian Journal of Science and Technology, 14(12), 1–9. https://doi.org/10.17485/ijst/2019/v12i14/143243
  6. Altrabsheh, N., Cocea, M., & Fallahkhair, S. (2014). Sentiment analysis: Towards a tool for analysing real-time students feedback. Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI, 2014-December, 419–423. https://doi.org/10.1109/ICTAI.2014.70
  7. Andrewson, S., Mason, J., & Joel, R. (2023). Leveraging NLP for personalized learning: Adaptive feedback systems in higher education. https://www.researchgate.net/publication/391319413
  8. Aung, K. Z., & Myo, N. N. (2017). Sentiment analysis of students’ comment using lexicon based approach. Proceedings - 16th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2017. https://doi.org/10.1109/ICIS.2017.7959985
  9. Balahadia, F. F., Fernando, M. C. G., & Juanatas, I. C. (2016). Teacher’s performance evaluation tool using opinion mining with sentiment analysis. Proceedings - 2016 IEEE Region 10 Symposium, TENSYMP 2016, 95–98. https://doi.org/10.1109/TENCONSpring.2016.7519384
  10. Bhana, V. M. (2014). Interpersonal skills development in generation y student nurses: A literature review. In Nurse Education Today (Vol. 34, Issue 12, pp. 1430–1434). Churchill Livingstone. https://doi.org/10.1016/j.nedt.2014.05.002
  11. Bhowmik, A., Mohd Noor, N., Saef Ullah Miah, M., Mazid-Ul-Haque, M., & Karmaker, D. (2023). A comprehensive data set for aspect-based sentiment analysis in evaluating teacher performance. AIUB Journal of Science and Engineering, 22(2), 200–213. https://doi.org/10.53799/AJSE.V22I2.862
  12. Bhowmik, A., Nur, N. M., Saef, M., Miah, U., & Karmekar, D. (2023). Aspect-based sentiment analysis model for evaluating teachers’ performance from students’ feedback. AIUB Journal of Science and Engineering, 22(3), 287–294. https://doi.org/10.53799/ajse.v22i3.921
  13. Borromeo, R. M., & Toyama, M. (2015). Automatic vs. crowdsourced sentiment analysis. ACM International Conference Proceeding Series, 0(CONFCODENUMBER), 90–95. https://doi.org/10.1145/2790755.2790761
  14. Chakravarthy, V. J., Kameswari, M., Mydeen, H. D., & Seenivasan, M. (2021). Opinion mining from student text review for choosing better online courses. IOP Conference Series: Materials Science and Engineering, 1070(1), 012067. https://doi.org/10.1088/1757-899x/1070/1/012067
  15. Clarizia, F., Colace, F., De Santo, M., Lombardi, M., Pascale, F., & Pietrosanto, A. (2018). E-learning and sentiment analysis: A case study. ACM International Conference Proceeding Series, 111–118. https://doi.org/10.1145/3178158.3178181
  16. Creswell, J. W., & David Creswell, J. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publications, Inc. https://tinyurl.com/mryt9hvm
  17. Dake, D. K., & Gyimah, E. (2023). Using sentiment analysis to evaluate qualitative students’ responses. Education and Information Technologies, 28(4), 4629–4647. https://doi.org/10.1007/s10639-022-11349-1
  18. Das, S., Roy, S., Bose, R., Acharjya, P. P., & Mondal, H. (2022). Analysis of student sentiment dynamics to evaluate teachers performance in online course using machine learning. 2022 International Conference on Applied Artificial Intelligence and Computing (ICAAIC), 668–673. https://doi.org/10.1109/ICAAIC53929.2022.9792958
  19. Edalati, M., Imran, A. S., Kastrati, Z., & Daudpota, S. M. (2022). The potential of machine learning algorithms for sentiment classification of students’ feedback on MOOCs. Lecture Notes in Networks and Systems, 296, 11–22. https://doi.org/10.1007/978-3-030-82199-9_2
  20. Faizi, R. (2023). Using sentiment analysis to explore student feedback: A lexical approach. International Journal of Emerging Technologies in Learning, 18(9), 259–267. https://doi.org/10.3991/ijet.v18i09.38101
  21. Fargues, M., Kadry, S., Lawal, I. A., Yassine, S., & Rauf, H. T. (2023). Automated analysis of open-ended students’ feedback using sentiment, emotion, and cognition classifications. Applied Sciences (Switzerland), 13(4). https://doi.org/10.3390/app13042061
  22. Fernández, M. P., & Martínez, J. F. (2022). Evaluating teacher performance and teaching effectiveness: Conceptual and methodological considerations. https://doi.org/10.1007/978-3-031-13639-9_3
  23. Gencoglu, B., Helms-Lorenz, M., Maulana, R., Jansen, E. P. W. A., & Gencoglu, O. (2023). Machine and expert judgments of student perceptions of teaching behavior in secondary education: Added value of topic modeling with big data. Computers and Education, 193. https://doi.org/10.1016/j.compedu.2022.104682
  24. Gottipati, S., Shankararaman, V., & Lin, J. R. (2018). Latent dirichlet allocation for textual student feedback analysis. ICCE 2018 - 26th International Conference on Computers in Education, Main Conference Proceedings, 220–227. https://ink.library.smu.edu.sg/sis_research/4215
  25. Gunasekaran, K. P. (2023). Exploring sentiment analysis techniques in natural language processing: A comprehensive review. https://doi.org/10.48550/arXiv.2305.14842
  26. Hariyani, C. A., Hidayanto, A. N., Fitriah, N., Abidin, Z., & Wati, T. (2019). Mining student feedback to improve the quality of higher education through multi-label classification, sentiment analysis, and trend topic. 2019 4th International Conference on Information Technology, Information Systems and Electrical Engineering, ICITISEE 2019. https://doi.org/10.1109/ICITISEE48480.2019.9003818
  27. Hashim, S., Omar, M. K., Jalil, H. A., & Sharef, N. M. (2022). Trends on technologies and artificial intelligence in education for personalized learning: Systematic literature review. International Journal of Academic Research in Progressive Education and Development, 11(1). https://doi.org/10.6007/IJARPED/v11-i1/12230
  28. Hayat, F., Shatnawi, S., & Haig, E. (2024). Comparative analysis of topic modelling approaches on student feedback. International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IC3K - Proceedings, 1, 226–233. https://doi.org/10.5220/0012890400003838
  29. Hixson, T. (2019). Reactions vs. reality: Using sentiment analysis to measure university students’ responses to learning ArcGIS. Journal of Map and Geography Libraries, 15(2–3), 263–276. https://doi.org/10.1080/15420353.2020.1719266
  30. Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilizing written student feedback: A streamlined process. Computers & Education, 157, 103965. https://doi.org/10.1016/J.COMPEDU.2020.103965
  31. Ishmael, O., Kiely, E., Quigley, C., & McGinty, D. (2023). Topic modelling using latent dirichlet allocation (LDA) and analysis of students sentiments. 2023 20th International Joint Conference on Computer Science and Software Engineering (JCSSE), 1–6. https://doi.org/10.1109/JCSSE58229.2023.10201965
  32. Kandhro, I. A., Wagan, A. A., Kumar, K., & Shaikh, Z. U. (2023). An efficient LSTM based cross domain aspect based sentiment analysis (CD-ABSA). Mehran University Research Journal of Engineering and Technology, 42(3), 89. https://doi.org/10.22581/muet1982.2303.10
  33. Kandhro, I. A., Wasi, S., Kumar, K., Rind, M., & Ameen, M. (2019). Sentiment analysis of students comment by using long-short term model. Indian Journal of Science and Technology, 12(8), 1–16. https://doi.org/10.17485/ijst/2019/v12i8/141741
  34. Karunya, K., Aarthy, S., Karthika, R., & Jegatha Deborah, L. (2020). Analysis of student feedback and recommendation to tutors. Proceedings of the 2020 IEEE International Conference on Communication and Signal Processing, ICCSP 2020. https://doi.org/10.1109/ICCSP48568.2020.9182270
  35. Kaur, W., Balakrishnan, V., & Singh, B. (2020). Improving teaching and learning experience in engineering education using sentiment analysis techniques. IOP Conference Series: Materials Science and Engineering, 834(1). https://doi.org/10.1088/1757-899X/834/1/012026
  36. Kim, C. M., & Kwak, E. C. (2022). An exploration of a reflective evaluation tool for the teaching competency of pre-service physical education teachers in Korea. Sustainability (Switzerland), 14(13). https://doi.org/10.3390/su14138195
  37. Kim, H., & Qin, G. (2023). Summarizing students’ free responses for an introductory algebra-based physics course survey using cluster and sentiment analysis. IEEE Access, 11, 89052–89066. https://doi.org/10.1109/ACCESS.2023.3305260
  38. Koufakou, A. (2024). Deep learning for opinion mining and topic classification of course reviews. Education and Information Technologies, 29(3), 2973–2997. https://doi.org/10.1007/s10639-023-117362
  39. Kumar, A., & Jain, R. (2016). Sentiment analysis and feedback evaluation. Proceedings of the 2015 IEEE 3rd International Conference on MOOCs, Innovation and Technology in Education, MITE 2015. https://doi.org/10.1109/MITE.2015.7375359
  40. Lalata, J. A. P., Gerardo, B., & Medina, R. (2019). A sentiment analysis model for faculty comment evaluation using ensemble machine learning algorithms. ACM International Conference Proceeding Series, 68–73. https://doi.org/10.1145/3341620.3341638
  41. Latika Tamrakar, M., Shrivastava, P., & Ghosh, S. M. (2021). An analytical study of feature extraction techniques for student sentiment analysis. In Turkish Journal of Computer and Mathematics Education (Vol. 12, Issue 11). https://doi.org/10.1007/978-3-030-80216-5_20
  42. Lin, F., Li, C., Lim, R. W. Y., & Lee, Y. H. (2025). Empower instructors with actionable insights: Mine and visualize student written feedback for instructors’ reflection. Computers and Education: Artificial Intelligence, 8. https://doi.org/10.1016/j.caeai.2025.100389
  43. Lin, F., Li, C., Wei, R., Lim, Y., Yew, & Lee, H. (2024). Developing a feedback analytic tool to support instructor reflection. https://doi.org/10.58459/icce.2024.4859
  44. Looney, J. (2011). Developing high-quality teachers: Teacher evaluation for improvemente jed_1492 440..455. http://dx.doi.org/10.2307/41343393
  45. Malebary, S. J., & Abulfaraj, A. W. (2024). A stacking ensemble based on lexicon and machine learning methods for the sentiment analysis of tweets. Mathematics, 12(21). https://doi.org/10.3390/math12213405
  46. Mamidted, A. D., & Maulana, S. S. (2023). The teaching performance of the teachers in online classes: A sentiment analysis of the students in a state university in the Philippines. Randwick International of Education and Linguistics Science Journal, 4(1), 86–95. https://doi.org/10.47175/rielsj.v4i1.639
  47. Melba Rosalind, J., & Suguna, S. (2022). Predicting students’ satisfaction towards online courses using aspect-based sentiment analysis. 20–35. https://doi.org/10.1007/978-3-031-11633-9_3ï
  48. Nandakumar, R., Pallavi, M. S., Pramath, P. H., & Hegde, V. (2022). Sentimental analysis on student feedback using NLP & POS tagging. International Conference on Edge Computing and Applications, ICECAA 2022 - Proceedings, 309–313. https://doi.org/10.1109/ICECAA55415.2022.9936569
  49. Nasim, Z., Rajput, Q., & Haider, S. (2017). Sentiment analysis of student feedback using machine learning and lexicon based approaches. International Conference on Research and Innovation in Information Systems, ICRIIS. https://doi.org/10.1109/ICRIIS.2017.8002475
  50. Nawaz, R., Sun, Q., Shardlow, M., Kontonatsios, G., Aljohani, N. R., Visvizi, A., & Hassan, S. U. (2022). Leveraging AI and machine learning for national student survey: Actionable insights from textual feedback to enhance quality of teaching and learning in UK’s higher education. Applied Sciences (Switzerland), 12(1). https://doi.org/10.3390/app12010514
  51. Neumann, M., & Linzmayer, R. (2021). Capturing student feedback and emotions in large computing courses: A sentiment analysis approach. SIGCSE 2021 - Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, 541–547. https://doi.org/10.1145/3408877.3432403
  52. Omran, T., Sharef, B. T., Hadjar, K., & Subramanian, S. (2020). Machine learning for improving teaching methods through sentiment analysis. Applied Mathematics and Information Sciences, 14(2), 309–317. https://doi.org/10.18576/amis/140215
  53. Onan, A. (2020). Mining opinions from instructor evaluation reviews: A deep learning approach. Computer Applications in Engineering Education, 28(1), 117–138. https://doi.org/10.1002/cae.22179
  54. Moreno-Marcos, P. M., Alario-Hoyos, C., Muñoz-Merino,P. J., Estévez-Ayres, I.,  & Kloos, C. D.  (2018). Sentiment analysis in MOOCs: A case study. 2018 IEEE Global Engineering Education Conference (EDUCON), 1489–1496. https://doi.org/doi:10.1109/EDUCON.2018.8363409.
  55. Papay, J. P. (2012). Refocusing the debate: Assessing the purposes and tools of teacher evaluation. In Harvard Educational Review (Vol. 82, Issue 1). https://doi.org/10.17763/haer.82.1.v40p0833345w6384
  56. Peña-Torres, J. A. (2024). Towards an improved of teaching practice using sentiment analysis in student evaluation. Ingeniería y Competitividad, 26(2). https://doi.org/10.25100/iyc.v26i2.13759
  57. Pramod, D., Vijayakumar Bharathi, S., & Raman, R. (2022). Faculty effectiveness prediction using machine learning and text analytics. 2022 IEEE Technology and Engineering Management Conference (TEMSCON EUROPE), 40–47. https://doi.org/10.1109/TEMSCONEUROPE54743.2022.9801997
  58. Praveenkumar, T., Manorselvi, A., & Soundarapandiyan, K. (2020). Exploring the students feelings and emotion towards online teaching: Sentimental analysis approach. 137–146. https://doi.org/10.1007/978-3
  59. Pyasi, S., Gottipati, S., & Shankararaman, V. (2018). SUFAT - An analytics tool for gaining insights from student feedback comments. 1–9. https://doi.org/10.1109/FIE.2018.8658457
  60. Pyasi, S., Gottipati, S., & Shankararaman, V. (2019). SUFAT - An analytics tool for gaining insights from student feedback comments. Proceedings - Frontiers in Education Conference, FIE, 2018-October. https://doi.org/10.1109/FIE.2018.8658457
  61. Qu, W., & Zhang, Z. (2020). An application of aspect-based sentiment analysis on teaching evaluation. 89–104. https://doi.org/10.35566/isdsa2019c6
  62. Rafiq, S., Afzal, A., & Kamran, F. (2022). Exploring the problems in teacher evaluation process and its perceived impact on teacher performance. Gomal University Journal of Research, 38(04), 482–500. https://doi.org/10.51380/gujr-38-04-08
  63. Rajput, Q., Haider, S., & Ghani, S. (2016). Lexicon-based sentiment analysis of teachers’ evaluation. Applied Computational Intelligence and Soft Computing, 2016, 1–12. https://doi.org/10.1155/2016/2385429
  64. Rakhmanov, O. (2020). A comparative study on vectorization and classification techniques in sentiment analysis to classify student-lecturer comments. Procedia Computer Science, 178, 194–204. https://doi.org/10.1016/j.procs.2020.11.021
  65. Ren, P., Yang, L., & Luo, F. (2023). Automatic scoring of student feedback for teaching evaluation based on aspect-level sentiment analysis. Education and Information Technologies, 28(1). https://doi.org/10.1007/s10639-022-11151-z
  66. Katragadda, S., Ravi, V., Kumar, P.,  & Lakshmi, G. J. (2020). Performance analysis on student feedback using machine learning algorithms. 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), 1161–1163. https://doi.org/doi:10.1109/ICACCS48705.2020.9074334
  67. Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/doi.org/10.1186/s41239-021-00292-9
  68. Sindhu, I., Muhammad Daudpota, S., Badar, K., Bakhtyar, M., Baber, J., & Nurunnabi, M. (2019). Aspect-based opinion mining on student’s feedback for faculty teaching performance evaluation. IEEE Access, 7, 108729–108741. https://doi.org/10.1109/ACCESS.2019.2928872
  69. Sivakumar, M., & Reddy, U. S. (2018). Aspect based sentiment analysis of students opinion using machine learning techniques. Proceedings of the International Conference on Inventive Computing and Informatics, ICICI 2017, 726–731. https://doi.org/10.1109/ICICI.2017.8365231
  70. Sun, J., & Yan, L. (2023). Using topic modeling to understand comments in student evaluations of teaching. Discover Education, 2(1). https://doi.org/10.1007/s44217-023-00051-0
  71. Sunar, A. S., & Khalid, M. S. (2024). Natural language processing of student’s feedback to instructors: A systematic review. IEEE Transactions on Learning Technologies, 17, 741–753. https://doi.org/10.1109/TLT.2023.3330531
  72. Sutoyo, E., Almaarif, A., & Yanto, I. T. R. (2021). Sentiment analysis of student evaluations of teaching using deep learning approach. Lecture Notes in Networks and Systems, 254, 272–281. https://doi.org/10.1007/978-3-030-80216-5_20
  73. Tian, X., Tang, S., Zhu, H., & Xia, D. (2022). Real‐time sentiment analysis of students based on mini‐xception architecture for wisdom classroom. Concurrency and Computation: Practice and Experience, 34(21). https://doi.org/https://doi.org/10.1002/cpe.7059
  74. Tzacheva, A., & Easwaran, A. (2021). Emotion detection and opinion mining from student comments for teaching innovation assessment. International Journal of Education (IJE), 09(02), 21–32. https://doi.org/10.5121/IJE2021.9203
  75. Unankard, S., & Nadee, W. (2020). Topic detection for online course feedback using LDA. Emerging Technologies for Education. SETE 2019. Lecture Notes in Computer Science, 11984, 133–144. https://doi.org/10.1007/978-3-030-38778-5_16
  76. Wang, J. (2025). The impact of AI teaching on teaching quality. International Journal of Web-Based Learning and Teaching Technologies, 20(1), 1–22. https://doi.org/10.4018/IJWLTT.376489
  77. Wook, M., Razali, N. A. M., Ramli, S., Wahab, N. A., Hasbullah, N. A., Zainudin, N. M., & Talib, M. L. (2020). Opinion mining technique for developing student feedback analysis system using lexicon-based approach (OMFeedback). Education and Information Technologies, 25(4), 2549–2560. https://doi.org/10.1007/s10639-019-10073-7
  78. Zayed Alatwah, S. (2022). Using sentiment analysis to evaluate first-year engineering students teamwork textual feedback. 2022 ASEE Annual Conference & Exposition. https://doi.org/10.18260/1-2--41460
  79. Zeng, J., Luo, K., Lu, Y., & Wang, M. (2023). An evaluation framework for online courses based on sentiment analysis using machine learning. International Journal of Emerging Technologies in Learning, 18(18), 4–22. https://doi.org/10.3991/ijet.v18i18.42521

Tools


Copyright © 2026  KITE Digital Educational Solutions |  Exclusively distributed by CE-Logic