HomeJournal of Interdisciplinary Perspectivesvol. 2 no. 9 (2024)

Sentiment Analysis of Student Evaluation for Teachers Using Valence-Aware Dictionary and Sentiment Reasoner

Kristel Anne B. Telmo | Kervie V. Alviola | Jazler Jhon S. Desamparado | John Nathaniel A. Cabigan | Cereneo S. Santiago Jr. | Richard Aries A. Shimada

Discipline: Education

 

Abstract:

This paper analyzed the quality of teaching using the Student Evaluation of Teaching (SET). The Valence Aware Dictionary and Sentiment Reasoner (VADER) was utilized to assess textual comments, providing a comprehensive view of teaching effectiveness beyond numerical ratings. The objectives were to identify faculty strengths and areas for improvement based on student feedback, analyze sentiment toward teaching methods, and determine the optimal number of clusters within the dataset. The analysis included 28,222 student comments from three semesters, preprocessed through tokenization, stopword removal, partof-speech tagging, and lemmatization. A word cloud visualized common terms, while K-means clustering and the Elbow method identified five as the optimal number of clusters. Results indicate that most comments are positive, emphasizing effective teaching methods' role in creating a positive educational experience. The findings suggest integrating machine learning with VADER and expanding the dataset for broader insights. Institutions should develop effective teaching strategies, prioritizing regular feedback collection and analysis.



References:

  1. Brush, K. (2023). Data Visualization. Retrieved from https://www.techtarget.com/searchbusinessanalytics/definition/data-visualization
  2. Cheng, L., Li, Y., Su, Y., & Gao, L. (2022). Effect of regulation scripts for dialogic peer assessment on feedback quality, critical thinking and climate of trust. Assessment & Evaluation in Higher Education, 48(4), 451–463. https://doi.org/10.1080/02602938.2022.2092068
  3. Kaliris, A., Mastrokoukou, S., Donche, V., & Chauliac, M. (2022). Rediscovering teaching in university: A scoping review of teacher effectiveness in higher education. Frontiers, 7, 861458. https://doi.org/10.3389/feduc.2022.861458
  4. Kastrati, Z., Dalipi, F., Imran, A., Nuci, K., & Wani, M. (2021). Sentiment Analysis of Students’ Feedback with NLP and Deep Learning: A Systematic Mapping Study. Applied Sciences, 11(9), 3986. https://doi.org/10.3390/app11093986
  5. Hegab, H., Salem, A., & Taha, H. A. (2022). A decision-making approach for sustainable machining processes using data clustering and multi-objective optimization. Sustainability, 14(24), 1688. https://doi.org/10.3390/su142416886
  6. Herold, F. (2019). Shulman, or Shulman and Shulman? How communities and contexts affect the development of pre-service teachers’ subject knowledge. Teacher Development, 23(4), 488–505. https://doi.org/10.1080/13664530.2019.1637773
  7. Li, M., Ma, S., & Shi, Y. (2023). Examining the effectiveness of gamification as a tool promoting teaching and learning in educational settings: a meta-analysis. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1253549
  8. Li, X., Huang, W., & Shang, J. (2023). Gamified Project-Based Learning: A Systematic Review of the Research Landscape. MDPI Sustainability, 15(2), 940. https://doi.org/10.3390/su15020940
  9. Liu, R. (2022b). Data analysis of educational evaluation using K-Means clustering method. Computational Intelligence and Neuroscience, 1-10. https://doi.org/10.1155/2022/3762431
  10. Mamoon-Al-Bashir, M., Kabir, M. R., & Rahman, I. (2016). The value and effectiveness of feedback in improving students’ learning and professionalizing teaching in higher education. Journal of Education and Practice, 7(16), 38–41. http://files.eric.ed.gov/fulltext/EJ1105282.pdf
  11. Newman, H., & Joyner, D. (2018). Sentiment analysis of student evaluations of teaching. In C. Penstein Rosé et al. (Eds.), Artificial Intelligence in Education. Springer
  12. Wieman, C. E. (2019). Expertise in university teaching & the implications for teaching effectiveness, evaluation & training. Daedalus, the Journal of the American Academy of Arts & Sciences, 148(4), 47–78. https://doi.org/10.1162/daed_a_01760.
  13. Yuan, C., & Yang, H. (2019). Research on K-Value selection method of k-means clustering algorithm. Journal of Multidictionary Scientific Journal, 2(2), 226-235. https://doi.org/10.3390/j2020016