Evaluations, tests, and examinations are terms used to assess the knowledge or skills learned or acquired by students. Teachers must implement these tests in the most effective way. Two ways of administering the same test were investigated to gauge whether or not scores are affected by the kind of test taken. A paper pencil test and web-based test were created for the midterm examination of BS Information Technology Fourth Year students. Both examinations have the same content and each has its own policies and procedures. Furthermore, qualitative and quantitative research design was used in this study. A survey was also conducted to determine the perceptions of the respondents about the two tests and the factors that affect their scores. It was found that there was a statistically significant difference between paper pencil test and web-based test; however, there were factors that affected the scores of the respondents and these factors were very vital. The result of this research provides an additional knowledge to future researchers who will study similar topics.