Perceived Usability Evaluation Of MOLS (Mulawarman Online Learning System) During COVID-19 Pandemic Using System Usability Scale (SUS), Performance Measurement, and Thinking Aloud Methods

Abstract

Due to COVID-19 pandemic, the teaching-learning process is evolving rapidly from a traditional classroom environment to online learning only. To cope with this situation, Mulawarman Learning Online System (MOLS) is implemented to allow students to interact with learning tools via web browsers. This paper aims to evaluate the student‘s perceived usability of MOLS based on effectiveness, efficiency, and user satisfaction. Moreover, this paper attempts to improve the usability and user satisfaction of MOLS through modifying the user interface from the gathered information of ergonomics concept. For this purpose, three methods are applied, i.e., using SUS (System Usability Scale) to measure student‘s satisfaction, Performance Measurement to evaluate effectiveness and efficiency and Thinking Aloud to gather data about what users really think about MOLS design which usually turn into redesign recommendations. A number of 96 students of Engineering Faculty participated in SUS Questionnaire and 10 students were involved in Performance Measurement and Thinking Aloud process. Result showed that SUS score was 61.64 which is below marginal score 68. The effectiveness was 99% and efficiency was 0.0035 task/second. Thus, improvement needs to be developed to make MOLS more usable in order to increase student‘s satisfaction.