Designing a Usability Assessment Process for Adaptive Intelligent Tutoring Systems: A Case Study


ERÜMİT A. K., ÇETİN İ., KOKOÇ M., KÖSA T., NABİYEV V., AYGÜN E. s.

Turkish Online Journal of Qualitative Inquiry, cilt.10, sa.1, ss.141-179, 2019 (Hakemli Dergi) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 10 Sayı: 1
  • Basım Tarihi: 2019
  • Dergi Adı: Turkish Online Journal of Qualitative Inquiry
  • Derginin Tarandığı İndeksler: TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.141-179
  • Ondokuz Mayıs Üniversitesi Adresli: Evet

Özet

This study aims at examining the usability evaluation process of ArtiBos, an adaptive intelligenttutoring system specifically designed for teaching of problem solving, and proposing usabilityevaluation recommendations accordingly. The study group consists of 90 students selected from 3different secondary education institutions and 30 experts from the fields of Computer Education andInstructional Technology and Mathematics Teaching. The usability of ArtiBos is evaluated accordingto the criteria of effectiveness, efficiency, and satisfaction included in the definition of usability by theInternational Standards Organization (ISO). In this study, quantitative and qualitative data were usedfor triangulation. Study data included users’ screenshots during performance of the instructed tasks inArtiBos, sound recordings taken from the think aloud technique, interviews with students, andopinions of experts. The study elaborates the procedure of usability tests of ArtiBos and makessuggestions for usability evaluation processes of similar systems. The results are expected to guideresearchers planning to carry out similar systems’ usability studies.