Enhancing Usability and Learner Engagement: A Heuristic Evaluation of the AI-Enhanced Video Drama Maker App

Closed

Yi-Fan Liu, Muhammad Irfan Luthfi, Wu-Yuin Hwang

2024 Proceedings - 21st International Joint Conference on Computer Science and Software Engineering, JCSSE 2024 Conference paper Cited by 2 Quartile

Abstract

This study introduces the 'AI-Enhanced Video Drama Maker' app. This innovative language learning tool integrates drama activities with Artificial Intelligence (AI) technologies, catering specifically to learners of English as a Foreign Language (EFL). Aimed at enhancing writing and speaking skills, the app utilizes drama-making for creative expression and real-world communication. This method is aligned with educational theories that emphasize the importance of authentic, contextualized learning experiences. The AI components, such as video-to-text recognition, Generative Pretrained Transformer (GPT)-generated sentences, and Text-to-Speech (TTS) features, are integrated to support and personalize the learning process. The study focuses on Heuristic Evaluation based on Nielsen's principles and gathering expert suggestions for enhancing the app's usability and user experience. Ten UI/UX design experts from two Taiwanese universities participated, providing valuable insights. Data collection was divided into three phases: system introduction, operation, and HCI design analysis. A questionnaire based on Nielsen's ten principles of Heuristic Evaluation was the main data collection tool, supported by SPSS for reliability and descriptive statistics analysis. The findings, underscored by a high Cronbach Alpha score, indicate the app's strong foundation in usability, especially in aesthetics and user support. Recommendations for improvement include enhancing user control, error prevention, and content diversity. The study concludes with the expectation that the app, after incorporating expert feedback, will effectively enhance EFL learners' writing and speaking skills. © 2024 IEEE.

Affiliations

National Academy for Educational Research, New Taipei, Taiwan; Graduate Institute of Network Learning Technology, National Central University, Taiwan; Universitas Negeri Yogyakarta, Dept. Electronics and Informatics Engineering Education, Indonesia; College of Science and Engineering, National Dong Hwa University, Taiwan