Guldana A. Begimbetova, Heri Retnawat, Gulzhaina K. Kassymova, Mochamad Bruri Triyono, Mohamed Nor Azhari Azman, Reisa Aulia Sodikin
This study aimed to develop and validate a digital literacy higher-order thinking skills (HOTS) cognitive test for engineering students at Universitas Negeri Yogyakarta in Indonesia. Utilising a quantitative research design, the study involved 95 participants and employed expert judgement to assess content validity through the Aiken V Index, which yielded a high average validity score of 1.783. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) confirmed a single factor structure with strong fit indices (CFI = 0.98, TLI = 0.97, RMSEA = 0.08), indicating robust construct validity. Reliability analysis revealed a high internal consistency (α = 0.92). Item Response Theory (IRT) calibration demonstrated satisfactory model fit, with moderate discrimination and average difficulty indices for the test items. The findings affirm that the developed test is both reliable and valid, effectively capturing students' digital literacy HOTS profiles, thereby providing valuable insights for educational interventions aimed at enhancing digital literacy skills in engineering education. KEYWORDS. © 2025, OpenED Network. All rights reserved.
Graduate School, Yogyakarta State University, Yogyakarta, Indonesia; Faculty of Pedagogy and Psychology, Abai Kazakh National Pedagogical University, Almaty, Kazakhstan; Institute of Metallurgy and Ore Beneficiation JSC, Satbayev University Almaty, Kazakhstan; Department Engineering Technology, Faculty of Technical and Vocational, Sultan Idris Education University, Malaysia; Education of System and Information Technology, Indonesia University of Education, Bandung, Indonesia
