Rezkilaturahmi, Heri Retnawati, Nur Hidayanto Pancoro Setyo Putro, La Ode Ilan, Ilyas, Taufik Rizki Sista
Assessment plays a strategic role in ensuring that English learning for vocational tourism students aligns with industry and cultural demands. However, limited research has examined the psychometric quality of tourism English assessments integrated with cultural insight. This study aims to analyze the psychometric properties of a Tourism English Test based on the Cultural Insight in English (CIE) framework using a Classical Test Theory (CTT) approach. The study employed a quantitative evaluative design involving 90 vocational high school students majoring in tourism in Indonesia. Content validity was examined using Aiken's V through seven expert judgments, followed by construct validation using Confirmatory Factor Analysis (CFA). Item characteristics were further analyzed using CTT parameters, including item difficulty, discrimination index, and reliability estimation. The results indicated that 22 items met acceptable content validity criteria after expert review. CFA supported a dominant unidimensional structure with Reading and Grammar as core components of CIE ability. CTT analysis revealed that most items demonstrated moderate difficulty levels and good discrimination indices, although several items required revision due to low or negative discrimination values. The instrument showed good internal consistency reliability (Cronbach's Alpha = 0.797). Overall, the findings confirm that the Tourism English Test based on the CIE framework possesses adequate validity and reliability and is suitable for measuring culturally embedded English proficiency among vocational tourism students. The study contributes to strengthening assessment practices in vocational English education by integrating cultural insight into psychometrically sound measurement models. © 2026, University of Hawaii Press. All rights reserved.
Universitas Negeri Yogyakarta, Yogyakarta, Indonesia; Universitas Darussalam Gontor, Ponorogo, Indonesia
