Desy Purwasih, Insih Wilujeng, Misbah, Rizki Zakwandi, Anggi Datiatur Rahmat
An important process in developing learning instruction is content validation by expert judgment. However, these data were not explored comprehensively to prove the feasibility of content and constructs. This study explores the method of a comprehensive analysis of learning instruction validation using multi-rater analysis. The data in this study were collected from five experts (four lecturers and one practitioner). The experts evaluate learning instruction based on instrument sheets. Then, the RASCH model was used to estimate the quality of the instruments sheet, the expert, and the learning instruction. The results showed that using multi-rater analysis showed that the instrument items had an MNSQ score of 1.00 in the range of 0.77 to 1.33, which means the items can estimate content validity well with a reliability of 0.91, which proves the instrument's reliability. The split score of 3.27 proves that experts have different assessments for learning instruction according to background and experience. Overall, the evaluation of learning instruction is feasible to use in learning. Researchers must adjust the multi-rater analysis to comprehensively explain the quality of instructional learning. © 2024 AIP Publishing LLC.
Science Education Department of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia; Science Education Graduate School, Universitas Pendidikan Indonesia, Bandung, Indonesia; Physics Education Department of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia; Doctoral Program of Science Education, Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia
