Development of a testlet generator in re-engineering the Indonesian physics national-exams

Open

Budi Naini Mindyarto, Djemari Mardapi, Bastari

2017 AIP Conference Proceedings Vol. 1868 Conference paper Cited by 2

Abstract

The Indonesian Physics national-exams are end-of-course summative assessments that could be utilized to support the assessment for learning in physics educations. This paper discusses the development and evaluation of a testlet generator based on a re-engineering of Indonesian physics national exams. The exam problems were dissected and decomposed into testlets revealing the deeper understanding of the underlying physical concepts by inserting a qualitative question and its scientific reasoning question. A template-based generator was built to facilitate teachers in generating testlet variants that would be more conform to students' scientific attitude development than their original simple multiple-choice formats. The testlet generator was built using open source software technologies and was evaluated focusing on the black-box testing by exploring the generator's execution, inputs and outputs. The results showed the correctly-performed functionalities of the developed testlet generator in validating inputs, generating testlet variants, and accommodating polytomous item characteristics. © 2017 Author(s).

Affiliations

Semarang State University, Physics Education Department, FMIPA, Box 50229, Semarang, Indonesia; Yogyakarta State University, Box 55281, Yogyakarta, Indonesia