The incompatibility of Item Response Theory with public selection procedure

a case study of the National High School Exam

Abstract

[Purpose] The aim of this article is to evaluate the compatibility of Item Response Theory – IRT with the current normative framework and case law applicable to public selection processes, such as the Unified National Public Selection – CPNU and the National High School Exam – Enem.

[Methodology/approach/design] A bibliographical review was conducted on specialized literature related to assessment methods, for the identification and interpretation of the premises and inherent characteristics of Classical Test Theory – CTT and IRT. Additionally, the normative guidelines applicable to public selection processes were identified and interpreted, given that the Sisu, at the federal level, and the various selection processes conducted by federal, state, and municipal public institutions of higher education are not primarily aimed at evaluating education but at selecting candidates for the available positions within the framework of public education policies. Research on consolidated jurisprudence was also carried out, especially in the context of the Federal Supreme Court – STF, the National High Court of Brazil – STJ, and the Federal Regional Court of the 1st Region – TRF1.

[Findings] There is an absolute incompatibility between IRT and public selection procedure such as CPNU and Enem. Its use violates applicable regulations and fails to comply with consolidated case law. It was concluded that the decision to provide supplementary positions for candidates subjected to the extra application of exams under CPNU was correct.