Large scale assessment in reading: considerations on construct and testing method in SAEB and PISA

Authors

  • Adriana de Oliveira Barbosa Universidade Estadual de Campinas

DOI:

https://doi.org/10.26512/rhla.v19i1.25156

Keywords:

Reading, Large scale assessment, SAEB, PISA, construct analysis, test methods

Abstract

The present work investigates the reading construct of two large scale external assessments present in the Brazilian educational context The Brazilian System of Assessment for Basic Education (SAEB) and the Programme for International Student Assessment (PISA), focusing on its testing methods (or tests formats). The objective is to contribute to a better understanding of reading in the assessment context, considering that both assessments have the potential to influence not only the political decisions but also the pedagogical practices. The theoretic basis comes from Applied Linguistics, in the ”‹”‹Language Assessment field. It has qualitative approach and based on the document analysis method. The differences in the constructs of the two assessment were emphasized, which are reinforced by the test formats: restricted to multiple choice items in SAEB and varied in PISA.  In this sense, it should be noted that the international assessment presents greater proximity to reading situations and demands that are more consistent with real practices, which is not the case in the national assessment

Downloads

Download data is not yet available.

References

ALDERSON, J. C. Assessing reading. Cambridge: Cambridge University Press, 2000.

BONAMINO, A.; COSCARELLI, C.; FRANCO, C. Avaliação e letramento: concepções de aluno letrado subjacentes ao SAEB e ao PISA. Educação e Sociedade, Campinas, v. 23, n. 81, p. 91-113, 2002.

BRASIL. Instituto Nacional de Estudos e Pesquisas Educacionais. Relatório Brasil no PISA 2018. Versão Preliminar. Brasília, 2019

BRASIL. Relatório SAEB (ANEB e ANRESC) 2005-2015: panorama da década. Brasília, 2018.

BRASIL. Matriz de avaliação de leitura PISA 2012. Disponível em: <http://download.inep.gov.br/acoes_internacionais/pisa/marcos_referenciais/2013/matriz_avaliacao_leitura.pdf>. Acesso em: 25 maio. 2019.

BRASIL. SAEB 2001: novas perspectivas. Brasília: INEP, 2001.

DOUGLAS, D. Understanding language testing. London; New York, Routledge, 2010.

GRABE, W. Reading in a second language: moving from theory to practice. Cambridge: Cambridge University Press, 2009.

GRABE, W.; JIANG, X. Assessing reading. KUNNAN, A. J. (Ed.) The companion to language assessment. John Wiley & Sons, 2014.

HALADYNA, THOMAS M.; RODRIGUEZ, MICHAEL. C. Developing and validanting test items. New York; London: Routledge, 2013.

KLEIN, R. Utilização da Teoria de Resposta ao Item no Sistema Nacional de Avaliação da Educação Básica (SAEB). In: BROOKE, N.; ALVES, M. T. G.; OLIVEIRA, L. K. M. (Orgs.) A avaliação da Educação Básica: a experiência brasileira. Belo Horizonte: Fino Traço, 2015. p. 189-192.

MCNAMARA, T. Language testing. Oxford: Oxford University Press, 2000.

OCDE. Brasil no PISA 2015: análises e reflexões sobre o desempenho dos estudantes brasileiros. São Paulo: Santilhana, 2016.

OCDE. PISA 2012 Assessment and analytical framework: mathematics, reading, science, problem solving and financial literacy. OECD Publishing, 2013. Disponível em: <http://dx.doi.org/10.1787/9789264190511-en>. Acesso em: 14 jul. 2017.

RUPP, A. A., FERNE, T.; CHOI, H. How assessing reading comprehension with multiple-choice questions shapes the construct: a cognitive processing perspective. Language Testing, v. 23, n. 4, p. 441-74, 2006.

SCARAMUCCI, M. V. R. Validade e consequências sociais das avaliações em contextos de ensino de línguas. Lingvarvm Arena, v. 2, p. 103-120 2011.

SCARAMUCCI, M. V. R. Proficiência em LE: considerações terminológicas e conceituais. Trabalhos em Linguística Aplicada, v. 36, p. 11-22, jul./dez. 2000.

SCARAMUCCI, M. V. R. Avaliação de rendimento no ensino de português língua estrangeira. In: ALMEIDA FILHO, J. C. (Org.). Parâmetros atuais para o ensino de português língua estrangeira. Campinas, SP: Pontes, 1997. p.75-88.

Published

2020-05-26

How to Cite

Barbosa, A. de O. (2020). Large scale assessment in reading: considerations on construct and testing method in SAEB and PISA. Revista Horizontes De Linguistica Aplicada, 19(1), 103–123. https://doi.org/10.26512/rhla.v19i1.25156

Issue

Section

Artigos