Document Type : Research Article
Author
Department of English, Tarbiat Modares University, Tehran, Iran
Abstract
Introduction
In the current era of policies and practices of testing-based accountability, high- stakes tests such as university entrance exams are widely perceived to have immense importance for the people and institutions involved because they induce a rather equal curriculum through a renewed focus on what is measured. In fact, high-stakes tests have the potential to shape curricular teaching and learning. Such a consequential alignment of teaching and learning with testing, i.e., ‘test wash back’ has recently encouraged policymakers to manage for a reform in situations where high-stakes tests can be deliberately employed to promote standards of teaching, accountability and powerful learning. Macro policies as such have formed the key concerns of many reformers around the globe, including Iran. A scrutiny of the ways these policies are conceptualized at their planning phase, and the possible dilemmas and challenges anticipated for their implementation have been the subject of very scarce studies, however. The present study aimed to unveil macro-policies, plans, values, and conceptualizations underlying different perspectives of a community of policymakers and planners planning for gradual substitutions of the University Entrance Examinations (UEEs) with the High school National Achievement Examinations (HNAEs) and students’ academic background, in a test change context in Iran.
2. Methodology
The present study, based on in-depth interviews with 14 high-rank policymakers and proponents of the UEEs reform, detailed their conceptualization of this change in terms of the underlying policies, prospects, and perspectives. The participants enjoyed different levels of experience in education (management, evaluation, and teaching) and age range of 40 to 55. An interview guide was developed for the qualitative nature of the required data. Strauss and Corbin’s (1990) ‘Paradigm Model’ of qualitative data analysis was used as a tool for identifying thematic categories and subcategories. This particular model is a data-driven conceptual model that works based on a series of causal/consequential relationships among the categories or themes.
3. Discussion
The initial database yielded a template which revealed participants’ understanding of the given situation, the logic underpinning their planning, their examinations of the problems, and the prospects about the programme’s future. Three major themes finally emerged: (1) the induction of the intended consequences; (2) the value of the multiple-approach assessment of learners’ knowledge and abilities; and (3) the significance of the prerequisites and challenges for implementation: current and future trends. (1)According to all respondents, what formed the main rationale behind the UEEs reform was to counterbalance the negative impacts of the objective UEEs and trigger intended positive effects on curriculum, instruction, and learning via the HNAEs. They felt that such potentials can be actualized through opting for ‘systemic validity’ which is defined by Fredriksen and Collins (1989) as a process that sparks off constructive positive influences on teaching and learning. Most of the inter viewees ,in general, believed improving both quality and quantity of teaching and learning can be fostered through changing the UEEs-based programme to the one which values schooling instructions and aligns the assessment modes/means with constructivism concepts in education. The conceptual picture of ‘Consequences’ does not limit only to the systemic validity but it embraces test-related factors like fairness or psychometric characteristics too. The governmental policies based on which the HNAEs were and are built come from the fairness and social equity premises. In relation to measuring real abilities through fair measures, the respondents questioned psychometric traditions for decision-making about the candidates’ abilities. They all converged in their beliefs that the UEEs with their sizable proportion of the memorization-based items are not perceived as fair measures for selecting the students. (2) All emerging themes and subthemes revealed a progress moving away from a ‘measurement culture’ that limits students’ performance to tightly specific skills captured under specific times towards ‘edumetrics culture’ (Segers & Dochy, 2001).The themes ‘integrating qualitative measurement modes like the interviews or oral communications for specific majors (e.g., English Language majors or arts)’, ‘keeping an on-going record of students’ performances from the beginning of their high school towards their graduation’, ‘exploiting regular formative assessments rather than conventional summative ones per se’, ‘integrating IT in assessing students’ learning’, and ‘designing and administering standard tests of Educational Progress (like SAT for instance) several times rather than once a year’ support this assertion. (3) Informants’ descriptions raised their shared concerns about the provision of the logistics ranging from allocation of financial, material, and human resources to timely collaboration and communication between the two ministries of Education and Science, Research and Technology (MSRT )and the National Organization of Educational Testing(NOET). Besides these requirements, the data came up with other concerns that would make serious challenges in future. They also explained their doubts in ‘discrimination power’ of the HNAEs (0-20) compared to the standardized UEEs, or argued for the likelihood of distributing a compatible ‘test-
anxiety and stress’ over the four years of high schools.
4. Conclusion
In Iran, choosing between the two competing admission practices by the policy makers bears a testimony that policymakers’ tendency to shift to the directing function of the HNAEs resulted from dynamics of their power. It is, then, within the realm of such a power that the unintended washback associated with the selecting function of the high-stakes tests seems to be controlled. Motivated by the current debates on evaluating the changed programmes, this study contributes to the literature through exploring the planning/policy phase prior to a later evaluation of the sole products which is common to the traditional evaluations. Policy/planning phase analyses can establish a baseline for subsequent evaluation of any programme, revealing a constellation of factors that might mitigate the intended policies, visions, or missions of that programme. In this study, a partial congruence was found between the policy and the desired outcomes of the HNAEs programme. This may thwart the success rate of ideals intended by the underpinning policies. Such concerns are not unique to Iran, but in other systems as well.
Keywords
', './data/jlts/coversheet/cover_en.jpg'))
Send comment about this article