Stenlund, Tova

Abstract [en]

Assessment of prior learning (APL) represents the task to identify and acknowledge an individual’s knowledge and skills regardless of how it has been obtained. In higher education this type of assessment is primarily used for the purpose of awarding access, credits or advanced standing. Because of the impact the results from APL have on the future working career for individuals claiming APL, it is of great importance that these result of APL is valid. The question of interest in this thesis is to what extent APL in higher education is a valid assessment.

The thesis is written in the field of educational measurement and comprises four papers and an extensive introduction with summaries of the papers. The most recent views of validity theory were used as the general theoretical framework in all papers, and all papers are concerned with APL in higher education. Study I reviews the research area of APL in higher education from a validity perspective. The general conclusion from the review is that the majority of the studies conducted in this area primarily provide theoretical rationales and theories for a variety of APL practices, and that there is a need for empirically based studies examining and evaluating validity of APL. Studies II, III and IV are empirical studies based on, and exemplified with, an APL scheme related to higher education in Sweden. Study II examines validity issues identified from claimants (individuals or students claiming APL) view of APL. The claimants’ experiences from the specific APL scheme were examined using a questionnaire developed for that purpose. Conclusions drawn from the results are that possible threats to validity may exist in the administration of APL procedures, as well as in consequences of APL. Study III focuses on validity of admission decisions based on APL. The study examines decisions made by different higher education institutions for approximately 600 individuals applying for higher education based on their prior learning. The results show that the existing practice of APL needs improvements in order to obtain validity and trustworthiness in the decisions made in relation to APL. Finally, Study IV focuses on reliability in APL related to higher education. The study provides data of inter- and intra-rater reliability among judges in the specific APL scheme. The results show a lack of especially inter-rater reliability, and a conclusion is that reliability in this type of assessment should be further investigated.

The general conclusion from this thesis is that there is a need to take validity issues in APL seriously, and that APL in higher education may not be as valid as it could be.

Abstract [en]

The process of giving official acknowledgment to formal, informal and non-formal prior learning is commonly labelled as assessment, accreditation or recognition of prior learning (APL), representing a practice that is expanding in higher education in many countries. This paper focuses specifically on the assessment part of APL, which undoubtedly is central to the whole process, through a review of research in this area and an analysis of the reviewed studies from a validity perspective. The research reviewed (published 1990–2007) is categorised into empirical as well as more theoretically oriented publications, with a quantitative dominance of the latter. According to the validity analysis, a majority of the studies conducted in this area relate to the evidential basis of test interpretation and use, primarily providing theoretical rationales and theories for a variety of practices. The consequential basis of test interpretation and use has not been studied to any larger extent, resulting in a lack of both theoretical and empirical studies dealing with this aspect of validity.

Abstract [en]

Assessment of prior learning (APL) refers a process where adults’ prior learning, formal as well as informal, is assessed and acknowledged. In the first section of this paper, APL and current conceptions of validity in assessments and its evaluation are presented. It is argued that participants in the assessment are an important source of information for the validation of the assessment. In the following section participants experiences from a particular APL scheme are evaluated using a questionnaire developed for that purpose. The questionnaire provides data on individuals’ perceptions of the procedure and result of the APL scheme. The results are described, analysed and discussed from a validity perspective. Conclusions drawn from the results are that possible threats to validity can exist in the administration of APL procedures, as well as in consequences of APL.

Abstract [en]

Assessment of prior learning (APL) refers to the process of validating individuals’ learning in a variety of contexts, representing a relatively new practice in many countries. In higher education APL is used to receive access and credits based on skills and knowledge acquired mainly outside of formal academic settings. This paper focuses on validity of admission decisions based on this type of assessment in higher education. The study examines decisions made by higher education institutions for approximately 600 applicants who have used APL in order to receive admission to, and credits in the vocational teacher education program in Sweden. The results are analysed and presented in relation to a validity discussion. A conclusion is that the existing practice of APL needs improvements in order to obtain validity and trustworthiness in the decisions made in relation to APL.

Abstract [en]

This paper focuses on reliability in assessment of prior learning (APL) related to higher education. APL refers to a process where adults’ prior learning, formal as well as informal, is assessed and acknowledged. In higher education APL is used for the purpose of gaining admission, advanced standing or credits. In this paper studies investigating reliability in APL are presented. The studies provide data of inter- and intrarater reliability among assessors in a specific APL scheme used in higher education. Percentage of agreement and Cohen’s kappa were used to estimate reliability, and the results show that the agreement between assessors, i.e. interrater reliability, is poorer compared to the agreement on repeated assessment by the same assessor, i.e. intrarater reliability. Further, the results reveal that there are differences in agreement between different aspects of prior learning. A conclusion is that reliability in this type of assessment ought to be further investigated.