A framework for the evaluation of research in South African Higher Education Institutions : conceptual and methodological issues

ENGLISH ABSTRACT: This study aimed at establishing whether or not an integrated and appropriate system exists for the
evaluation of research in the South African higher education system. As background to the
assessment of research in South African higher education, models of research evaluation from other
countries were reviewed and served as reference to the discussions on the local efforts. In each case
the higher education research systems were reviewed, including existing efforts of research evaluation
that exits alongside the systems. The review followed a pattern that focuses on areas including the
history and rationale, purpose (s) for research evaluation, political/transformation contributions and
methodological issues for a clearer understanding of the contributions made by the efforts. The
study followed a multiple-case study approach to review the models and the South African situation,
with the local research evaluation efforts embedded within the study of South Africa as a case.
Five themes guided the reviews that were apparent for the final discussions of the study: the rationale
and purpose of research evaluation, units of analysis used in the evaluation, dimensions/criteria used
in research evaluation, governance and management of research evaluation processes and
methodological issues related to research evaluation. The study revealed that none of the fragmented
South African research evaluation efforts is suitable to deal with the transformation requirements
expected of higher education institutions. This is mainly because of the voluntary nature of the
current initiatives and their focus on the lowest level of units of analysis – the individual researcher.
The one effort that would be better suited to meet the transformation imperatives – the HEQC
institutional audits - does not concentrate on research exclusively but collectively addresses all core
activities in institutions, reducing the attention necessary for research evaluation to make a
meaningful contribution to higher education research.
The study suggested a comprehensive design for the framework of South African research evaluation.
The purpose identified for the envisaged exercise is the development and improvement of quality
research of international standards across the system of higher education in order for research to make
meaningful contributions to national demands. Programmes/departments in the higher education
institutions are suggested as the units of analysis in which quality, productivity, relevance and
viability serve as criteria for evaluation.