Paper: Opening The Black-Box of Referee Behaviour. An Agent-Based Model of Peer Review

ABSTRACT. This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused especially on the importance of reciprocity motives to ensure cooperation between everyone involved. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios where we tested interaction conditions and manipulated author and referee behaviour. We found that reciprocity per se can have a negative effect on peer review as it tends to increase evaluation bias. It can have a positive impact only when purged by self-interest motivation and accompanied by disinterestedness and fairness standard.

No comments:

Post a Comment

This is a blog (now) associated with the European Social Simulation Assocation SIG on "Simulating the Social Processes of Science". For all queries about the SIG, or items to post here please contact Bruce Edmonds "bruce at edmonds dot name". Thanks