Cognitive scientists will tell us that interrupting the visual flow if information is a significant determent to learning. Looking from the score to your hands and back to the score breaks up the information flow into your memory, creating a garbled mess. It is critical for the mastery of playing, that the fingers and arms learn to judge distances without the aid of the eyes. Make the mistakes and learn from them, but do not let the eyes become the crutch of the hands.