1 in 7 men receive a diagnosis of prostate cancer in their lifetime. The aggressiveness of the treatment plan adopted by the patient is strongly influenced by Gleason grade. Gleason grade is determined by the pathologist based on the level of glandular formation and complexity seen in the patient’s biopsy. However, studies have shown that the disagreement rate between pathologists on Gleason grades 3 and 4 is high and this affects treatment options. We used quantitative phase imaging to develop an objective method for Gleason grading. Using the glandular solidity, which is the ratio of the area of the gland to a convex hull fit around it, and anisotropy of light scattered from the stroma immediately adjoining the gland, we were able to quantitatively separate Gleason grades 3 and 4 with 81% accuracy in 43 cases marked as difficult by pathologists.