Subjective Evaluation

A pair of high resolution images produced by two different SR methods, for the same input low resolution image, are shown to each participant of this subjective survey. The participant selected which one is better than the other in terms of perceptual quality based on his/her subjective judgement. The high resolution image pairs are drawn from all the competitive methods randomly, and the images winning the pairwise comparison will be compared again in the next round, until the best one is selected. We use the Bradley-Terry model [1] to estimate the subjective scores for each SR method. 101 people participated the survey, and they performed such pairwise comparison over six images ( Kid, Chip, Statue, Leopard, Temple and Train).