Image reconstruction is a method by which the underlying images, hidden in blurry and noisy data, can be retrieved. This is used in applications such as computer tomography (CT), magnetic resonance and radio astronomy. In recent times, a non-parametric adaptive regression method called steering kernel regression was proposed and proved to be effective. This method involves computation of local gradient at each pixel thereby making it computationally intensive. The time consuming parts of the steering kernel regression can be optimized by off-loading them onto GPUs and multi-core processors. The parallel implementation of this algorithm improved the performance of image processing applications such as denoising, deblocking and upscaling. It has given an average speedup factor of 6 on multi-core and 21 on a GPU.