Gohiki no shinshi - 1966

Fresh out of prison, a broken man reluctantly takes a job to kill three men, but changes his mind when some gangsters target the same men. He then tries to find out why the men are being targeted in the first place.