2 pixel dots at the end of non-black vertical lines

When I make a vertical line, reduce the thickness to 1 pixel and change the colour, it always has a black dot at either end of the line, about two pixels long. Doesn't happen with horizontal lines. It's just annoying as it ruins a rather nice line on my design! (OCD?!)