ReShade does only support 8-bit per channel back buffers for screenshots at the moment. Game, or more likely something in the SkyGfx mod, forces D3DFMT_A2R10G10B10 aka 10-bit per channel. There is no solution for this implemented right now.