The pixel output formats are detailed in Section 5 and Appendix D of the Hardware Guide for ADV7842. There is also an excel spreadsheet on the Design Support Files page for ADV7842 which can help confirm the pixel bus configuration for a given register setting.