Please make sure, that the radix of the bus is Unsigned Decimal. Even this way, you probably going to get a saturated sine wave, so you should reduce the rx gain to the minimum: 4.5 dB (because you're using an SMA cable).

If you'll still have some saturation, you should consider to change the cable to two antenna. (the 4.5 dB is the minimum gain of the AD8366)