The data I was trying to export had originally been imported from SQL Server to hadoop using sqoop and while importing sqoop uses a default column delimited of ^A (octal representation of '\001'). So to get this to work I had to specify the delimiter using -input-fields-terminated-by