They will play OK if I use a different program to mux them.
VLC media player 2.1.5 Rincewind (revision 791b550). Compiled on Jun 6 2014 16:07:36.
$ cvlc foo.aac --sout="#std{access=file,mux=mp4,dst='foo2.m4a'}" vlc://quit