Keyboard on USB hub not working with Animal Crossing

I have a HDD connected to the first USB port and a hub connected to the other port. The hub has the ethernet adapter, Wii Speak and a (wireless) keyboard connected. When using the Internet channel the keyboard works, but in Animal Crossing it does not. I have not tried the Wii Speak yet.

I figured out how to get CFG to load with IOS249 by default (mauifrog's downloads uses 248 as a command line argument, very annoying) since loading with 248 doesn't seem to recognized the HDD any more. I have tried loading without the Wii Speak and Ethernet so that it's only the keyboard in the hub, still doesn't work. When I launch Animal Crossing like normal from the original disc, or any other normal channel like Internet or writing a message, the keyboard (and Ethernet) works as expected.

Is there any way to debug or trace what's going on? I feel like it's a bit of hit and miss right now. Maybe I'll try using a different USB loader.