I'm going to leave this question open for few more hours, but it's starting to look like the answer is NO, there is NO FREE API for the Census. Best idea seems to be the datasets Dave wrote about. But that looks like a ton of man-hours to pull that together...