This is another one of those intractable issues related to matrix decomposition limitations causing issues when trying to blend between the results of different constraints, not to mention the fact that the childof constraint needs to do some fairly evil space-conversion things which don't really play nicely when applied partially.