Posts Tagged ‘RCTs’

One of the most illuminating insights in Ben Ramalingam’s Aid on the Edge of Chaos (see last week’s review) was on how well suited complexity science is to tackling issues of systemic risk in the global financial system (e.g. too much inter-connectedness amongst banks and other financial institutions). The reason being that there was a wealth of data, millions upon millions of individual transactions, just sitting there waiting to be analysed if only someone could bring the right toolset (and a powerful enough computer). Complexity science can take all that apparent randomness and help us tease out significant emergent patterns and behaviour.

I thought this was particularly illuminating because it perfectly illustrates one of the major challenges of bringing complexity science techniques to bear on development problems: for the most part we do not already have the data, and going out and collecting it is very expensive. Different analytical approaches no doubt differ in their data requirements, but I suspect that in many cases that chaos nerds have an even bigger problem in this respect than randomistas. In short without the huge morass of data there is too little random feedstock from which patterns can emerge.

If we combine that problem with one of the main challenges to RCT’s global domination – limited external validity when context is everything* – I am worried that complexity thinking may sometimes me the equivalent of the proverbial sledgehammer used to crack a nut. It may be that the nut is so hard to crack that nothing short of a sledgehammer will suffice to do the job, but the reality is that we cannot go round deploying chaos science sledgehammers everywhere, not least because I doubt there are enough capable chaosistas.

But there is another emergent pattern out there, of bloggers sounding really stupid when they write about things they don’t understand. So now maybe Ben and co can tell me how badly I am wrong …

* In chaotic systems this is represented in the extreme sensitivity to initial conditions, hence the joke about the butterfly flapping its wings in the rainforest triggering a thunderstorm on the other side of the world.