So Nature has released a study by researchers from Columbia University purporting a link between the El NiÃ±o effect and violent conflict in a subset of countries (those that face large shocks in temperature when El NiÃ±o comes knocking).
There are tons of reasons to be skeptical of these results – one thing that made me pause was the complete lack of theory in the paper, and thus there’s no real attempt to discern why El NiÃ±o might increase the risk of violence. Even stranger – the results get stronger when the authors control for rainfall and temperature in the affected countries, which really doesn’t leave much of a theoretical channel for the resulting outcome. To make matters worse, the structure of the article makes it nearly unapproachable – which is not the fault of the authors, but the journal itself (why isn’t this appearing in a social science journal? I have a theory).
Edward Carr also stepped in and rightly choked-slammed the results. While I agree with him that the paper is a mess and we shouldn’t make too much of the results, I found some of his complaints to be off the mark:
This design makes sense only if you assume that the random back-and-forth shifting did not trigger adaptive livelihoods decisions that, over time, would have served to mitigate the impact of these state shifts (I am being generous here and assuming the authors do not think that changes in rainfall directly cause people to start attacking one another, though they never really make clear the mechanisms linking climate states and human behavior). Â The only way to assume non-adaptive livelihoods is to know next to nothing about how people make livelihoods decisions. Â Assuming that these livelihoods are somehow optimized for one state or the other such that a state change would create surprising new conditions that introduced new stresses is more or less to assume that the populations affected by these changes were somehow perpetually surprised by the state change (even though it happened fairly frequently).
Carr seems to be suggesting that, by using run-of-the-mill regression analysis, the authors are implicitly assuming that people in `treated’ countries don’t react in ways to offset future El NiÃ±o effects. It seems to me that this approach isn’t making that assumption at all, it’s attempting to measure the average impact on the incidence of conflict. We might expect that the impact to be higher under the assumption of non-adaptive livelihoods than under adaptive livelihoods (unless part of that adaptation is picking up an AK-47), but none of this feeds into the average effect.
Now – it is unclear what that average effect is measuring (and this might be what Carr is getting at), as the impact in year 0 is the impact of El Nino on the unadapted, where the impact in year 0 + T might be the impact on El Nino on the semi-adapted. While this might certainly be an issue for the external validity of the findings (if people have been adapting during the period observed, we’re not likely to see similar effects in the future), it doesn’t affect the researchers’ ability to say “here’s the aggregate impact of El NiÃ±o on X over this period.” It’s still a valid statement, if a less interesting one.
I should note this isn’t the first time I’ve taken issue with research on the impact of climate on civil conflict, especially with how this stuff gets reported in the news. The Guardian has already managed to mistakenly conflate the result of increased risk of conflict with direct culpability by claiming that the research “shows 50 of 250 conflicts between 1950 and 2004 were triggered by the El NiÃ±o cycle.” This is a common mistake, one I discuss in length here.