Tuesday, February 09, 2010

Tired of Statistics?

For a century or more, writers and speakers have developed the habit of using statistics to support their views. This becomes clear if we compare, for example, a political speech given in 2010 with one given in 1510. This mathematical trend has been popular because it gives the appearance of being scientific and rational.

Reflective listeners and readers, however, have long realized that statistics are subject to manipulation and misinterpretation. One need only recall the primary lesson that correlation does not imply causation, or recall Mark Twain's quip about statistics, to understand why the numerals which adorn political texts need either to be carefully examined, or to be ignored.

We understand that quantitative analysis is important, and should be done, but we border on the absurd when a report is released by the Treasury Department, and it is immediately combed by various political parties, who harvest whatever numbers appear to support their agendas.

Is there an alternative?

Researchers hoping to escape the statistical madness have focused on a method of qualitative analysis. This type of investigation has long been used in situations where a statistical approach isn't possible: it has been used by the United States Air Force in debriefing crewmen after missions, by the FAA after crashes, by physicians in case studies, and by police detectives. When studying a single event or a unique case (N=1), statistical approaches are usually meaningless.

This type of qualitative analysis is now being transferred from situations in which statistical analysis is impossible to situations in which statistical analysis is unhelpful. In certain branches of medicine and economics, for example, quantitative analysis yields results which are ambiguous or misleading. Qualitative analysis, by contrast, can yield more understanding of the situation's dynamics.

So, in some situations, we can avoid statistics and get a better insight of the matter at hand!