Monday, April 04, 2011

Honest Statistical Writing


We’ve all heard that people can lie with statistics.  But if you write statistics, you do not wish to lie.  And we all dislike being lied to.

For those who write or evaluate statistical evidence, there is a handbook. It is called How to Report Statistics in Medicine, second edition, 2006, by Thomas Lang and Michelle Secic.  (It is published by the American College of Physicians).  The book is simply and clearly written, with examples.  It advises us generally about types of measurement and then covers kinds of evidence, such as

·      Various measures of risk
·      Hypothesis tests with their p values
·      Association and correlation
·      Regression and ANOVA
·      Surveys, case studies, cross-sectional analyses

Readers who don’t know statistics very well (as I do not) can use this book to judge statistical presentations.  This book would be ideal if you review articles for a science journal.

I learned a few things:

On page 3 -  Do not give people more than two significant figures.  That’s all they can grasp.  Do not write that in April 2011, unemployment was 9.4481% of the available U.S. workforce.  It’s clearer to say that, in April 2011, unemployment was 9.4% of …  

On page 22 - 
When I inform people about the risk (of what’s bad) or the probability (of what’s good), I need to tell them at least four things:
  1. The numerator and denominator with their units of measurement (for example, 25 out of every 100 …).
  2. The time span.  Am I reporting the probability that X will occur over one year?  Over 10 years?  Over the life cycle of a fruit fly?
  3. The unit of population.  Every 1,000 live births?  Every 1,000,000 European residents?  Every 100 fruit flies in my sample?
  4. The confidence interval (CI or p value).

When I read an odds ratio (page 27), I should remember that “4.2 times as likely as” does not really mean “4.2 times more likely than.” 

This book by Lang and Secic is helping me read better and listen better.

As you know, statistics often appear in tables or graphs.  If you need to create them, here is a basic tutorial: Including Tables and Figures in Academic Writing .  Its examples are not necessarily all in APA 6th edition style. You will want to check APA6 pages 116 and following.  But the facts are good.

The tutorial comes from our British friends at the Subject Centre for Languages, Linguistics and Area Studies, Avenue Campus, Highfield, University of Southampton, Southampton, UK SO17 1BF

No comments: