FATHOM close
 
New Ethics Rules for Polling

News organizations have always argued that space does not permit the sophisticated statistical detail that would fully explain the polls they conduct or report upon. The Web has changed all of that. Now news organizations can refer readers to their websites for more detail. Here's how polls should be conducted and reported ethically:

  • Confidence levels and error limits should be fully reported, in detail, for subsamples as well as for the overall sample. At the very least, news organizations should provide a calculator so that readers can do the math themselves.
  • News organizations should also provide an estimate of how accurately the sample being polled was selected. This "sampling error" should be added to the random errors described above.
  • When reporting on polls of others, news organizations should either provide full disclosure of error limits (as above) or set and disclose their own standards about what is reliable enough to report. For example, a news organization might decide that no poll with a sample smaller than 500 will be reported. This approach is particularly useful for broadcasters who do not have enough airtime to go into details.
  • News organizations should report possible sources of bias (circumstances that can affect poll results)--for instance, breaking news, high refusal rates or a multiple-day or multiple-week sampling period.
  • News organizations should publish the full text of the polling script used by telephone operators.
  • Wherever possible, polls should ask questions in multiple ways about issues that are hazy in the public's mind (the economy, for example; see main story).
  • News organizations should publish their complete data sets in a generally usable format (Excel, CSV, HTML, XML), so interested parties can do their own analysis and so multiple surveys can be more easily combined.
 
   ©2000 Fathom, Inc.