diamond geezer

 Wednesday, July 28, 2010

PR Masterclass

Lesson 2: How to lie with with statistics
- an apology

I'd like to apologise wholeheartedly and unreservedly for my post on Sunday in which I accused arts collective CultureLine of telling lies in a press release. I have since engaged in email conversation with the good folk at Colman Getty, the PR Agency responsible, and they've made me aware that one of my underlying assumptions about the survey was incorrect. By jumping to conclusions without seeking the facts, I have entirely misrepresented how the headline in the press release was obtained. Sorry, that's unforgivable. So on their behalf I feel it's only right to set the record straight. Because it turns out that the truth is much worse than I previously thought.

Let me go back to the opening of CultureLine's press missive and start again.
Half of north Londoners never cross the river for work or play
54% of Londoners living north of the River Thames never venture south for either work or cultural pursuits and south Londoners are twice as likely to cross the river for culture.
I wondered where that 54% came from, because it sounded unlikely. But I made a wrong assumption by using inappropriate data appearing later in the press release. I thought the 54% came from here:
48% of north Londoners visit the south of the capital for culture less than once a month and 7% never do this.
I thought the 54% must have come from adding together the 48% of North Londoners who sometimes cross the river to the 7% who never do. There were no other figures in the press release which could possibly have matched the 54% total, even after rounding, so I assumed these figures were what had been used. But this would have been a wholly unjustifiable use of statistics. Indeed, as a nice lady from Colman Getty kindly pointed out to me...
"Had we added the % of those North Londoners who never cross the river for culture to the % of those North Londoners who cross the river less than once a month for culture, you’re right, that would have been inaccurate and misleading."
Because that's not what they did. Instead I'm told they used a statistic from the survey which didn't appear anywhere in the press release. A statistic I couldn't have known about until it was revealed in their email.
"The ‘half of Londoners never cross the river for work or play’ statistic was calculated as follows. We asked respondents how often they crossed the river for work and how often they crossed the river for play. Of those North Londoners who responded, half either never crossed the river for work (47.7%) or never for play (7%)."
So the 'half' was obtained by adding the 47.7% for "work" to the 7% for "play". This made a supposed total of 54% for "work or play". Sounds convincing, doesn't it? But in fact this is an even bigger massive lie than the one I thought I'd seen before.

They've added this and this
48% of north Londoners never cross the river for work
7% of north Londoners never cross the river for play
to make this
Half of north Londoners never cross the river for work or play
And I'm sorry, but that's statistical drivel.

To help see why, here are those first two statements written the other way around.
52% of north Londoners sometimes cross the river for work
93% of north Londoners sometimes cross the river for play
Or, in other words, when it comes to play, almost all north Londoners sometimes cross the river. North Londoners are river-crossing kinds of people. They don't shun south London, they go there. Almost all of them. It is absolutely definitely not the case that "Half of north Londoners never cross the river for work or play", because almost all of them cross the river for just one of those activities. An even greater number (at least 93%, probably higher) cross the river for either one or the other. A more accurate headline would therefore have been
Half of north Londoners never cross the river for work
but that wouldn't have been news. Or maybe
Less than 7% of north Londoners never cross the river for work or play
but that wouldn't have been news either. Instead the good folk at Colman Getty have jumped to a fallacial conclusion based on underlying survey data which wasn't revealed to the public. More precisely, they combined two probabilities incorrectly using mathematical rules which should apply only to mutually exclusive events, which these are not. They invented a plausible-sounding statistic which had absolutely no grounding in reality, then launched their tainted conclusion headlong into the national media. They have lied with statistics, presumably because someone was too innumerate to know better.

I look forward to reading their apology.

<< click for Newer posts

click for Older Posts >>

click to return to the main page

...or read more in my monthly archives
Jan18  Feb18  Mar18  Apr18  May18  Jun18  Jul18
Jan17  Feb17  Mar17  Apr17  May17  Jun17  Jul17  Aug17  Sep17  Oct17  Nov17  Dec17
Jan16  Feb16  Mar16  Apr16  May16  Jun16  Jul16  Aug16  Sep16  Oct16  Nov16  Dec16
Jan15  Feb15  Mar15  Apr15  May15  Jun15  Jul15  Aug15  Sep15  Oct15  Nov15  Dec15
Jan14  Feb14  Mar14  Apr14  May14  Jun14  Jul14  Aug14  Sep14  Oct14  Nov14  Dec14
Jan13  Feb13  Mar13  Apr13  May13  Jun13  Jul13  Aug13  Sep13  Oct13  Nov13  Dec13
Jan12  Feb12  Mar12  Apr12  May12  Jun12  Jul12  Aug12  Sep12  Oct12  Nov12  Dec12
Jan11  Feb11  Mar11  Apr11  May11  Jun11  Jul11  Aug11  Sep11  Oct11  Nov11  Dec11
Jan10  Feb10  Mar10  Apr10  May10  Jun10  Jul10  Aug10  Sep10  Oct10  Nov10  Dec10 
Jan09  Feb09  Mar09  Apr09  May09  Jun09  Jul09  Aug09  Sep09  Oct09  Nov09  Dec09
Jan08  Feb08  Mar08  Apr08  May08  Jun08  Jul08  Aug08  Sep08  Oct08  Nov08  Dec08
Jan07  Feb07  Mar07  Apr07  May07  Jun07  Jul07  Aug07  Sep07  Oct07  Nov07  Dec07
Jan06  Feb06  Mar06  Apr06  May06  Jun06  Jul06  Aug06  Sep06  Oct06  Nov06  Dec06
Jan05  Feb05  Mar05  Apr05  May05  Jun05  Jul05  Aug05  Sep05  Oct05  Nov05  Dec05
Jan04  Feb04  Mar04  Apr04  May04  Jun04  Jul04  Aug04  Sep04  Oct04  Nov04  Dec04
Jan03  Feb03  Mar03  Apr03  May03  Jun03  Jul03  Aug03  Sep03  Oct03  Nov03  Dec03
 Jan02  Feb02  Mar02  Apr02  May02  Jun02  Jul02 Aug02  Sep02  Oct02  Nov02  Dec02 

eXTReMe Tracker
jack of diamonds
Life viewed from London E3

» email me
» follow me on twitter
» follow the blog on Twitter
» follow the blog on RSS

my flickr photostream