Sunday, June 29, 2008

Survey Says: Ignore the Survey

by Robert McHenry
I don’t respond to poll questions. Occasionally someone will call on the telephone, introduce him- or herself as associated with some organization I never heard of – and often saying the name of it so quickly that I can’t quite make it out – and then announce that I’m about to be asked questions about something. I invariably say “No, thanks,” and hang up. I don’t give it away, folks.

While pursuing a business degree – do you ever wonder why we are said to “pursue” a degree, as though it were fleeing in terror, or at least at high speed, like the rabbit at a greyhound race? – I took some marketing course in which we learned about polls and surveys. The readings gave us an inside look at how subjects are chosen, how questions are composed, how the process is conducted. What was clear although never spoken aloud was that these techniques are about equally efficacious in finding what people actually think and finding that they think what pollers want or expect them to. It’s all in the wrist.

Today’s newspaper brings a story that underscores just how useless polls can be. The Pew Forum on Religion and Public Life surveyed 35,000 Americans on their religious beliefs. There’s a wealth of information on religious affiliations, strength of certain beliefs, the relationship between religious belief and political posture, and so on. And there are some puzzling results like this: Of those who identified themselves as atheists, 21 percent said that they believe in God or in some universal spirit, and 6 percent believe in a personal God. Of agnostics, 55 percent believe in God, 14 percent in a personal God. How can that be, you may be wondering?

I’m reminded of the man-in-the-street surveys that Steve Allen used to conduct when he was the host of the “Tonight Show” on television. One election year he asked people if they would vote for a presidential candidate if it could be convincingly demonstrated that he had “scruples.” The pollees were unanimous: They most certainly would not.

Poll results can be influenced by the wording of questions, by the tone of voice or facial expression of the interviewer, by myriad factors that do not bear on the actual issues at hand. Notoriously, too, people choose their answers to survey questions under the influence of a welter of sometimes conflicting motives. They tend to answer as they think they are expected to and tend to avoid controversial or unpopular positions. Hence the wide differences between pre-election polls and election results, for example.

There are those who just like to mess with the survey. This might account for some of the believing atheists, jolly folks that they are.

And then there would seem to be those who – it must be said – simply don’t know what the heck they are talking about. “Scruples” sounds as though it might be a rather nasty and contagious disease, after all, one that probably causes pustulant irruptions on the skin. Not what we want to see at the inaugural ball, so why take chances?

Too many surveys seem to take no pains to exclude the “eager to speak out but unfortunately clueless” portion of the population or at least to identify it separately in the results. Consequently, those of us who haven’t yet decided to ignore surveys entirely are left with an unknown and unadmitted degree of uncertainty. Word to the wise.

No comments: