Telephone survey response rates are on a precipitous decline, although telephone surveys that include landlines and cell phones and are weighted to match the demographic composition of the population continue to provide accurate data along most measures, finds the Pew Research Center for the People & the Press in a May 2012 report. Looking at contact rates over time (the percent of households in which an adult was reached), the study shows a drop from 90% in 1997 to just 62% this year. And when factoring in a declining cooperation rate (percent of households contacted that yielded an interview), the report finds the response rate (percent of households sampled that yielded an interview) this year to be just 9%, down from 36% in 1997 and 25% in 2000.
The study was based on 2 new telephone surveys conducted by the research center. One was conducted January 4-8, 2012, among 1,057 adults using Pew Research’s standard methodology, achieving an overall response rate of 9%. The other, conducted January 5 to March 15, among 2,226 adults, used a longer field period as well as other efforts to increase participation, achieving a 22% response rate. The survey questions were compared with similar or identical benchmark questions asked in large federal government surveys that achieve response rates of 75% or higher and therefore have minimal non-response bias.
Comparing the standard Pew survey with the US government survey shows the standard survey to be generally representative of most politically-relevant facets of the population, including the proportion of respondents who are married, have children in the household, are internet users, and are registered to vote. The only areas in which the standard survey significantly overstated the proportion of respondents were for contacting a public official in the past year, and volunteering for an organization in the past year. However, over-representing volunteers was found to have little effect on survey estimates.
Not only did the standard Pew survey compare well with the larger US government survey, it also fared well when compared with the high-effort survey that yielded a 22% response rate. In fact, 28 of the 40 comparisons yielded differences of 2% points or less, while there were 3% point differences on 7 items and 4% point differences on the remaining 5 items.
Subscribe now to receive more charts and articles like this in your inbox. A fast read in a clean, mobile-friendly design.