Question

...
JK

Is there a Response Rate Fallacy (if not there should be IMHO)

Assuming that the commonly published figures are correct - internal surveys will generally receive a 30-40% response rate (or more) on average, compared to an average 10-15% response rate for external surveys - we are left with a 70 - 85% non-responder rate. There are significantly lower response rates for online surveys (which now are the norm) when compared to paper based surveys. How can we draw any concrete conclusions based on the usual response rates due to non-response bias and the like? To do so would be something of a Response Rate Fallacy. i.e. it is a fallacy to derive much meaning from a survey with a low response rate unless it is assured that the sample was representative and even then one is on thin ice.
asked on Saturday, Apr 01, 2017 12:45:58 PM by JK

Top Categories Suggested by Community

Comments

Want to get notified of all questions as they are asked? Update your mail preferences and turn on "Instant Notification."

Eat Meat... Or Don't.

Roughly 95% of Americans don’t appear to have an ethical problem with animals being killed for food, yet all of us would have a serious problem with humans being killed for food. What does an animal lack that a human has that justifies killing the animal for food but not the human?

As you start to list properties that the animal lacks to justify eating them, you begin to realize that some humans also lack those properties, yet we don’t eat those humans. Is this logical proof that killing and eating animals for food is immoral? Don’t put away your steak knife just yet.

In Eat Meat… Or Don’t, we examine the moral arguments for and against eating meat with both philosophical and scientific rigor. This book is not about pushing some ideological agenda; it’s ultimately a book about critical thinking.

Get 20% off this book and all Bo's books*. Use the promotion code: websiteusers

* This is for the author's bookstore only. Applies to autographed hardcover, audiobook, and ebook.

Get the Book

Answers

...
Bo Bennett, PhD
0
The response rate is irrelevant to the research. As you alluded to, the sample size being adequate is the real consideration. For example, if survey 1 received a 1% response rate and was sent to a total representative sample of 10,000 people, it would get 100 responses. If survey 2 received a 10% response rate and went to the representative sample of 1000 people, it would get 100 responses. Assuming no shenanigans, the results from both surveys should be similar. The statistical problem with poor response rates arise when the sample is not large enough to meet the desired confidence level based on the anticipated number of responses.

If I am missing something here, let me know.
answered on Saturday, Apr 01, 2017 02:44:13 PM by Bo Bennett, PhD

Comments