Question

...
Dan

If the earth is the subject, and there is only one earth, is controlled study weakened?

It seems like much of the argument among non-scientists (like me) boils down to predictive modeling being potentially and wildly unreliable, especially dealing with infinite time frames. Greenhouse gas data from ice cores, for instance, isn't often disputed because it is verifiable. However, the predictions of anthropogenically caused global environmental due to increased greenhouse gases are based on models. There are many models, sometimes with conflicting conclusions, even though they come to generally agreed upon consensus of a warmer planet. The most cogent argument that I (a non-scientist) get from the global warming hoaxers is that we can't really know and the data seems to support them. I'm not looking to discuss global warming here, for the record I'm going with the consensus as it seems the smartest thing to do (I drive a Leaf by the way--that should help categorize me psychographically), what I want to know is how best to defend statistical data when no control group is possible?
asked on Wednesday, Dec 17, 2014 09:08:06 AM by Dan

Top Categories Suggested by Community

Comments

Want to get notified of all questions as they are asked? Update your mail preferences and turn on "Instant Notification."

Reason: Books I & II

This book is based on the first five years of The Dr. Bo Show, where Bo takes a critical thinking-, reason-, and science-based approach to issues that matter with the goal of educating and entertaining. Every chapter in the book explores a different aspect of reason by using a real-world issue or example.

Part one is about how science works even when the public thinks it doesn't. Part two will certainly ruffle some feathers by offering a reason- and science-based perspective on issues where political correctness has gone awry. Part three provides some data-driven advice for your health and well-being. Part four looks at human behavior and how we can better navigate our social worlds. In part five we put on our skeptical goggles and critically examine a few commonly-held beliefs. In the final section, we look at a few ways how we all can make the world a better place.

Get 20% off this book and all Bo's books*. Use the promotion code: websiteusers

* This is for the author's bookstore only. Applies to autographed hardcover, audiobook, and ebook.

Get the Book

Answers

...
Bo Bennett, PhD
1

Wow, good question. First I would say that we need to take the predictive models on a case by case basis. The level of reliability for each greatly varies. A very important concept in science is known as consilience or convergence of evidence. In our context, this is the idea that multiple models will point to a demonstrable conclusion, even though some valid models will not. This is why deniers (of any scientific fact established from theory) cling to the outliers that confirm their position and ignore consilience.

This might be best explained by thinking of a study of coin flips. Let's say that 20 studies were conducted, 19 of which found no statistical difference between heads or tails (what we call having a p-value greater than .05), and one study, out of pure statistical probability, found that heads came up more a statistically significant number of times (p < .05). We can look at this the following ways: 1) focus on the one statistically significant study and claim that coins unfairly land on heads, which is clearly fallacious. 2) Reject the methodology (models) because one came up with completely different results, which is a poor conclusion, but more due to a lack of scientific understanding than fallacious reasoning. Or 3) accept the convergence of evidence pointing to the fact that coin toss results are functionally random*, which is by far the best conclusion based on the scientific method and reason.

* I say functionally because one can get into deep philosophical debates about randomness, which is irrelevant for this example. Also, there are studies that suggest that more than randomness might be at play.

answered on Wednesday, Dec 17, 2014 09:48:16 AM by Bo Bennett, PhD

Bo Bennett, PhD Suggested These Categories

Comments