To which I have nothing more to add.In summary, we may be able to cure our students (our future voters) of pseudoscience and pseudoscientific thinking by exposing them to the claims of practices like acupuncture that masquerade as medical science and by helping them identify and unpack the pseudoscientific assertions of these practices and understand why the claims are indeed pseudoscientific.
The cure for pseudoscience: alternative medicine
I just saw my colleague Paul Strode, with whom I wrote a book a few years ago. Knowing my interest in pseudoscience, Mr. Dr. Science Teacher (the name of his blog) directed me to his article Acupuncture Study as a Cure for Pseudoscientific Thinking.
The article is, I think, really two articles. The first describes an experiment that his students perform, but he sets it up so that they generally overlook one important variable. The outcome of the experiment is therefore not necessarily useful. The second article, which relies to some extent on the first, is largely about acupuncture, and that seems to me to be where he gets down to brass tacks.
I will only summarize here. Mr. Dr. Strode concludes that acupuncture is better than no treatment but that it is not better than a placebo. He cites a number of studies showing that sham acupuncture, including poking with a toothpick, works as well as "real" acupuncture. He observes that acupuncture can sometimes have deleterious side effects (nocebo effect) and cites a reference to the effect that there have been five confirmed cases of death resulting from acupuncture treatment.
Finally, and perhaps this is really a third article, Dr. Strode describes perusing the website of the National Center for Complementary and Integrative Health; he is impressed primarily by "how tentative each headline is." Then he singles out one article, not about acupuncture but rather about how "Meditation or Exercise May Help Acute Respiratory Infections, Study Finds." May help. May help.
I did not read the original article, but Dr. Strode helpfully provides a P-value of 0.054, and an effect size of 0.043. The P-value means that there is only about a 1 in 20 chance that the claimed effect is real the result (or a more extreme result) could have happened by chance. Statisticians often define a study to be statistically significant when the P-value is less than 0.05, so this study is marginal at best.
Effect size is, in the simplest case, the ratio of the difference between the two means and the sample standard deviation. For example, if the mean of the test group and the mean of the control group differ by one standard deviation, then the effect size equals 1. The means in this study differ by 0.043 standard deviation; in other words the two means are virtually the same.
The headline says that meditation or exercise may help acute respiratory infections. Indeed they may. This study has not ruled out the proposition, but to my mind neither has it provided one whit of evidence in its favor.
Dr. Strode claims that meditation is useful anyway, and it differs from acupuncture by being free. He concludes,
24 Comments
Henry J · 16 August 2016
So, it may be better for one to think than to pay somebody to needle them?
John Harshman · 16 August 2016
Matt Young · 16 August 2016
AdelyneMld · 16 August 2016
That still isn't a proper formulation. The p-values measures the probability to get a result as extreme or more extreme assuming a specified hypothesis is correct, which is most of the time the null hypothesis. This is a conditional probability. The American Statistical Association explains it better than I do: https://www.amstat.org/newsroom/pressreleases/P-ValueStatement.pdf
Jonboy · 17 August 2016
This reminds me of all that stupid "cupping" we saw on some famous Olympic performers over the last few days. Not a good example of modern athletic medicine to present to the world.
Roger Lambert · 17 August 2016
Dr Strode makes the statement:
"The placebo effect is a real, measurable biological phenomenon ..."
which I think is fairly misleading and ripe for misinterpretation. It implies that a treatment - for example, acupuncture as a substitute for chemical anesthesia, has some biological effect as an anesthetic. But this is NOT true. The placebo effect is not a targeted biological effect, but merely a psychosomatic effect as a confounder in a clinical study. Any beneficial effect reported by patients in such a study are outcome effects. And these effects are due to the psychological benefits of expectation fulfilment and attention, ie, being chosen to participate, getting attention, breaking a normal routine, being physically touched, an expectation that a studied treatment is bound to be effective, etc.
The placebo effect is (mis)interpreted by millions as a beneficial biological targeted effect that you can get essentially without the cost, side effects,and hassle of real medicine. This misinterpretation leads millions to a very badly contrived conclusion - that the placebo effect can be harnessed, that it "can't hurt to use such sham medicines, or to use "harmless" quackery. The placebo effect is not biological, it is psychological and its only effect is to confound clinical conclusions.
eric · 17 August 2016
Matt Young · 17 August 2016
Bobsie · 18 August 2016
This reminds me of the classic management engineering study of the 1920s where researchers focused on improving worker productivity.
At first they increased lighting by increments, each time followed by an increase in productivity. Then they decreased lighting in increments and also found productivity increases each time. Just being the object of study was the common factor for productivity increase.
It became known in management engineering circles as the "Hawthorne effect" named after the Hawthorne Works in Cicero Il where the study was conducted.
harold · 18 August 2016
eric · 18 August 2016
harold · 19 August 2016
Robert Byers · 20 August 2016
I recently saw on a youtube show about unexplained biology phenomena how much the placebo effect was real.
As a Christian/creationist we are taught in the bible that laughter is like a good medicine. So the "mind' must have a affect on the biology.
Howevrr I speculate its the power of memory. Not our free will but our memory has alrady its channels for reacting to some true medicine and so the fake one can trigger these channels also. A person with a phobia about heights, upon suddenly at some height, sweats, heart races, confusion, etc etc just because of the memory noticing the height.
For sure the body is triggered by thoughts. Everyone knows this.
i always like the placebo effect because it confirms to me the power of the memory, on its own and not our controlling it, to affect our bodies. Very profoundly beyond was is recognized in science.
So not a mysterious spooky healing thing by a fake thing.
DS · 20 August 2016
i speculate that speculation is worthless
Rolf · 20 August 2016
Frank J · 21 August 2016
This is only anecdotal, but I can vouch that meditation cures a lot of ills. For example, I know that evolution (the fact and the theory) is true. But it's not fun, being related to last night's dinner and all. So sometimes I try to convince myself that creationism is true instead. At first it's a wonderful "serenity now!" thing - a nice picture of "kinds" popping up on dry land "a long time ago," then marching two by two onto an ark... But invariably I start thinking "when was 'a long tome ago'? billions of years ago, only thousands? something else?" And "does the earth go around the sun or the other way around." "Can YEC and OEC both be true at the same time?" "Is Behe right that I'm still related to last night's dinner, but that 'RM + NS' alone could not drive the speciation?" Soon I'm back to the same old same old. But it was fun while it lasted.
harold · 21 August 2016
harold · 21 August 2016
Another way of looking at placebo is that it is "that class of 'treatment' which can be replaced by virtually anything else to achieve the same effect".
E.g. if I have a bunch of patients with mild tension headache and no contraindication against aspirin. I give some of them a reasonable dose of aspirin, I tell some of them to "tough it out", and I give the rest a whole range of things from "psychic healing intervention", "magic beans", inactive material described as "Indonesian herbal remedy", "Perkins' tractors" https://en.wikipedia.org/wiki/Elisha_Perkins, etc.
Even though tension headache has a psychological component, it's almost certain that the aspirin will work best, because it has a well known strong effect in this type of headache.
The placebos will probably all "work better than nothing", but they'll all be worse than the aspirin and all be about as good as each other.
It follows logically that you'd have to be silly to pay a lot of money for Perkins tractor therapy, because you could just get a "magic" pinto bean somewhere worth a fraction of a cent, swallow it, and get an equally good "effect".
Rolf · 21 August 2016
Robert, I hope you will see the wisdom of learning to know the enemy you are at war with. Below is the place to begin:
I tried to take the course some years ago, but to my dismay I found that I was too late. Age had got the better of me. It just took too much mental effort to digest the stuff and work out the right answers. (I am 86 now.)
Here is my advice to you, take this free course:
https://www.coursera.org/learn/genetics-evolution
Buyuk Aslan · 21 August 2016
First, I still see people separating phenomena into the distinct categories of "psychological" and "biological". They are the same. What is referred to as psychological is just the net output of all the biological processes. All of our thoughts/emotions/feelings result from the balance of neurotransmitters and neuronal output in our brains. Before anyone states that someone could then use this to excuse any behavior ("My brain's neuronal activity made me do it.") it is a two-way street. While our brain chemistry can alter behavior our behavior can also alter our brain chemistry. It is why cognitive behavioral therapy has some efficacy.
The Placebo Effect often crops up in treatment studies, especially in the area of drug addiction. As has been already pointed out, many times a patient will appear to do better because someone is simply paying attention to them. When I was in research, the clinical researchers would state that a pharmacological treatment for drug addiction would often show much better efficacy in an in-patient unit than for walk-in patients. The reason is that the in-patient subjects had people caring for them, showing interest in them, etc.. Of course, anyone with a drug addiction would feel better with that treatment alone.
With the improvement in imaging techniques we are increasing our understanding of brain function and the Placebo Effect. Studies imaging the brains of people suffering from depression revealed that people in which a placebo had efficacy showed increased activity in the pre-frontal cortex while in those patients in which drug treatment showed efficacy had decreased activity in the pre-frontal cortex. This shows that there are multiple brain pathways that can lead to the same output.
The question is why do some people show efficacy with placebos? What is it about their brain chemistry that results in a placebo showing efficacy?
I am abhorred by people passing off the Placebo Effect as some amazing therapy that the "evil" medical/pharmaceutical industry is suppressing. I also do not like it when people use mystical explanations to explain biological phenomena. There are studies in which the brains of monks in deep meditation are revealing really cool information on brain function. I am truly excited what future imaging studies will reveal about brain function. I expect many "mystical" phenomena to eventually be explained by sound scientific inquiry (bye bye crystals, pyramid sitting, etc.). Similar to how some religious beliefs have been explained away by science.
Bobsie · 21 August 2016
harold · 21 August 2016
Frank J · 21 August 2016
harold · 21 August 2016