Pathetic level of slavery to evidence

Posted 16 May 2011 by

Andrew Weil practices "alternative" medicine, that is, medicine for which there is no evidence of efficacy. Now, according to an article in the Los Angeles Times, he recommends that evaluations of the efficacy of a treatment include "[p]atient factors -- including how patients felt about the treatment, whether they can afford it and any evidence of a placebo response" (the words are those of the reporter, not Weil). Some of Weil's other recommendations, such as consideration of the funding source and possible unintended consequences, make sense, but "how patients felt about the treatment" is an invitation to peddle snake oil - maybe we should perform all clinical trials using red pills to get the best outcome. Paraphrasing Weil, the article goes on to say,

Medicine has become enslaved to "evidence-based" approaches that rely on randomized, clinical trials as the only measure of whether a treatment is valuable[.]

Enslaved to evidence-based approaches? Reminds me of nothing more than William Dembski's pathetic level of detail.

63 Comments

Joel · 16 May 2011

"Medicine has become enslaved to “evidence-based” approaches . . . "

Just like engineering, architecture, aviation, agriculture and seismology are 'enslaved' to "evidence-based" approaches. Evidence-based approaches have served these fields well--why abandon them in the case of medicine?

mrg · 16 May 2011

And, of course, the law ... "your honor, I would like to offer 'non-materialistic' evidence in favor of my client." "Denied."

Not to mention businesses, emergency response organizations, and absolutely the military: a warfighter that doesn't care about the real facts is going down in flames.

Glen Davidson · 16 May 2011

And don't get me started on how enslaved to evidence-based approaches the judiciary is.

Although, I always like to imagine IDiots and people like Weil being consistent in their anti-evidence shtick when accused of some serious crime. Do you think that any of them will clamor for the use of "revelation" or "it looks like he's guilty" when their own freedom is on the line?

Somehow, I think that they'll challenge every "non-materialistic" and "non-evidence-based" claim made against them, although they might very well try to use nonsense as a defense.

Nothing new there, though. They always demand rigorous evidence from others, while they feel exempt from the demands of scientific rigor themselves. They'll hold us to sound standards, it's just that they have "higher ways of knowing" than their opponents.

Glen Davidson

Stanton · 16 May 2011

Glen Davidson said: And don't get me started on how enslaved to evidence-based approaches the judiciary is. Although, I always like to imagine IDiots and people like Weil being consistent in their anti-evidence shtick when accused of some serious crime. Do you think that any of them will clamor for the use of "revelation" or "it looks like he's guilty" when their own freedom is on the line? Somehow, I think that they'll challenge every "non-materialistic" and "non-evidence-based" claim made against them, although they might very well try to use nonsense as a defense. Nothing new there, though. They always demand rigorous evidence from others, while they feel exempt from the demands of scientific rigor themselves. They'll hold us to sound standards, it's just that they have "higher ways of knowing" than their opponents. Glen Davidson
Unless they could be assured that the entire court was in their pockets, I think Intelligent Design proponents, the more cunning ones, at least, would avoid the courtroom like it was the radioactive plague. After all, you remember how Bill Dembski wanked on and on how he hoped and prayed to get the chance to put all those Evilutionists on trial, only for him to hide under a rock when the opportunity in Dover came knocking.

mrg · 16 May 2011

I think for any practical endeavor any complaints about "materialism" are silly: "Ya'll lost that battle a long time ago, people."

On that same coin, I do get a little weary of overblown claims for "Science" with a capital "S" ...
is it really any more or less "evidence-based" than any other practical exercise? And this commitment to
evidence is what exercises the critics. Again: "You've lost. You can complain forever but you can't
win. Get some sense and give it up."

Science Avenger · 16 May 2011

The people critical of "evidence-based approaches" can never answer the big question:

If you were wrong, how would you know it?

They simply assume that their internal truth detector is infallible. Gee, now where on earth do you suppose they were first introduced to that concept? So much for the "what's the harm" arguments.

eric · 16 May 2011

I suspect Weil would have the same problem defending his position in court that Behe had, when Behe proposed a broader definition of science. The opposing lawyer would get up, point out that sacrificing chickens on an altar could count under Weil's definition of "effective treatment," and that would be the end of it.

harold · 16 May 2011

Weil is eccentric but should not be confused with dangerous quacks. In no way does he try to replace or prevent mainstream therapy.

He openly recommends mainstream medicine for serious complaints.

Even where he recommends what he calls "integrative" or "alternative" stuff, it is often just evidence-based mainstream stuff.

His diet and exercise advice is 100% mainstream.

This is a guy who recommends eating lots of fruit and vegetables and fish oil, exercising, and managing stress, and using mainstream medicine if you get sick anyway.

He may do it in a funny robe with a big bushy beard, and he may charge tens of dollars for books that peddle glorified common sense and other arguably useless but fairly harmless products, and he may have made a very silly statement here, but he really is not a harmful figure.

If anything, he weans a lot of well-meaning but confused people off of harmful woo.

Mike Elzinga · 16 May 2011

One can’t help thinking of homeopathic dilutions that go far beyond the number of molecules that would have to be removed from a water solution in order to leave its “essence” imprinted in the water.

There is only one motto that fits that “science:” Nothing works.

eric · 16 May 2011

harold said: but he really is not a harmful figure.
I disagree. Weil quote from the article:
"The individual's belief system will affect the value of a treatment significantly and cannot be ignored."
I think Weil's statement is harmful to the public's understanding of science and medicine, because it teaches the opposite of what is true. What enlightenment science has discovered is that, to a very large extent, the individual's belief system can be ignored and will not affect the value of the treatment. And to the extent that Weil's statment is true, he is basically recommending doctors lie to their patients. That is really the only way to get the placebo effect to work for you - deceive the patient about what it is.

harold · 16 May 2011

eric - We'll have to partly agree and partly disagree.
I think Weil’s statement is harmful to the public’s understanding of science and medicine, because it teaches the opposite of what is true. What enlightenment science has discovered is that, to a very large extent, the individual’s belief system can be ignored and will not affect the value of the treatment.
I agree with you but perceive a difference between having made this statement, and being harmful. I don't agree with everything Weil says but I do agree with his preventative and therapeutic recommendations - in fact, I have to, because for all his talk about "belief systems", his actual medical recommendations are supported by the literature. If a patient goes to Weil, they will receive a recommendation that they eat what is strongly supported as a healthy diet, and undertake healthy exercise. If they are ill, he will recommend standard therapy. Eccentricity in personal beliefs is not grounds to label a physician harmful to the public. If there was any evidence that Weil recommended not giving appropriate therapy to patients with certain "belief systems", I would massively condemn him, but he does not cross that line (or even come close to doing so).
And to the extent that Weil’s statment is true, he is basically recommending doctors lie to their patients. That is really the only way to get the placebo effect to work for you - deceive the patient about what it is.
If Weil recommended knowingly lying to patients, that would be a very serious breach of ethics. I have no reason to think he does that. The only medically indicated use of placebos is in controlled studies, and the patients know that they may be getting the placebo in those studies, and understand the reason for the randomization.

Stuart Weinstein · 16 May 2011

Stanton said:
Glen Davidson said: And don't get me started on how enslaved to evidence-based approaches the judiciary is. Although, I always like to imagine IDiots and people like Weil being consistent in their anti-evidence shtick when accused of some serious crime. Do you think that any of them will clamor for the use of "revelation" or "it looks like he's guilty" when their own freedom is on the line? Somehow, I think that they'll challenge every "non-materialistic" and "non-evidence-based" claim made against them, although they might very well try to use nonsense as a defense. Nothing new there, though. They always demand rigorous evidence from others, while they feel exempt from the demands of scientific rigor themselves. They'll hold us to sound standards, it's just that they have "higher ways of knowing" than their opponents. Glen Davidson
Unless they could be assured that the entire court was in their pockets, I think Intelligent Design proponents, the more cunning ones, at least, would avoid the courtroom like it was the radioactive plague. After all, you remember how Bill Dembski wanked on and on how he hoped and prayed to get the chance to put all those Evilutionists on trial, only for him to hide under a rock when the opportunity in Dover came knocking.
And still pocketed what $20K is consulting fees? Dembski will swallow his pride for money.

Stuart Weinstein · 16 May 2011

harold said: Weil is eccentric but should not be confused with dangerous quacks. In no way does he try to replace or prevent mainstream therapy. He openly recommends mainstream medicine for serious complaints. Even where he recommends what he calls "integrative" or "alternative" stuff, it is often just evidence-based mainstream stuff. His diet and exercise advice is 100% mainstream. This is a guy who recommends eating lots of fruit and vegetables and fish oil, exercising, and managing stress, and using mainstream medicine if you get sick anyway. He may do it in a funny robe with a big bushy beard, and he may charge tens of dollars for books that peddle glorified common sense and other arguably useless but fairly harmless products, and he may have made a very silly statement here, but he really is not a harmful figure. If anything, he weans a lot of well-meaning but confused people off of harmful woo.
Isn't this the sap who is responsible for a drop in the number of kids getting immunized because of a bogus claim that compounds in vaccinations caused autism? He's a weapon of mass destruction.

Stuart Weinstein · 16 May 2011

Stuart Weinstein said:
harold said: Weil is eccentric but should not be confused with dangerous quacks. In no way does he try to replace or prevent mainstream therapy. He openly recommends mainstream medicine for serious complaints. Even where he recommends what he calls "integrative" or "alternative" stuff, it is often just evidence-based mainstream stuff. His diet and exercise advice is 100% mainstream. This is a guy who recommends eating lots of fruit and vegetables and fish oil, exercising, and managing stress, and using mainstream medicine if you get sick anyway. He may do it in a funny robe with a big bushy beard, and he may charge tens of dollars for books that peddle glorified common sense and other arguably useless but fairly harmless products, and he may have made a very silly statement here, but he really is not a harmful figure. If anything, he weans a lot of well-meaning but confused people off of harmful woo.
Isn't this the sap who is responsible for a drop in the number of kids getting immunized because of a bogus claim that compounds in vaccinations caused autism? He's a weapon of mass destruction.
Oopps spoke to soon. Wrong dude. Apologies to Dr. Weil Stuart

harold · 16 May 2011

Stuart Weinstein -

I believe you're thinking of this repugnant slimeball.

Glen Davidson · 16 May 2011

Weil is a horrifying charlatan pretending that patient beliefs change the outcome of cancer treatments:
Finally, two of the more pernicious proposals in Weil’s paper are related. First, he repeats his explicit argument for favoring placebo medicine: Given the history and philosophical preferences of allopathic medicine, it should come as no surprise that the factors defining the healing response become minimized or ignored in current practice. This failing must be remedied, as these factors account for a huge component of how humans heal and recover. The healing relationship has taken a much larger role in IM as practitioners in nearly all CAM modalities place a much higher emphasis on it. The importance of these issues can be demonstrated most clearly in psychiatry research, where the placebo response plays a huge role accounting for as much as 40%–90%+ of the total response.26

Significant placebo and expectancy responses inhabit other areas of medical practice, such as dealing with pain and even life expectancy in patients with terminal cancer. Clearly, patient factors must compose a significant part of all treatment selection processes. Ideally, every treatment should be matched to the individual’s belief system to reach the highest level of response possible.
Aside from stating, “CAM is placebo medicine, and we should use placebo medicine when it fits in with patient beliefs,” a more explicit admission that what is being proposed in this opinion piece is placebo medicine I cannot imagine. Worse, it’s based on misinformation, the most egregious of which is Weil’s claim that placebo and expectancy effects can increase life expectancy in patients with terminal cancer. Would that it were true, but unfortunately it’s not, either in late stage cancer or early stage cancer. Nor is there any evidence that it has an effect on recurrence.
Weil exposed Not surprising, given his idiotic attack upon "'evidence-based' approaches." Glen Davidson

truthspeaker · 16 May 2011

I wonder how Dr. Weil knows when to put fuel in his car? Does he do it when it feels like the right time, or is he enslaved to an evidence-based approach that says looking at the fuel gauge is the only way to tell if his car needs gas?

truthspeaker · 16 May 2011

harold | May 16, 2011 2:34 PM | Reply | Edit Weil is eccentric but should not be confused with dangerous quacks. In no way does he try to replace or prevent mainstream therapy. ... He may do it in a funny robe with a big bushy beard, and he may charge tens of dollars for books that peddle glorified common sense and other arguably useless but fairly harmless products, and he may have made a very silly statement here, but he really is not a harmful figure.
Encouraging people to spend money out of their health care budget on useless products is harmful.

truthspeaker · 16 May 2011

...and you can't wean people off of more harmful kinds of woo by telling them that woo works.

Chris Lawson · 16 May 2011

This topic is right up my alley as I teach EBM to medical students and GP registrars.

On reading the article in LA Times, I think it is fair to say that the only objectionable statements were made by the reporter rather than quotes from Weil. For instance:

"Medicine has become enslaved to 'evidence-based' approaches that rely on randomized, clinical trials as the only measure of whether a treatment is valuable, Weil and his co-authors wrote."

The original paper (Scott Shannon, Andrew Weil, Bonnie J. Kaplan. Alternative and Complementary Therapies. April 2011, 17(2): 84-91. doi:10.1089/act.2011.17210 -- as the reporter couldn't be bothered to provide a proper reference) says nothing of the sort. It does make some (IMO very dubious) claims about over-emphasis of randomised control trials, but the paper recommends a grading scale of evidence for effectiveness in which the top 3 levels are based on RCTs.

The LA Times article also fails to recognise that the standard medical tiers of evidence already include non-RCT studies, such as case-control and cohort studies. The paper that first linked tobacco to lung cancer was a famous 1950 case-control study by Doll and Hill (they thought that tarmac or motor vehicle exhaust fumes caused lung cancer and discovered to their surprise that the only strong association was with cigarette smoking) and supported by the 1954 British Doctors Study, a cohort study. No RCTs in sight.

There are still many statements in the paper that I would dispute, but they are not on the same scale as the LA Times article suggests. In fact, the article pretty much misses the point of the paper, which calls for a different approach to weighing evidence, while the reporter has reconstructed it as a "mainstream evidence is bunkum" narrative.

Gary Hurd · 16 May 2011

The first post doctoral proposal I wrote was for a study of the ethnopharmacology of coca use in Peru. That was in 1976, and I became acquainted with Andy Weil, and some others like Tim Plowman at Harvard, who were of the opinion that the "war on drugs" was really a war on ourselves, and particularly a war on minorities. The DEA was then, as now, merely an armed branch of the political and religious far-right. DEA "enforcement" was then just moving into armed foreign operations in South America targeting "communists" whether or not they were involved with drug production.

The DEA became particularly enraged with Weil when he pointed out that the "war" was already lost when the quality illegal drugs like heroin went up, and the street price went down. Andy also observed anyone in the USA who had the least interest in taking heroin, cocaine, or any other drug could find a ready supply anywhere! As an MD, he was particularly vulnerable to DEA pressure. He would not retract his (obviously true) statements that drug use, drug abuse, and drug addiction were not the same thing, and that this is a medical question that cannot be "treated" with guns and prisons. (That was true 35 years ago, and it is true today). The DEA retaliation was to deny Weil a schedule II drug license so that he was effectively prevented from practicing medicine.

My opinion was that this led Andy to two rather profound questions; "What is medical practice beyond giving people shots and pills?" and "What can I do to earn a living?"

The answer to both questions was that he teach people that prevention is better than any medicine by writing books, giving talks and to sell this with a degree of flamboyance.

Some of the specific misunderstandings about medical practice, "evidence based" or not, that I have seen in the posts so far will wait until after my dinner.

rrich · 16 May 2011

Weil and co-authors illustrate the simple point that medical research, like science generally, is always an interested endeavor. Always conducted in social and cultural context (Laura Nader 1996 Naked Science). I have intimate experience with a close family member diagnosed with Multiple Sclerosis. The treatments for MS (Rebif and Copaxone) have proven largely ineffective in controlling both the occurrence of her lesions and the symptomology of the disease. We have pursued information on other treatments, but very little is establishment-sanctified. Big Pharma is the interested actor here, which pays for and conducts almost all the cited research on MS treatments. There are few "scientific" studies, for instance, on the effect of diet on MS, despite strong anecdotal evidence that diet can play a significant role in both lesion count and symptomology. See Terry Wahls’ work and her book Minding my Mitochondria if you are interested. Why would a pharmaceutical company conduct or fund a study on the effects of diet on MS when none of their products would be used, and in which a treatment could be found that would actually subvert their own research-based products? They wouldn’t, and no one would expect them to. However, as patients, our family has grown increasingly frustrated with seemingly narrow self-interested approaches to the MS research problem by a mainstream science that cannot provide answers to easy and basic questions. Our specialist does not dismiss the efficacy of diet as treatment for MS. But when we ask him about it he says he doesn’t know much about it. There is little accepted clinical research on diet and MS, and little of what there is makes it to the literature with which he is familiar. I agree with Lawson above that the LATimes reporter recontextualizes the article in a standard narrative format and misses the more interesting point of the article on an alternative system of weighing evidence of efficacy that includes funding, accessibility of the treatment, and other patient factors. Medicine and the scientific research upon which it is based is today too much a closed paradigmatic corporate loop in the worst Kuhnean sense. A critique of science and medicine as socially interested and invested in certain kinds of (pharmacological) results is one part of a healthy understanding of contemporary medicine and science.

harold · 16 May 2011

rrich -
Weil and co-authors illustrate the simple point that medical research, like science generally, is always an interested endeavor. Always conducted in social and cultural context (Laura Nader 1996 Naked Science).
Okay, that's a reasonable statement.
I have intimate experience with a close family member diagnosed with Multiple Sclerosis.
Best wishes. That's a tough disease to deal with.
The treatments for MS (Rebif and Copaxone) have proven largely ineffective in controlling both the occurrence of her lesions and the symptomology of the disease.
That sucks. Modern therapy has benefited many patients, but there's still a lot to learn.
We have pursued information on other treatments, but very little is establishment-sanctified. Big Pharma is the interested actor here, which pays for and conducts almost all the cited research on MS treatments. There are few “scientific” studies, for instance, on the effect of diet on MS, despite strong anecdotal evidence that diet can play a significant role in both lesion count and symptomology.
I don't follow your logic. You seem to think that because pharmaceutical companies do research on their own products, no-one else can ever do any other type of research. That doesn't make sense to me.
See Terry Wahls’ work and her book Minding my Mitochondria if you are interested. Why would a pharmaceutical company conduct or fund a study on the effects of diet on MS when none of their products would be used, and in which a treatment could be found that would actually subvert their own research-based products? They wouldn’t, and no one would expect them to.
1) Terry Wahls certainly isn't being censored or suppressed, or prevented from seeking funding for a clinical study. She's on faculty at a highly prestigious medical school. 2) Her dietary advice is probably beneficial for overall health, for most people, at least based on current understanding of diet and health. Whether it does any good for MS I don't know. It might. MS is a notoriously waning and waxing disease, as I'm sure you already know. I'm sure you can see how that could lead to false attributions of improvement to something random, when they were just the natural course of the disease. The next step is a controlled trial. Of course, there can't be a placebo in a trial that tests a diet, and if whoever is testing the diet is convinced that it works, they might feel that it was unethical to even have a control group. Within those limitations, though, I don't see any rationale for failing to do some kind of controlled, organized scientific study.
However, as patients, our family has grown increasingly frustrated with seemingly narrow self-interested approaches to the MS research problem by a mainstream science that cannot provide answers to easy and basic questions.
I don't think of MS or any other autoimmune disease as posing "easy" or "basic" questions. But if you think the questions are so easy and basic, why don't you just answer them yourself? Meanwhile, Wahl does make her dietary recommendations very explicit, and although I have no idea whether they help MS or not, they're certainly unlikely to be harmful. So if you think she's right, why don't you just do what she recommends? My understanding, and please correct me if I'm wrong, is that she doesn't try to replace conventional therapy, but does suggest that a dietary strategy, one that is compatible with what we currently believe to be a healthy diet, can help.
Our specialist does not dismiss the efficacy of diet as treatment for MS. But when we ask him about it he says he doesn’t know much about it. There is little accepted clinical research on diet and MS, and little of what there is makes it to the literature with which he is familiar.
That's all true, but you don't need a prescription at the grocery store. If you think that a nutrient rich diet will help, eat one. And tell your specialist when you start, so that if unusual benefit is noted, he can report the anecdote. Sometimes that's how research gets started.
I agree with Lawson above that the LATimes reporter recontextualizes the article in a standard narrative format and misses the more interesting point of the article on an alternative system of weighing evidence of efficacy that includes funding, accessibility of the treatment, and other patient factors.
I sort of agree here, except that I believe that rich societies like the US should assure that every man, woman and child has access to the indicated treatment for every disease.
Medicine and the scientific research upon which it is based is today too much a closed paradigmatic corporate loop in the worst Kuhnean sense.
Here I disagree. There is plenty to criticize, but buzzwords and conspiracy theories don't add anything.
A critique of science and medicine as socially interested and invested in certain kinds of (pharmacological) results is one part of a healthy understanding of contemporary medicine and science.
Yes it is indeed. Yet a persistent claim of harmful if not predatory quacks (and I don't mean Weil, nor Wahl, who I believe is at worst sincere in a mistaken belief that a diet that is overall beneficial will help MS, and may even be partly correct), is that some kind of perfectly healthy diet or lifestyle will perfectly prevent, or, in the case of real criminal predators, cure, clinical disease. Often, insultingly simplified stereotypes of hunter gatherer societies or others are created in support of such claims. To which I reply - 1) Yes, it is true that "western medicine" has historically focused on "treatment", rather than prevention. There is a reason for this - at any given time, there are millions of people who need the treatment. Furthermore, much of the prevention is extremely well known, yet there is nothing the medical profession can do to force people to prevent. 2) Fortunately, there are people who do try to lead healthy lifestyles, although in my view, many of them go overboard into obsession and well past the point of diminishing returns. Plenty of them get sick anyway. Less often, overall, than of the people who don't take care of themselves, but it's a question of statistical advantage, and there are many other factors. 3) Everyone who claims to prevent or cure all diseases, or even a particular disease, is free to do everything in their power to objectively test their claims. Vast numbers of people seek to make such claims, yet evade such testing. Good luck with the MS. I hope I don't come across as rude or hostile, that's not my intent.

Gary Hurd · 16 May 2011

Well, Andy's employment problem was resolved at the U. of Arizona. The question of how do we measure patient outcome visa-vis drug trials was not so easily resolved.

Let me give a personal experience: some years ago I was prescribed a medicine by a urologist to prevent vomiting during treatment for a kidney disease. The drug had passed all kinds of trials with flying colors- except it did not prevent me from vomiting. And, when I did, it was a particularly nasty tasting blue vomit, much worse than the ordinary unmedicated stuff.

This is the difference between an “evidence-based” double-blind drug trial, and a clinical result.

Mike Elzinga · 16 May 2011

rrich said: Medicine and the scientific research upon which it is based is today too much a closed paradigmatic corporate loop in the worst Kuhnean sense. A critique of science and medicine as socially interested and invested in certain kinds of (pharmacological) results is one part of a healthy understanding of contemporary medicine and science.
There are other complicating factors. Many similar diseases - like Gaucher’s disease or Pompe’s disease, or ALS, or Friedreich’s Ataxia – are often referred to as “orphan diseases” because the research on them not only involves relatively small populations, but the development of drugs to slow or stop the progress of these diseases is agonizingly difficult and expensive. Clinical trials with drugs under development involve extremely complicated protocols of bringing people from around the globe to a relatively few locations where they can be given treatments and evaluated on the effects of those treatments. It means setting up teams of investigators, evaluators, and coordinators who make sure research protocols are followed and patients are protected. Companies such as Genzyme take a huge financial risk in developing drugs, become a sole source (until some other company steps in and takes similar risks), and then has a disastrous contamination problem that shuts them down for months while patients desperately try to hang on. Understanding diseases is not accomplished by simply scatter-shot approaches and anecdotal reports and testimonials. The best these can do is in providing leads; but more often than not, they send people off on wild goose chases. It is an extremely complex process of not only identifying the disease, but sorting through literally hundreds of complicating factors that vary greatly from individual to individual. I get first hand reports of this from a close relative who is a clinical research coordinator in the clinical research trials on a couple of these diseases.

Gary Hurd · 16 May 2011

Mike Elzinga, you support you promotion of "factual," "empirical," "scientific" medicine with "first hand reports of this from a close relative?"

This is not the "factual,"empirical," or "scientific" evidence that the Holy Church of the Double-Blind accepts. These "first hand reports of this from a close relative" are exactly the anecdotal data that purely "scientific" medicine rejects, exactly like to many "scientific" doctors reject their patient's actual clinical experiences. (You cannot die, I used medicine to cure you!) Are we to practice medicine as physicians, or statistics undergrads?

Gary Hurd · 16 May 2011

Damn! I hate typos, even with the preview they slip by. Then seconds later, they are glaring, mocking me.

you(r)

to(o)

Mike Elzinga · 17 May 2011

Gary Hurd said: Mike Elzinga, you support you promotion of "factual," "empirical," "scientific" medicine with "first hand reports of this from a close relative?" This is not the "factual,"empirical," or "scientific" evidence that the Holy Church of the Double-Blind accepts. These "first hand reports of this from a close relative" are exactly the anecdotal data that purely "scientific" medicine rejects, exactly like to many "scientific" doctors reject their patient's actual clinical experiences. (You cannot die, I used medicine to cure you!) Are we to practice medicine as physicians, or statistics undergrads?
It’s not just the relative. I’ve personally met many of the patients; many of whom are college educators, lawyers, engineers, and researchers themselves. I have met them on several occasions and in two different cities. They are a well-organized and well-informed community of people who have been in these studies for a number of cycles now. They know the principle investigators, the companies and company executives; and they have suffered through the problems of depending on a single company that ran into production problems and bungled its relationships with the investigators, coordinators, and patients. I’ve followed some of the issues in the press as well as from other inside sources. And the patients have been very open about their experiences, frustrations, and personal feelings. The studies are all double blind and have to meet federal regulatory standards and frequent reviews; and the patients understand that. We have had discussions about protocols and some of the problems that people in the companies have in understanding and building such protocols. It is often a mess because of the shortage of qualified people who understand the processes of setting up research protocols. That doesn’t mean I or the patients sympathize with the companies and their profit motives. Nevertheless, given the nature of their diseases, most patients recognize the difficulties and risks that the companies take when plunging into the development of drugs for orphan diseases. These patients also work with the research coordinators and investigators to encourage other companies to get involved. It has been only recently that the much larger companies that have huge research budgets have gotten into the field for these diseases. Until about 4 or 5 years ago, only the smaller start-ups with promising results have been working on these and applying for clinical trials. More companies are now getting into the act. So what I see in this picture is not a one-sided picture of companies and doctors screwing patients for profit. It is messy, involving the screw-ups of shipping companies who have nothing to do with the research but who misrepresent their abilities to get vital, perishable test results, supplies, and medications to the proper locations on time. It involves insurance companies with bureaucrats and drones who can’t get paperwork done on time or who balk at insuring patients who get into these kinds of studies. It involves personnel turnover, changes in the laws, inexperience and incompetence, and overworked staff in many organizations that have to work together, and who all have other things going on simultaneously. It involves inefficient record keeping and the lack of interlinked computer systems and electronic data records. The cartoon Dilbert could apply to some of what goes on; but the process of trying to keep all this mess functioning is pretty much like what we find in many companies, universities, legislative bodies, churches, military organizations, and governments. It’s people attempting to do too much with too little, and trying to do it in the face of constantly changing rules and regulations and budget problems. But from what I can tell, the people directly involved with the patients really do care. One of the most inspiring things I learned from the patients is that it really helps to be involved in a network of other patients with the same disease. That way they keep each other informed and become active in not only keeping the researchers, coordinators, federal monitors, and companies on their toes, but who also make sure other patients get new information as soon as it becomes available. And this is also part of a coordinator’s job; to not only refine protocols and coordinate with the government regulators and monitors, but to keep in close touch with the patients and see that their individual needs are met. As for the patients, that relative I mentioned also makes sure that any new people who enter studies are put in contact with those patient organizations. It helps to keep them informed and brings them into a community of others who have also lived with the disease. And that is generally a recommendation for anyone who suffers from any form of disease.

The Founding Mothers · 17 May 2011

Harold, I think you do a great job of responding to to rrich. I'd like to add a little something though:
Harold said:
1) Yes, it is true that “western medicine” has historically focused on “treatment”, rather than prevention. There is a reason for this - at any given time, there are millions of people who need the treatment. Furthermore, much of the prevention is extremely well known, yet there is nothing the medical profession can do to force people to prevent.
In fact, vaccination is arguably an excellent example of a highly successful preventative medical programme. In many cases, children will only be accepted into an education system if they have an up-to-date vaccination schedule. Whether it's the 'medical profession' who forces participation in this is arguable, but I for one think it's a very good thingTM.

truthspeaker · 17 May 2011

This is a guy who recommends eating lots of fruit and vegetables and fish oil, exercising, and managing stress, and using mainstream medicine if you get sick anywa
Yes, and so does my doctor, but she doesn't peddle nonsense on top of it.

harold · 17 May 2011

Gary Hurd -
I was prescribed a medicine by a urologist to prevent vomiting during treatment for a kidney disease. The drug had passed all kinds of trials with flying colors- except it did not prevent me from vomiting. And, when I did, it was a particularly nasty tasting blue vomit, much worse than the ordinary unmedicated stuff.
What this apparently means is that, in a large group of patients, under certain circumstances, the drug had a statistically significant effect of reducing (not necessarily eliminating) vomiting. In your individual case, it seems not to have helped. This does not mean that the drug did not reduce vomiting, relative to controls, in the study. To see how good the effect really was, I'd have to see the published report of the study. (I wonder if it was tested against medical marijuana or THC based products, which can be excellent anti-emetics. But anyway.) For Everyone - A double blind study is nearly always the best way to test whether a particular treatment is better than the control treatment (which may be, but is not necessarily, a placebo), under a defined set of conditions. In no way, shape, or form are physicians limited to the use of treatments that have been studied in double blind conditions, nor should they be. Penicillin was never double blind studied, because it was immediately obvious that it worked dramatically compared to the alternative of no antibiotics, and that denying it would be unethical. Aspirin has been double blind studied for a number of indications, but was known to be effective for "tension" headaches for at least a century before any studies were ever done. The FDA does not regulate the clinical practice of medicine. The FDA regulates, among many other things, medical product claims. Gary Hurd's drug manufacturer could not make the claim that the drug reduces vomiting without submitting adequate trial results to the FDA. The clinical practice of medicine is an applied scientific profession. Judgment is required. Where there are known, definitive tests and therapies that are clearly indicated, it is malpractice to use something else that isn't as good. It is highly, highly unethical to deliberately offer placebo, as well (note that respecting, sharing, or simply not bothering to deny a patient's cultural beliefs is not "offering placebo", and deliberately antagonizing the cultural beliefs of an ill, vulnerable patient might be grossly unethical in some circumstances). However, there are times when judgment is required.

truthspeaker · 17 May 2011

Harold, it almost seems like you are saying that human bodies are enormously complex things, and that a drug that works for a large majority of people won't work for everybody. What a radical concept!

~

mrg · 17 May 2011

The Founding Mothers said: In fact, vaccination is arguably an excellent example of a highly successful preventative medical programme. In many cases, children will only be accepted into an education system if they have an up-to-date vaccination schedule. Whether it's the 'medical profession' who forces participation in this is arguable, but I for one think it's a very good thingTM.
I have to laugh because I was just over at WIRED Online, which was running an article on antivaxers coming up with a bogus survey to demonstrate an autism-vaccine link. Anyway, someone cited stats showing that the risks of dying of measles were like about three orders of magnitude (or suchlike) greater than dying of the MMR vaccine. Somebody shot back that such a statistic was misleading because the rate of measles infection was so low. I was flabbergasted and HAD to reply: "That's because of vaccines. I recall I had measles when I was a kid. Back in the day, measles, mumps, and chicken pox were normal childhood diseases. They aren't any more." Wouldn't the OFs (Old Farts) here concur with that recollection?

eric · 17 May 2011

harold said: The FDA regulates, among many other things, medical product claims. Gary Hurd's drug manufacturer could not make the claim that the drug reduces vomiting without submitting adequate trial results to the FDA.
Unfortunately, submission of results is entirely voluntary and thus open to abuse. A company can conduct 10 trials, get positive results in only 1 of them, and then submit only that trial's results to the FDA - making the drug appear far more effecacious than it is. Personally, I'd like to see the FDA institute two rules: (1) the FDA will only consider results of trials registered with them before the trial is conducted, and (2) the FDA will count non-submission of a registered trial's results (after some reasonable time to complete it) as a negative result. Relating this back to Weil's comments, while RCT's probably always will be (and should be) the gold standard, there is no reason why companies couldn't submit other types of studies if an RCT is impossible. Medicine is just like physics or chemistry - there is no absolute bar in experimental design that we need to jump over, but we should always be striving to perform the best experiments we can.

truthspeaker · 17 May 2011

mrg, I'm "only" 40, and chicken pox was a very common childhood disease when I was a kid. Despite being exposed several times as a child, I never actually contracted it until I was 16.

hoary puccoon · 17 May 2011

mrg said:
The Founding Mothers said: In fact, vaccination is arguably an excellent example of a highly successful preventative medical programme. In many cases, children will only be accepted into an education system if they have an up-to-date vaccination schedule. Whether it's the 'medical profession' who forces participation in this is arguable, but I for one think it's a very good thingTM.
I have to laugh because I was just over at WIRED Online, which was running an article on antivaxers coming up with a bogus survey to demonstrate an autism-vaccine link. Anyway, someone cited stats showing that the risks of dying of measles were like about three orders of magnitude (or suchlike) greater than dying of the MMR vaccine. Somebody shot back that such a statistic was misleading because the rate of measles infection was so low. I was flabbergasted and HAD to reply: "That's because of vaccines. I recall I had measles when I was a kid. Back in the day, measles, mumps, and chicken pox were normal childhood diseases. They aren't any more." Wouldn't the OFs (Old Farts) here concur with that recollection?
I'm way over 40, although I don't like the term Old Fart, thank you very much. My daughter, who is also over 40, remembers two family members whose lives were shortened by after-effects of polio. One was a paraplegic. The other seemed for years to have made a complete recovery-- and then, her nerves just slowly shut down. In the end, she couldn't even swallow. It was horrifying to watch. As a result, my daughter has become very vocal about the need for vaccines. But when the only people who remember are over forty, what can you do to convince the youngsters?

mrg · 17 May 2011

hoary puccoon said: I’m way over 40, although I don’t like the term Old Fart, thank you very much.
I'm ditto, and I like it. But then, nobody ever accused me of excessive formality. It is a common claim of antivaxers that since nobody gets sick any more of diseases for which there are effective vaccines, there's no reason to vaccinate any more. Pointing out the circularity of this logic is inevitably lost on them.

TomS · 17 May 2011

mrg said: Anyway, someone cited stats showing that the risks of dying of measles were like about three orders of magnitude (or suchlike) greater than dying of the MMR vaccine. Somebody shot back that such a statistic was misleading because the rate of measles infection was so low.
I don't understand this objection. Could someone just explain why if the rate of measles infection is low that invalidates the comparison?

mrg · 17 May 2011

I'm not following the objection to the objection. Clarify please?

mrg · 17 May 2011

BTW: By "risks of dying of measles" that means "risk of dying if you contract it" and not "risk of a nominally healthy person ultimately dying of measles".

harold · 17 May 2011

TomS and mrg -

In fact, the most correct statistic to use is usually "risk of a healthy person in a vaccinated population dying (or suffering whatever complication you want to use) from getting the vaccine, versus the risk of a healthy person in an unvaccinated population ever getting measles and dying (or getting a super-nasty complication or whatever)".

While vaccine denialists justify their behavior by claiming vaccines are dangerous, what mrg was presented with is actually the "free ride" argument.

The flawed logic is "you get your kid vaccinated and risk the side effects, I'll skip the vaccination, but there won't be anybody for my kid to get measles from, so I get a free ride - you take all the risk and I share the benefits".

Why is this logic flawed? It sounds cynical but valid.

Here's the problem with it - the viruses we vaccinate against are incredibly infectious. The risk from vaccination is very, very low.

Once you get, say, measles, the risk of severe complications is somewhat low, but massively higher than the risk from a vaccine. So you only need to have a very low probability of getting measles for the free ride strategy to have a negative expected value.

As soon as...

p(getting measles)*(bad outcome from measles) is greater than p(bad vaccine outcome)...

the "free ride" strategy isn't "free".

Let's put some numbers in there, using "death" as "bad outcome" for simplicity. For simplicity I'm going to assume that vaccinated people don't ever get measles. That's not strictly true, but this is a simplified model. Let's assume we're looking at a ten year period, also to keep it simple.

With ideal medical care, a measles patient still has a 1/1000 chance of dying! (The mortality rate is much higher where optimal medical care is not available, which is most depressing, since optimal medical care is mainly palliative and controlling opportunistic infections.)

There is not even a clear death rate assignable to completing an MMR vaccine schedule, but let's call it one in ten million, which is probably very high. Typically, studies just don't record enough deaths to get really reliable fatality rate.

As you can see, in this model, as soon as chances of contracting measles goes over 1/10,000, the "free rider" is actually losing - his chances of dying of measles are already higher than his chances were of dying of the vaccine. That is, if he's walking around healthy but has a 1/10,000 chance or better of getting measles, his strategy loses.

And measles is very, very contagious. Literally everybody used to get it. And it is endemic all over the world; it isn't close to being eradicated.

So in short, the free ride strategy is only a free ride is virtually no-one uses it. I don't know what the threshold percentage of kids skipping vaccines is, to make the "free ride" strategy negative - no-one does - but it's almost certainly being exceeded in the US.

In fact, the presence of "free riders" is actually strong motivation to be really sure to get vaccinated.

mrg · 17 May 2011

harold said: In fact, the most correct statistic to use is usually "risk of a healthy person in a vaccinated population dying (or suffering whatever complication you want to use) from getting the vaccine, versus the risk of a healthy person in an unvaccinated population ever getting measles and dying (or getting a super-nasty complication or whatever)".
The stats in the posting I referred to compared the risk of complications if you get vaccinated versus the risk of dying if you get measles. However, you are correct, that boils down after factoring in full considerations to your argument and the bottom line: no matter how you slice it, all stats say that the odds are against the antivaxer. Antivaxers like to trumpet the "individual freedom of choice" angle, but that ignores the fact that, by creating a potential disease vector, it's not an "individual choice" any more. Would we regard an HIV-positive person who refused to practice safe sex as ethical? To be sure, that's a much more extreme case, but I think few would agree that would be ethical.

mrg · 17 May 2011

I might add that antivaxers like to play games with stats and it is nice to be able to see through them.

As Jeff Shallit put it: "Probability calculations are the last refuge of a scoundrel."

harold · 17 May 2011

Fake probability calculations, that is.

Valid probability calculations are a useful tool.

Gary Hurd · 17 May 2011

Speaking form a fully accredited geezer perspective, I grew up with plenty of kids who suffered various degrees of polio injury. I also had a few kinds of measles, and chicken pox, mumps, whopping cough, and scarlet fever, and valley fever- all before I was 12.

There was concerned commentary in the 1800s that "medical advances" were producing a weakened "national stock" by preserving the lives of "weak" children who would have died of common diseases. In Chapter 5 of the Decent of Man, Darwin wrote regarding the protection of the poor, weak, and ill, “Nor could we check our sympathy, even at the urging of hard reason, without the deterioration in the noblest part of our nature. The surgeon may harden himself whilst performing an operation, for he knows that he is acting for the good of his patient; but if we were to intentionally neglect the weak and helpless it could only be for a contingent benefit, with an overwhelming present evil.”

Shebardigan · 17 May 2011

mrg said: I was flabbergasted and HAD to reply: "That's because of vaccines. I recall I had measles when I was a kid. Back in the day, measles, mumps, and chicken pox were normal childhood diseases. They aren't any more." Wouldn't the OFs (Old Farts) here concur with that recollection?
I am now arrived at the "Will You Still Feed Me?" age, and testify that I had all three. Really looking forward to the shingles.

harold · 17 May 2011

Gary Hurd said: Speaking form a fully accredited geezer perspective, I grew up with plenty of kids who suffered various degrees of polio injury. I also had a few kinds of measles, and chicken pox, mumps, whopping cough, and scarlet fever, and valley fever- all before I was 12. There was concerned commentary in the 1800s that "medical advances" were producing a weakened "national stock" by preserving the lives of "weak" children who would have died of common diseases. In Chapter 5 of the Decent of Man, Darwin wrote regarding the protection of the poor, weak, and ill, “Nor could we check our sympathy, even at the urging of hard reason, without the deterioration in the noblest part of our nature. The surgeon may harden himself whilst performing an operation, for he knows that he is acting for the good of his patient; but if we were to intentionally neglect the weak and helpless it could only be for a contingent benefit, with an overwhelming present evil.”
Darwin was a very humane and ethical man by the standards of his time, and in many ways, by the standards of any time. I'm barely at mid-life crisis age, but I had chicken pox, and I have a cousin who's one month younger than me who has had shingles. Supposedly I had a bad case of chicken pox, but I can't remember it. I had the mumps, too. That was common enough in the 1970's that I correctly self-diagnosed myself at around the age of 9. Pre-pubescent mumps is no big deal but I urge all adult males to be sure they have had either the disease or the vaccine, lest they contact it as adults and experience a severely painful condition. Note that if you are unfortunate enough to get mumps as a young buck, you still have 70% chance of salivary gland-only involvement, but those aren't the greatest odds. Also, even if you do show up in the ER begging them to tell you why your cojone is massively swollen and agonizingly painful, you still have an excellent chance of recovering full fertility. I still don't recommend messing with any of this. Overall, both chicken pox/shingles and mumps are mainly diseases of nasty symptoms but low risk of permanent damage (measles is far more dangerous), but not recommended.

Chris Lawson · 18 May 2011

If anti-vaxxers claimed that we should not vaccinate children against diseases that no longer carry a significant burden in the community, they would be absolutely right and would be completely in line with standard medical opinion. This is, after all, why we no longer vaccinate against smallpox (which has been eradicated in the wild) and in Australia we no longer routinely vaccinate against TB (which has not been eradicated and even occurs occasionally in Australia, but is so rare here that it is not worth vaccinating every child).

The problem comes when anti-vaxxers lie about the evidence. I will not go through all the common anti-vax fallacies except to say that there is a surprising overlap with anti-evolution fallacies.

raven · 18 May 2011

My daughter, who is also over 40, remembers two family members whose lives were shortened by after-effects of polio. One was a paraplegic. The other seemed for years to have made a complete recovery– and then, her nerves just slowly shut down. In the end, she couldn’t even swallow. It was horrifying to watch.
Post polio syndrome. It's been hitting for a few decades now. I'm a boomer and remember getting the polio vaccine. But in my grade school, one kid didn't come in one day. Rumor had it he contracted some infectious disease. And later died of it. We all said it was polio but kids, who knows? There were a lot of older people who survived polio. You could tell because they limped a lot in various ways.

Sylvilagus · 18 May 2011

raven said: There were a lot of older people who survived polio. You could tell because they limped a lot in various ways.
Or worse. the mother of my best friend in kindergraten (~1966)survived polio but was paralyzed from the waist down and used a wheelchair.

Karen S. · 18 May 2011

I'm a boomer and I remember the polio vaccinations. And my mother remembers lots of crippled kids and even funerals for kids due to polio. Violinist Itzhak Perlman contracted polio as a young child and requires crutches to walk.

It would be nice if anti-vaxxers could travel back in time for a reality check.

W. H. Heydt · 18 May 2011

raven said: There were a lot of older people who survived polio. You could tell because they limped a lot in various ways.
Franklin Delano Roosevelt... --W. H. Heydt Old Used Programmer

JASONMITCHELL · 18 May 2011

perhaps tangental to the original article - when drug/ therapy testing we tend to limit the variables (just good science) but sometimes that means that a more complicated experiment isn't done in oprder to prove the efficacy of a single compound. for example, let's imagine that a natural substance is believed to be an effective treatment of a malady - so extracts of the substance are prepared and tested in a double blind study and results are analyized - but tests of the substance as it is found in nature are rareley performed- why? (look at the entire 'suppliemnts' aisle in the grocery store)

mrg · 18 May 2011

Karen S. said: It would be nice if anti-vaxxers could travel back in time for a reality check.
And when they came "back to the future", they would insist that everything they saw confirmed everything they believed. Morton's demon would travel along with them, after all.

MichaelJ · 18 May 2011

JASONMITCHELL said: perhaps tangental to the original article - when drug/ therapy testing we tend to limit the variables (just good science) but sometimes that means that a more complicated experiment isn't done in oprder to prove the efficacy of a single compound. for example, let's imagine that a natural substance is believed to be an effective treatment of a malady - so extracts of the substance are prepared and tested in a double blind study and results are analyized - but tests of the substance as it is found in nature are rareley performed- why? (look at the entire 'suppliemnts' aisle in the grocery store)
Aren't the initial tests on the entire supplement? It is only after it is found to work that the actual active ingredient determined.

David Fickett-Wilbar · 18 May 2011

Shebardigan said: Really looking forward to the shingles.
They're not fun. Not fun at all. The only good thing about them is that they've got a nice English word for a name instead of something Latinate or Greek, or some doctor's name.

Nomad · 18 May 2011

JASONMITCHELL said: but tests of the substance as it is found in nature are rareley performed- why? (look at the entire 'suppliemnts' aisle in the grocery store)
Because the substance "as it is found in nature" is going to be variable in terms of levels of possible active ingredients. It is also good science to want to ensure that all your test subjects are getting reliable doses of compounds you are interested in. Otherwise, if half your subjects respond and half don't how do you know whether it's because of the effectiveness of the compound or if perhaps half your subjects got an inadequate amount of it?

Gary Hurd · 19 May 2011

Natural products cannot be patented. Extraction methods can be, and synthetic analogues of plant products (as an example) can be patented.

I helped on the early part of a project to identify an anticonvulsant from "china berry." Neither the plant, nor boiling the berry could be patented, so the only pharmaceutical company interest=money was to identify the active chemical so that a patentable synthetic could be made.

harold · 19 May 2011

JASONMITCHELL said: perhaps tangental to the original article - when drug/ therapy testing we tend to limit the variables (just good science) but sometimes that means that a more complicated experiment isn't done in oprder to prove the efficacy of a single compound. for example, let's imagine that a natural substance is believed to be an effective treatment of a malady - so extracts of the substance are prepared and tested in a double blind study and results are analyized - but tests of the substance as it is found in nature are rareley performed- why? (look at the entire 'suppliemnts' aisle in the grocery store)
1) For a substance to be clinically useful, it is usually best to be able to give it in consistent dosage, and without other giving other compounds that theoretically could be toxic or harmful at the same time. Therefore, if a useful active ingredient can be purified, that is often the logical way to go. A fair number of drugs are the isolated active ingredients of herbal medicines (e.g. digoxin, aspirin). A number of major antibiotics are or were originally isolated from microorganisms. 2) Gary Hurd's economic observations are valid, and there is nothing unethical about patenting a novel way to purify or synthesize something. Also, it may be cheaper to synthesize a compound than to purify it from a natural source, and you have to know what you want to synthesize. 3) Nevertheless, studies of compounds in their "natural state" are not uncommon. St John's Wort has been extensively studied and is used clinically in Germany; active ingredients can be purified but it's often ingested whole, sometimes dried and ground and put into capsules. Passion Flower is a bit less studied but also commonly used. Innumerable studies have looked at tea drinking, coffee drinking, fish eating, etc, in various prevention/borderline therapeutic contexts. 4) I take a few "supplements", but it's important to note that over the counter supplements mainly avoid making any kind of claim that would be regulated by the FDA, beyond the claim that they are sufficiently short term non-toxic to be sold, and that they contain what they say they contain, in a very literal sense (in worst case scenarios even these implied claims may be false, but that's illegal). There is no guarantee that the method of preparation is consistent with a meaningful dose of the active ingredient. There is no guarantee that the active ingredient has any beneficial impact on human health. Evidence may range from actual clinical studies, to widespread credible traditional acknowledgement of a an effect, to documentation of some kind of effect in animal studies, to documentation of some kind of effect in "test tube" studies, to nothing, or even to false claims. Do your research and be very skeptical.

rrich · 19 May 2011

Thanks for the reply harold; I appreciate your comments and wishes and the depth of your reply. I don’t agree with all that you say, but the posts have clearly moved on, so I will address just your conspiracy point because I think it is particularly relevant to why I posted in the first place. My problem with the mainstream research on MS is not that it amounts to a conspiracy, but that research is always interested, and that the interest is not only defined by what is best for patients. And , I’m sorry for the buzzwords, but the scientific community addressing MS, which is really just one of many similar kinds of communities, each of them more or less distinct, is very much a closed corporate loop. That is not a conspiracy claim. It is not a simplistic claim that all corporations are bad or that researchers conspire in dark laboratories to serve only the bottom line. It is an observation based on our experience.

The “easy” and “basic” questions I refer to are questions about research in the literature on the effects of diet on MS progression. Perhaps easy and basic were not very good qualifiers. I meant that we ask our specialist questions that from where we stand as patients seem incredibly simple for a highly trained MS specialist at a first-rate institution. In this case, the question is “what can you tell us about the effects of diet on MS progression.” The response we get to this question is not that diet has no impact; the specialist doesn’t conspiratorially try to steer us back to pharmaceutical treatments by pooh-poohing the impact of diet. Instead, the response we get is a blank stare and an awkward silence. The specialist cannot answer the question. And he can’t answer the question (he tells us honestly) because there is no research that he feels he can cite with authority that might answer our question. The question isn’t addressed in the literature he reads.

As an aside, you suggest that if the questions are so easy and basic that we ought to answer them ourselves. That is a bit unfair. First, we are of course in the process of doing so. Second, those of us who must face the medical bureaucracy in the treatment of illness and disease rely on the advice and leadership of our physicians. If my relative were told by her specialist, for instance, that he was familiar with Wahls’ research and claims and that while he knew of no research that supported them still found them interesting, his interest could have a huge impact on how she decides to treat her MS. But he had not even heard of such an approach, and this makes my relative less inclined to pursue that course. Knowing my relative and how she strives to follow the treatment prescribed by the specialist, I personally feel that if the specialist specifically prescribed diet change as part of her treatment that she would pursue that course with a passion.

I am a socio-cultural anthropologist by training, and approach our experiences with MS and the medical bureaucracy as a kind of auto-ethnographic experience as we wade through the system trying to locate ourselves in a prolific stream of corporate literature and agents. The corporate nature of the experience is unquestionable; the literature we are given is corporate-generated; the meetings and lunches we go to are corporate sponsored; our nursing assistant who helps with injections is paid by the company that has developed the drug being injected; even many of the patient groups are organized around corporate human relations staff and outreach personnel. Anthropologists use our own experiences, and the daily experiences of the people we study, to understand larger systemic processes and contexts within which experiences occur and that help to structure those experiences.

So, building on my experience, I would end by taking us back again to Weil’s basic point that qualitative data should have a greater role in the evaluative process of medical treatments. When I first read the “pathetic level of slavery” post and then LA Times article, Weil’s basic point resonated very strongly with my own experience: mainstream science could benefit from qualitative kinds of data that stem from people’s experiences. Qualitative studies could enhance (they shouldn’t replace double-blind studies) evaluative procedures. To say that scientific research is “interested” is from my perspective not a statement of conspiracy, but a recognition of how our for-profit health system is organized; it is a structural observation. And I say that not to argue against a for-profit system, nor to claim that profit is the most salient feature of our health-care system, nor to say that corporations or big pharma are bad. Profit is just one important feature of our system, and so long as one can get access, a for-profit system has significant advantages. I make the point instead because too often in my experience (and here I refer not just to my MS-related experience, but also in the posts here on Panda’s Thumb, including the original one on this blog) advocates of rationalist science try way too hard to make science itself a sacrosanct enterprise of objectivity and truth. As one who practices a form of scientific method, I think that is a diminished understanding of scientific knowledge. Thanks again for the dialogue.

qetzal · 19 May 2011

eric said: Unfortunately, submission of results is entirely voluntary and thus open to abuse. A company can conduct 10 trials, get positive results in only 1 of them, and then submit only that trial's results to the FDA - making the drug appear far more effecacious than it is.
This is not true. Sponsors are required to submit the results of all clinical trials when they seek approval for a new drug.
Personally, I'd like to see the FDA institute two rules: (1) the FDA will only consider results of trials registered with them before the trial is conducted, and (2) the FDA will count non-submission of a registered trial's results (after some reasonable time to complete it) as a negative result.
The first part of your proposal has been in effect for quite a few years already. Any clinical trial (other than Phase I trials) that a sponsor intends to use in support of drug approval has to be registered in advance at clinicaltrials.gov. The results of unregistered trials cannot be used to support drug approval (but they can still be used to deny approval - e.g. if they contradict other positive trials or reveal safety issues).
Relating this back to Weil's comments, while RCT's probably always will be (and should be) the gold standard, there is no reason why companies couldn't submit other types of studies if an RCT is impossible.
This happens in rare cases, but in general, the company would have to convince FDA in advance that blinded RCTs weren't possible, and that they could still establish efficacy in some other way.

mrg · 28 May 2011

qetzal said: The first part of your proposal has been in effect for quite a few years already. Any clinical trial (other than Phase I trials) that a sponsor intends to use in support of drug approval has to be registered in advance at clinicaltrials.gov. The results of unregistered trials cannot be used to support drug approval (but they can still be used to deny approval - e.g. if they contradict other positive trials or reveal safety issues).
I'm glad somebody said that. Ben Goldacre raised a fuss about the supposed failure to register trials in his otherwise creditable book of essays on bogus medicine.

Rick · 6 June 2011

I think I'd be more comfortable going to a vet that to Mr Weil.