Evaluating health care claims

In some ways this post is a continuation of my previous one titled “…because it’s natural”. In a lot of diseases such as DM-2, Alzheimer’s, and heart disease, there are multiple mechanisms that contribute to either the disease itself or to it’s complications. Two mechanisms of disease that seem to get a lot of space on TV, print and on the internet is that of inflammation and oxidation. Whether it is someone promoting a “super food” that has a lot of antioxidants in it (or a lot of anti-inflammatory activity), or a pill that has plant extracts in it that reduce oxidation or inflammation, the claims should be  taken with a grain of salt. For example in some cases, there may be multiple good studies that show taking said supplement does act as good antioxidant. However this doesn’t mean that the supplement will improve one’s health or lengthen lives. This is a problem with using what’s called a surrogate endpoint. Don’t get me wrong, using surrogate endpoints can be useful when the more significant and relevant endpoints are things to be avoided (death or disability for example) or might not happen for years  – I don’t think a study that would take 30 years to start showing something works would get funding – or finding enough people to study would be practical. It helps if a change in the surrogate endpoint has already been shown to be related to reduction in a particular disease’s morbidity or mortality.There are also observational studies that show certain things (high vitamin A levels, higher beta-carotene intake) are associated with lower levels of a particular disease state. Sometimes using a surrogate endpoint  (or  noticing an association between two things such as high levels of vitamin A and lower rates of a particular disease) ends up leading to people doing negative studies. For example, many deaths after a heart attack are related to arrhythmias. A study called the CAST (short for Cardiac Arrhythmia Suppression Trial) showed  higher mortality in people who were on anti arrhythmia drugs. It doesn’t mean that the drugs didn’t have a role in other disorders. I have a feeling it means that we were just asking the wrong question (even though it needed to be asked and answered) about treating arrhythmias after heart attacks. I use the example of the CAST study to make the point that showing something changes the level of something (either up or down) that is thought to be involved in causing disease – be it inflammation, oxidation, arrhythmia or otherwise – doesn’t mean it affects the disease it is said to. It may be that to treat a disease with anti-inflammatory medications (or substances), one also needs to block other pathways of that disease as a well for any to be effective. This is why most cancers are treated with more than one drug. This is why people are often on more than one blood pressure medication. As I mentioned in my last post, any claims should have data supporting that they work. The results should be reproducible, hopefully other by other researchers. Getting back to my original assertion from the start of this particular blog post, if someone is touting a “superfood” for health, It is appropriate to ask if it actually improves health, decreases complications, etc. In my opinion, just to say something is a “super food”  because it is a ‘super anti oxidant’ is blowing smoke.  That isn’t to say that anti-oxidant rich foods don’t promote good health. There are too many studies that are negative that to look at one thing and say “this is the holy grail of food”. This also undersimplifies things too greatly. It’s better, in my opinion, to say “these are the types of foods/eating (or habits if one is talking about other aspects of lifestyle) that are associated with good health. For examples, many of the studies that show that olive oil intake is inversely related to cognitive decline are more agnostic about what role each component in olive oil plays, despite showing benefits. Is it the kinds of fatty acids in olive oil? Is it the polyphenols that act as antioxidants?  Is it the anti-inflammatory chemicals in olive oil? I suspect the answer is yes, it is all three. Is it the answer to everything: just have olive oil and you’ll live to 100? I doubt it. My bottom line on health care claims:

Be critical but open minded: ask the following questions: “Does it actually affect or prevent disease? Does it decrease complications of the disease and not just something thought to be associated with disease or complications thereof?”. If the answer is “yes, it does reduce _fill in the blank_ and there is a proportional reduction in the amount of deaths/strokes/people going on dialysis/etc then you have a winner. IF the answer is “it does reduce _fill in the blank_” but there is no reduction in _fill in this blank as well_” it may mean that the answer is more complicated than we think. It may mean that the wrong question(s) were asked, or the right ones hadn’t been asked.

Also be wary of claims that make a product or procedure seem that it’s THE ANSWER for a particular disease. It may be a piece in the puzzle, but in order to be considered as such, the answer to the question ‘where’s the proof’ should be along the lines of “here are the studies…”

If the person makes statements like “doctors are in the pockets of ‘big pharma’ and aren’t interested in curing disease”, then be wary. I think most doctors get into this business to make people better. If there was a pill that taken once or twice cured someone of his or her type 2 diabetes (and did not cause some other severe life threatening disease), I think most doctors would use that pill.

Also ask if this the first study of something? Often a treatment is found in a study to be helpful. The numbers of people may be small. Due to the nature of studies, the participants are typically more homogenous than the population as a whole. Once larger studies are done, the benefits of a medication/procedure, etc may not be as large as initially thought.

Another question ot ask is this better than what we have now? Though it could be asked of a new medication, I’m primarily thinking here of new surgical procedures (eg, robotic surgery for certain things). If offered ask: is the rate of complications less with the new procedure? Is mortality less? Is the recovery time quicker with the new procedure?

One thought on “Evaluating health care claims

  1. Don’t believe the hype – 10 persistent cancer myths debunked – Cancer Research UK – Science blog – doctorgladstone

Leave a comment