We Don’t Know What We Don’t Know

“If these two studies are really correct, what people in general are trying to do might be completely wrong in terms of maintaining health and even longevity.” – Shin-ichiro Imai, MD, PhD, of Washington University

A few weeks ago, two studies were published in Cell Metabolism which generated huge press coverage but little true scientific discussion. Both studies concerned the effect of the ratio of dietary protein to carbohydrate on health and longevity.

In the first study, 858 mice (C57BL/6) were fed 25 different diets ad libitum, the composition having various protein, carbohydrate and fat levels. With 34 mice per treatment arm, those on the low-protein, high-carbohydrate diet lived the longest … and were the fattest.

In the second study, the 24-hour dietary record from 6,381 adults collected two decades ago as part of the NHANES III were analyzed and matched with subsequent mortality data. Their conclusion: in those under 65 years old, a high-protein intake increased all-cause mortality 74 percent while in those over 65, it resulted in a 23 percent reduction in all-cause mortality!

I have no idea what to do with this data, and neither does anyone else, as they are nothing more than small observations that fly in the face of years of experience and teaching, leaving  physicians skeptical. However, there is no shortage of pundits reporting the data as though they do know what it means and, further, what strategies we should be employing based on these results. The authors both concluded, to their credit, simply that more data was needed.

In 1981, an analogous “stir” was produced when the Harvard School of Public Health reported in the New England Journal of Medicine that coffee consumption was associated with pancreatic cancer, that study based on interviews with 369 patients and 644 controls. Again, the result seemed contrary to experience. The uproar among the lay public was deafening while most medical thinkers took a “wait and see” approach, the authors concluding more data was needed. Thankfully, for all of us who are coffee drinkers, the association has not born the test of time.

In an analogous fashion, if we consider the nouveau clinical and economic proposals being inflicted on medicine today, how many authoritarian pronouncements have been made, how many edicts set forth, how many directives issued as though they are “fact” when in truth “we don’t know what to do” and “we need more data”? After all, there is a history. As young interventionists, we dilated those coronaries we were told should be opened, later stenting those we were told should be stented, only now to be told that we were “wrong.” Our echocardiographers did annual echocardiograms as they were taught to do by the “experts” on their valvular and heart failure patients, only to now be told they were “wrong.” Our isotopists did repeated perfusion images on those with repaired coronary artery disease, being told they should evaluate their patients’ progressive ischemic burden, only now to be characterized, if they follow such a path, as overutilizers, exposing their patients to undue radiation, the efficacy of the very test itself now brought into question.

Yes, in both the clinical and business arenas of medicine, knowledge advances, the rules that shape our daily practice evolve and the paradigms we employ shift. But let no one imply that the failure of physicians to mindlessly embrace, as fact, the unproven sometimes radical changes proposed by others is somehow a unilateral failure of those skeptics to “see the truth.” Do not suggest those hesitant to embrace the unproven and untested have undergone some sort of ethical metamorphosis to a less-honorable, obstructionist state.

Perhaps they are just more wise, battle scarred and tempered in the fiery crucible of experience, having recall of remote, vaguely familiar, analogous proclamations that turned to folly, sometimes at great expense.

Maybe they, more than most, are fully aware that “we don’t know what we don’t know.”

4 thoughts on “We Don’t Know What We Don’t Know

  1. Thank you. Thank you. This subject needs to be addressed more vigorously to both the public and scientists. As a nutritionist, I find a good part of the literature totally confounded with correlation/observational studies presented as cause and effect. And not only are the media complicit, but well-known scientists themselves are doing this; and they know it. I have to address this whenever I give a talk about nutrition. Intense education about this subject is needed from the day an emerging scientist starts her/his studies as well as more intense review of scientific publications.

  2. How true! It seems we have all accepted as fact that the death of fee for service, and population health will cure all that ills. Yet again, very little fact to show for this. Can medical professionals really overcome all of the psychological, social, and hereditary reasons people become ill or are unheathy? Can a physician or his representatives really control what a patient eats, drinks and how they exercise? Do we really want to? When patients can’t see physicians because the incentive is to not to see patients, and mange with RN’s social workers, and mid-levels, will the populace embrace that as a step forward? We don’t know what we don’t know. We need more data.

  3. At last someone has a little sense. I guess we no longer bleed people for various problems. Unfortunately, the “conservatives” are being vilified, yet we have seen so much that we doubt most “new” stuff.
    Our biggest problem is the hype by the media. patients ” demand” the newest and “best” even if unproven.

  4. I believe the adage “if you ask the wrong question, you will get the wrong answer.” Such is what I think of this above information. The proper question to ask is one that would be answered by a comparative anatomist. Based on the anatomy and physiology of this human organism (teeth shape, jaw action, enzymes in the salivary gland, pH of the stomach acid, length of the small bowel, lack of nails and claws…), compared to a dog or cat, a goat or gorilla, etc., what would a comparative anatomist think is the proper types of food and their frequency of intake for this human biology? It is known what an anatomist would say/has said: we live in an organism that should be at least 90% whole foods (ideally organic and minimally processed) vegetarian physiology (whether we like it or not) with perhaps 3 servings/week of any type of wild game (free range chicken, cage free eggs, bison, wild caught fish). Drink water and tea, Breathe clean-air/avoid particle/smoke-filled air, exercise to the point of having clear lines of definition and demarcation on the abdomen (low % body fat)…. Now what about the information that was obtained in these referred-to studies? To me, those under 65 were doing it “right” & hence they lived longer while those over 65 had passed their stress tests of “living”, were in good enough shape that they were able to safely tolerate (and enjoy) the high protein diet. Those ove 65 who could not tolerate that high protein diet had passed on due to the predictable diseases that arise therefrom. Well, that’s my 2 cents. HRS, MD, FACC http://www.thepmc.org

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>