|
| |||
|
|
||
|
|||
|
|
Gilding the Gold Standard Lily: The Limits of Evidence-Based MedicineBy Anthony Rosner, PhD, LLD [Hon.], LLC Systematic, impartial review of information is the keystone upon which all scientific progress is made. That said, I have become more aware than ever in the past year how that process can easily run amok, looking more like the chaotic "broom" scene in Disney's "The Sorcerer's Apprentice" than true common sense. Sometimes we become so enamored with the process that we forget the actual information contained in an inquiry, let alone its original intent. It is simply a matter of missing the woods for the trees, with a couple of lumberjacks thrown in, sporting their own agendas.In a recent report submitted to the British government on the advisability of foxhunting, for instance, it was concluded that: "Despite a lack of firm scientific evidence, the inquiry was satisfied that hunting seriously compromises the welfare of the fox." It said the same thing about hunting deer, hares and mink.1 "Duh," I say. Rest assured that at the Foundation for Chiropractic Education and Research (FCER), we would never be caught investing in an undertaking such as this, wasting resources and personnel to pursue a research project whose outcome was obvious or hopelessly trivial. There has to be a question or controversy involving whether the proposed hypothesis or its null will be supported. If there is a consensus for a better treatment or outcome, the null hypothesis becomes a straw man and the research becomes invalid. In outcome studies, this principle has been described as clinical equipoise, a situation in which the ethics of subjects being recruited have not been compromised because patients have not been put into a treatment regimen whose outcome is known to be inferior. Rather, there is an honest question of which of the treatment alternatives being compared will produce better results.2 This then becomes a criterion by which we should accept or reject proposed clinical trials.3 A look at studies published in the medical journals over the past five years offers a revealing glimpse into how frequently randomized clinical trials (the so-called "gold standard") have been misinterpreted or even corrupted. Design flaws, sometimes appearing to be intentional, are responsible for this. Consider the following:
The "take-home" lesson in all this adheres to the often-cited principle of GIGO ("garbage in, garbage out") used in relation to computers. Information extracted from an investigation is only as good as the quality of data put into the analysis; definitive results are never delivered by process alone with no forethought. In the realm of patient health care, it is easy to forget that sound, clinical observations in the doctor's office remain the cornerstone upon which all experimental approaches, including randomized clinical trials, are based. In the world of clinical treatment, erroneous judgments are as much the product of improper generalizations of RCTs (which by their definition take place within a highly restricted setting) as the quality of the RCTs themselves. Indeed, the entire structure of evidence-based medicine is put into perspective by the renowned epidemiologist David Sackett, who argues: "External clinical evidence can inform, but never replace individual clinical expertise, and it is this expertise that decides whether the external evidence applies to the individual patient at all [italics mine], and, if so, how it should be integrated into a clinical decision."17 The importance of the observations attending the individual patient has been eloquently carried a step farther by Mark Tonelli, who argues that there will always be a region (an epistemological zone) in which the individual differences between individuals cannot be made explicit and quantified.18 To assume otherwise, to categorically assume that the entire answer to clinical treatment by any modality has been captured by the precision of analytic methods in the scientific literature, would be like saying that a medical librarian who has access to systematic reviews, meta-analyses, Medline, and practice guidelines provides the same quality of health care as an experienced physician.19 This is precisely where FCER recognizes the challenge of future research. Our program will always endeavor to involve the individual clinician and elevate the importance of the case study to its proper level of recognition. It is sometimes overlooked that all clinical trials were originally conceived by observations taken from individual cases. We ask that you provide every bit of input, through both advice and continuing membership, to FCER so that we may overcome an all-too-prevalent myth and ultimately provide the missing pieces to what is commonly regarded as evidence-based medicine. References
Anthony Rosner,PhD Brookline, Massachusetts  Click here for more information about Anthony Rosner, PhD, LLD [Hon.], LLC.
|
 | |||||||||||||||||||||||||||||||||||||||
|
|
||
