Authority versus Evidence: Arguing About Adoption and Psychological Interventions

Off and on for a couple of years, but especially in the last few months, I’ve found myself upholding the idea that there must be an evidence basis for treatment, against others who believe that statements by people who claim authority are the most powerful of all arguments. I’ve referred to this conflict as a “culture war”, and I am convinced that it is an argument between ideological, a priori assumptions about the world, on the one hand, and positions based on systematic observations and evidence, on the other-- same old Plato versus Aristotle, if you like.

Von and other adoption bloggers argue strongly for a Primal Wound, on the basis of their own experience and on the authority of Nancy Verrier (who, incidentally, has not yet answered the questions I asked a month or so ago). They reject the systematic research evidence provided by Michael Rutter and the English-Romanian Adoptees Project or by other investigators, showing that most adopted children, even those adopted late and after intense social deprivation, do quite well in the long run. For Von and friends, the vividness of personal experience and the statement of an authority establish a set of assumptions that do not need to be tested against other evidence. For Rutter and other researchers, evidence is to be explored carefully as a test of existing assumptions.

Valle Oberg, a proponent of Ronald Federici’s methods of dealing with post-institutionalized children, also appeals to authority as the foundation of her argument. She states (in comments on this blog) that Federici has worked with thousands of children (although the arithmetic on this does not seem to work out very well) and has “saved” them, and that her own children were among those. Therefore, she argues, what she says, and what Federici has said, must be correct. In addition, she proposes that peer-reviewed publication of outcome research is not evidence that methods are effective. Oberg dismisses the view that Federici needs to report his evidence to the public before his methods are said to be effective.

While mulling over these disagreements, I came across a letter to the editor published in Science in 2004 (a silent testimony to the number of papers on my desk). That LTE was in response to discussion at that time about hormone replacement therapy and the way it failed to provide the benefits to heart health that had been expected of it. The authors, Philip Guzelian and Christopher Guzelian, pointed out that it was not surprising or anomalous that the predicted results did not occur. They commented that the outcome was a “dramatic example of the difference between authority-based conclusions (arising from opinion, experience, intuition, judgment, and scientific inference)… and evidence-based conclusions (derived from an objective, unbiased, and systematic analysis of scientific knowledge)… The lesson is quite generalizable. Uncritical acceptance of authority-based opinions as conclusive evidence is pervasive, even though top authorities unsuccessfully predict what scientific knowledge will be preserved as ‘fact’ “. Guzelian and Guzelian noted that there are times when decisions need to be made without adequate scientific evidence, but warn against confusing them with evidence-based conclusions and propose that “the obvious solution is to explicitly acknowledge when shortcomings in the amounts or quality of evidence necessitate a reversion to authority”.

An important point in the contribution of Guzelian and Guzelian is the acknowledgment that evidence-based conclusions are not always available. Those authors were not talking about psychological interventions, but that acknowledgement is an important one in discussion of psychological treatment, where design and implementation of research can be extraordinarily challenging. Although Guzelian and Guzelian did not mention levels of evidence (the idea that some forms of research offer stronger arguments than others), they did imply the need to balance evidence and authority differently in different situations. When evidence is strong, it should be weighed far more heavily than authority; when evidence is weak or non-existent, authority and personal experience are better to rely on than flipping a coin or casting the I Ching.

Perhaps the most important message in the Guzelians’ letter is the need for explicit statement that in the absence of systematic evidence, one is appealing to authority for support of a claim. This is only appropriate, of course, if there is no evidence or if the existing evidence is weak or open to interpretation, and if the maker of the claim can show that this is the case. It is not sufficient to do as Von, Valle Oberg, and many others have done-- to ignore the existing evidence and put forward instead a contradictory claim based on authority, and not only authority, but the authority whose views are welcome.

But, of course, if your way of thinking is to appeal to authority, this will make sense to you only if stated by an authority of your choice.