Volume 389 October 23 1997
International weekly journal of science
WHERE HAS THE BILLION TRILLION GONE?
The Conscious Universe: The Scientific Truth of Psychic Phenomena
by Dean Radin
HarperEdge 1997 pp320 $25
reviewed for Nature by I.J. Good
My friend Christopher R. Evans worked for a time with the well-known parapsychologist
J. B. Rhine, but became a skeptic. In 1974 I invited Evans to Blacksburg,
Virginia, to give a lecture on extra-sensory perception (ESP), and picked
him up at Roanoke airport. He had travelled from London in a Boeing 727.
The licence number of my car happened to be CRE 727. The probability of
that coincidence was about (1/26)^3 x 1,000 = 1/17,000,000.
I have experienced three even more remarkable coincidences, one of which
changed the course of my life. But I doubt whether these coincidences were
paranormal because there are more than 5 million minutes a decade. Some
people must have experienced chance coincidences with probabilities of about
10^-14. So controlled, not anecdotal, observations are needed.
In England, for about 20 years starting in 1939, S. G. Soal was by far the
most prominent parapsychologist. He did controlled card-guessing experiments
resembling those of Rhine. At the suggestion of Whateley Carington, Soal
examined his records, looking for 'hits' one ahead and one behind the guess
of the 'current' card. In one series of experiments, the tail probability,
or P value (the probability that, by chance, the outcome would be at least
as 'extreme' as the observed outcome) was 10^-35 for the 'one-aheads' thus
seeming to prove the existence of precognitive telepathy.
But evidence accumulated, culminating in the ingenious detective work of
Betty Marwick in 1978, showing that Soal's studies were very probably fraudulent.
Dean Radin, author of "The Conscious Universe" avoids mentioning
Radin is firmly convinced that paranormal events happen. His conviction
is based mainly on evidence from controlled experiments but is influenced
also by the 'non-local' phenomena of quantum mechanics.
Quantum mechanics has affected many people's metaphysical speculations about
consciousness and ESP. For example, some 50 years ago, in a conversation
with the prominent physicist Leon Rosenfeld about subjective experiences,
I said: "A [quantum] field theory does seem to be natural in order
to understand how the activities of numerous neurons in a brain somehow
summate. Perhaps psi depends on PSI [the Schrödinger wave function]."
Leaving psi aside, there are much more serious and technical speculations
about the relationship between consciousness and quantum fields by Stuart
Hameroff and Roger Penrose, related to microtubules--extremely small sketal
elements in neurons. One could say that microtubules update Descartes' pineal
gland. Penrose does not, however, mention ESP in his work on consciousness.
Taken at face value, some of the evidence from controlled experiments is
conclusive. But we have to allow for fraud and the 'file-drawer' effect.
Take the first of these. Even many 'normal' scientists have cheated, as
recorded by Alexander Kohn in "False Prophets: Fraud and Error in Science
and Medicine" (Barnes and Noble 1986). To that collection may be added
the psychologists who lie to their subjects and call the lying 'experimental
Parapsychologuists and psychics have more incentive to cheat because, if
their research results are uninteresting, they have less opportunity to
turn to teaching. Unconscious cheating, wishful thinking (which is universal),
unsound experimental design and analysis, and seeing what we expect are
further pitfalls. The statistician M. G. Kendall once described the phenomenon
of seeing what one expects as "one of the deadliest forms of bias in
psychology". He was referring to an experiment in which an observer
of a reliable random number generator had a tendency to write down too many
Potentially the most important evidence in Radin's book is the chapter on
meta-analysis, which is also emphasized in the introduction--and it is here
that the 'file drawer' effect comes into play.
Meta-analysis is the combination of results from many experiments. A problem
in meta-analysis, and in statistics generally, is how to allow for the researches
that remain unpublished and unknown because their P values did not reach
a conventional significance level such as 0.05. I do not know who coined
the name 'file drawer' effect for this problem. This effect drags down the
statistical significance of published work. Radin claims that "parapsychologists
were among the first to become sensitive to this problem"-=-although
he does not say when--and he mentions that "in 1975 the Parapsychological
Association's officers adopted a policy opposing the selective reporting
of positive outcomes". The problem was known to statisticians by 1958.
Consider the following typical example. Radin points out that there were
186 publications on ESP card tests worldwide from 1882 to 1939. "The
combined results of this four-million trial database [taken at face value],"
he says, "translate into tremendous odds against chance--more than
a billion trillion to one." (A 'trial' is the guess of one card) He
means that the P value is about 10^-21--he is not writing only for the scientific
establishment. This P value corresponds to a bulge above 'chance' expectation
of 9.5 sigma, where sigma is the standard deviation. (I call that a 'sigmage'
Apart from the possibility of conscious and unconscious fraud and wishful
thinking in some fraction of the publications, Radin claims, with no explanation,
that, in order to "nullify" the statistical significance, the
file drawer would have to contain "more than 3,300 unpublished, unsuccessful
reports for each published report". That number 3,300 is a gross overestimate.
It should be reduced at least to about 15 (or even to 8).
The expected sigmage in the file drawer, under the null hypothesis, would
be slightly negative but I will call it zero. If these results were combined
with the published work, the total sample size would be multiplied by 16,
thus becoming 64 million individual guesses. Given the null hypothesis ('chance'),
the bulge would be unaffected so the sigmage would be divided by sqrt (16
) = 4 and would become 9.5/4 = 2.4 with a P value of about 1/100.
Because the number of individual guesses is so large, this P value appreciably
SUPPORTS the null hypothesis (no ESP). This is because a Bayes factor (the
factor by which the odds of a hypothesis are multiplied in light of the
observations), corresponding to a fixed P value, is roughly proportional
to 1/ sqrt (N), where N is the sample size. So Radin's method for evaluating
the file-drawer effect, whatever that method may be, must be misguided.
This conclusion largely undermines Radin's meta-analysis which is central
to his case for ESP.
Nevertheless, Radin's book is well written and provides a good summary of
the arguments supporting the existence of ESP, with about 600 references.
It is less good on the counter-arguments. Readers should also consult "ESP
and Parapsychology: A Critical Evaluation by C. E. M. Hansel (Buffalo 1980)
where much fraudulent work is exposed. Radin quotes Hansel as saying that
three P values, each of 0.01, amount to one of 10^-6, and that he (Radin)
would find that convincing. But the product of independent P values is not
a P value. The product has to be transformed by a method due to R. A. Fisher.
Both Hansel and Radin have overlooked this. In the present example, the
composite P value is 1/9000 not 1/1,000,000.
I am not a skeptic by definition. There is one type of evidence that could
convince me if it were successful. Guesses, by psychics, of the parities
(even or odd) of future cricket scores could be published on the World Wide
Web. The actual scores and parities could be published (later) in large
print to help the precognizing of the psychics and to help their evaluation.
This procedure would rule out the possibiity of undetectable fraud.
I.J. Good is in the Department of Statistics, Virginia Polytechnic Institute
and State University, Blacksburg, Virginia 24061-0439, USA
see responses to this review by Brian
Dean Radin and Nick Herbert.
Send your comments to Nature at firstname.lastname@example.org.