Showing posts with label pseudoscientist. Show all posts
Showing posts with label pseudoscientist. Show all posts

Tuesday, June 1, 2010

Droppings of a Crank; The Sheldrake Research Pt. 3



[ Read the second part ]

The Critique

A predominant problem of the reviewed experiments is the sampling. Sheldrake & Smart use rather vague terms in their report; it is explained that the phenomena studied is the most common example of telepathy in the modern world and you get the impression that the ability to sense who is calling before you answer is general. But does the study sample really represent the general public? The receivers who responded to the advertisment reasonably considers themselves to have telepathic ability, a notion stronger than a general supposition. Futhermore, it is reasonable that the callers nominated by the receivers to some extent shares this notion and also thinks the receiver has the supposed ability. The sample must therefore be considered representative of a population of what is usually called "high scoring subjects" rather than the general public. This narrowing down is, however, not done by Sheldrake & Smart, an error also noted by Schmidt, Müller, & Walach (2004).

The snowball sampling of callers is motivated by the theory that telepathy occurs between people belonging to the same social group. But in a group of relatives and friends, there is so much more than an alleged telepathic connection. There is affinity, loyalty, shared values, group pressure, and social obligations. A systematic error to be considered in all psychological research is the "good-subject tendency," i.e. the tendency of experimental participants to act according to what they think the experimenter wants. In the classic Milgram experiments, two thirds of the participants were willing to administer dangerous electroshocks when told to do so by a "professor" in charge, even when the victims begged to be released or in the end responded to the shocks only with tormented screams (Milgram, 2004). Dissimulation as well as lies can be part of participant strategy to achieve what is believed to be the experimenter's goal. In an experiment with members of social groups participating together, with an established affinity, it is imperative to be aware that this type of participant tendency can manifest itself in both implicit and explicit cooperation within the participant groups. In an experiment on telepathy it is of the utmost importance that both verbal and non-verbal communication can be ruled out as cause of a measured effect, especially when participants are allowed to act within the frames of existing social bonds and forms of communication perhaps unknown to the experimenter. Are Sheldrake's & Smart's experiments controlled in these respects? Does the experimental design allow other forms of communication than telepathy? Here are some suggestions of confounding variables:

Positive interpretation

All reported methods allow what can be called "positive interpretation." The experimenter is actually totally unaware of what is being said during the calls between receiver and caller. The receiver reports his or her guess to the experimenter first after the call and any caller confirmation is also done after the call. The experiments thus lack any control for interpretations in line with the following:

- Uhm, I'm guessing Frank. Is it Frank?
- No, it's Mary. Sorry.
- Oh, I thought of you first but then I changed my mind.
- You did? Well, you were right then, from the beginning.
- Yeah, typical...
- But let's report you were right. The idea is to follow your intuition, isn't it?
- I suppose... But can I do that?
- Of course you can. It's not cheating since you thought of me first.
- I guess... Okay, I'll report I was right.



Both receiver and caller then reports that the guess was right, even though it de facto was wrong - the receiver might even have thought of all callers. None of Sheldrake's & Smart's methods is protected against this threat to internal validity. This type of interpretation is also more likely to emerge within a social group than between strangers who doesn't know each other. Thus, the results of the study don't exclude this kind of error; the fact that no telepathic connection beyond chance has been measured between receiver and unknown caller can be explained by the lack of social bond that permits this type of "agreement", rather than lack of a shared "morphic field." And it doesn't take many such instances of positive interpretation to significantly affect the data.

Caller number identification

The report carefully describes what kind of die was used in the random selection of caller and calling time but there is no description of what kind of telephones were used by the receiver. It would have been appropriate that the equipment used had been accounted for. Was it an older type of phone or a more modern with a display? Does the receiver have caller number identification service and if not, can this be verified by the receiver's service provider? None of this is accounted for in the report.

Cell phone/SMS

Since both receiver and caller are sitting all by themselves in their homes, there is no possibility to control possible verbal or text communication by cell phone. To exclude such communication, careful monitoring of both receiver and caller is required - a receiver may even have a cell phone set to "silent" kept close to the body, and be directed by agreed upon vibration signals.

Sensory leakage

Even if the calls had been controlled, Schmidt, Müller, & Walach (2004) notes the possibility of sensory leakage as the receiver might apprehend cues from different sounds from the caller and his or her environment. This threat is eliminated if the receiver has to make a guess before answering. But as already noted, the Sheldrake & Smart experiments lack control of the calls altogether.

In Sheldrake's & Smart's own discussion on errors, mortality and how it might have affected the statistical analysis is considered. But the mortality itself is not. In both experimental series, the mortality is 57%, i.e. more than half of the receivers dropped out before completing the ten trials. For an experimental study in which the participants have been informed in detail about procedure and in addition gets compensated, 57% is a whopping number. Sheldrake & Smart provides the following explanation:
They withdrew for a variety of reasons, most commonly because they could not persuade all 4 callers to agree to be available at the same times. (Sheldrake & Smart, 2003a).

In the discussion on errors, this is somewhat elaborated on:
In fact most participants who stopped did so because their callers were unable or unwilling to continue. (Sheldrake & Smart, 2003a).

The receivers, who at one point decided to participate, were thus unable or unwilling to complete the experiment. Why? Sheldrake & Smart claims that it usually was due to the four caller not being able to participate at the same time. What were the reasons that cannot be sorted under "usually"? Is it possible that some of the receivers saw no point in continuing because of weaknesses in the experimental design? Sheldrake & Smart doesn't say.

It should be noted that the vague formulations regarding mortality allows for it all to be explained by unwillingness to complete a scientific experiment because it was experienced to be unscientific or otherwise not worth completing, despite compensation. Even if the participants knew each other well in the groups, they were not familiar with participants in the other groups. If you dropped out from the experiment because you considered it meaningless you might still get the impression from Sheldrake's & Smart's report that most of the others left the experiment due to time factors.

Sheldrake & Smart use initials for the receivers in their report. An account of the mortality, listing the reasons for dropping out, would have been possible considering both space and practicality. In light of the methodological weaknesses of the experiment, such an account should have been in the report.

In the discussion on errors, Sheldrake & Smart dismisses cheating for three reasons: (1) It is unlikely that a majority of the participants would have cheated and had that been the case, the results would have been different, (2) Sheldrake & Smart themselves did not cheat in the preliminary experiment, nor did the unknown callers in the second experimental series, and (3) the tests in a completely different experiment was videotaped (Sheldrake & Smart, 2003b).

It is certainly unlikely that a majority of participants would cheat, had the sample been random and representative of the general public, but that is not the case in the Sheldrake & Smart experiments. Instead, the researchers have a non-random sample of people who think they have a telepathic ability or that the receiver does. It is not unlikely that a majority of such a sample considers it reasonable to somewhat adjust guesses in line with the "positive interpretation" principle described above - even if it means cheating in a strict experimental sense, it doesn't have to have that meaning to the participants. Sheldrake & Smart also presumes that cheating would have rendered even better results than was the case, thus ignoring the possibilty of participants assessing that major "adjustments" would be suspicious. Since the experimenters beforehand informed the participants of the procedure, they certainly disclosed information about what outcome would be expected by chance and thus hinted what results would be enough to be significant. It would be foolish - and revealing - to achieve more than necessary.

That Sheldrake & Smart themselves didn't cheat doesn't say much, unfortunately. The fact that Sheldrake is looking for support for his very controversial theory on morphogenetic fields makes him more than inclined to "interpret positively". Smart was alredy convinced she had telepathic connection to her dog (Sheldrake & Smart, 2000) and must be considered just as inclined as Sheldrake to adjust results. Furthermore, it is rather remarkable that experimenters double as participants in experiments.

The argument that unknown callers did not cheat (their results are at chance level) is only valid if the only possibility of cheating is the one suggested by Sheldrake & Smart. As is evident from the above, that is not the case.

The experiment videotaped in another study (Sheldrake & Smart, 2003b) cannot guarantee that cheating was not used in the reviewed study. It is of course ridiculous to suggest such a thing. If you look at both studies you find that one woman, Sue Hawksley, scored 63% when her mother was calling in the reviewed study, but only 27% when her mother was calling in the videotaped experiments. The same woman scores at chance level when close friends are calling in the reviewed study, but 63% and 45% in the videotaped experiments. It seems highly unlikely that an alleged telepathic connection with the mother disappears entirely when someone turns on a videocamera, and that telepathic connection with close friends then suddenly emerges. A reasonable explanation would instead be that the mother is comfortable with "positive interpretation", which is possible in the reviewed study, while cell phone or caller number presentation, which are possible in the videotaped experiments, are more fitting cue tools for the close friends.

A fundamental experimental flaw is the fact that the research method is changed three times during the experiments. It indicates that the design was weak and not thoroughly thought out from the beginning. The fact that Sheldrake & Smart so freely reports this suggests a lack of fundamental insights into research methods.

Sheldrake (2006) claims that the experiments have been replicated but the study he refers to, Lobach & Bierman (2004), suffers from similar flaws as the one reviewed here. Another study, in which errors were eliminated and stricter controls adopted, reported results that would have been expected by chance (Schmidt, Müller, & Walach, 2004).

To sum up, no inference regarding the existence of telepathy can be made on basis of this study. As it has been reported by Sheldrake & Smart, it suffers from methodological flaws so severe that it must be considered worthless. The researchers present a seeming representability that doesn't exist och appear totally unaware of fundamental psychological dispositions, in themselves and in the participants, that might be of importance to the experiment. The design is very weak and sensitive to several confounds that may affect the results.

Next, a concluding post. Stay tuned.


References

Lobach, E., & Bierman, D. J., (2004). Who’s Calling at This Hour? Local Sidereal Time and Telephone Telepathy. Report presented at The Parapsychological Association Convention, Wienna, Austria.

Milgram, S. (2004). Obedience to authority: The unique experiment that challenged human nature. New York: Perennial.

Schmidt, S., Müller, S., & Walach, H., (2004). Do You Know Who is on the Phone? Replication of an Experiment on Telephone Telepathy. Report presented at The Parapsychological Association Convention, Wien, Österrike.

Sheldrake, R., (2006). In Conversation on Abc Radio National – Rupert Sheldrake [www dokument]. URL http://www.abc.net.au/rn/inconversation ... 754367.htm.

Sheldrake, R., & Smart, P., (2000). A Dog That Seems To Know When His Owner is Coming Home: Videotaped Experiments and Observations. Journal of Scientific Exploration, 14, 233-255. URL http://www.sheldrake.org/Articles&Paper ... video.html

Sheldrake, R., & Smart, P., (2003a). Experimental Tests For Telephone Telepathy. Journal of the Society for Psychological Research, 67, 184–199. URL http://www.sheldrake.org/Articles&Paper ... _tests.pdf

Sheldrake, R., & Smart, P., (2003b). Videotaped Experiments on Telephone Telepathy. Journal of Parapsychology, 67, 187–206. URL http://www.sheldrake.org/Articles&Paper ... video.html



Monday, May 24, 2010

Gardner on Pseudo-scientists

Martin Gardner 1914-2010

Martin Gardner's Fads and Fallacies in the Name of Science was first published in 1952 under the title In the Name of Science. It soon became a classic of skeptic literature and it is easy to understand why. Reading it now, more than fifty years later, it feels just as necessary as it must have been then. Gardner's prediction has come true. We do have a multitude of pseudo-scientists promoting different weird ideas as though they are unquestionable truths. The cranks of the mid 20th century discussed by Gardner has been replaced by new ones, sometimes even weirder. From the traits and characteristics described by Gardner, it is easy to recognize a Rupert Sheldrake or Gary Schwartz, or - if you're involved in debates on paranormal phenomena - the followers of such cranks. Like Torbjörn Sassersson, who are able to forward the arguments of his Masters but lack the intellectual capacity to develop ideas of his own. Interestingly enough, the more devoted the follower, the more personality traits he or she seem to share with the Master. In some cases, the paranoia described by Gardner doesn't seem to be connected to a specific theory or set of theories. As in the case of Rickard Berghorn, former sci-fi publicist turned self-proclaimed genius, the paranoia itself is the main drive - he is just waiting for some lunacy to come along. Anyway, I am sure you won't lack contemporary references to the excerpt from Gardner's introductory chapter quoted below. I hope it will serve as a teaser for the book. It is, as far as I know, still in print and a must in any skeptic's library. Buy it and read it. Gardner comes in handy when taking part in the struggle for skepticism.

"The modern pseudo-scientist - to return to the point from which we have digressed - stands entirely outside the closely integrated channels through which new ideas are introduced and evaluated. He works in isolation. He does not send his findings to the recognized journals, or if he does, they are rejected for reasons which in the vast majority of cases are excellent. In most cases the crank is not well enough informed to write a paper with even a surface resemblance to a significant study. As a consequence, he finds himself excluded from the journals and societies, and almost universally ignored by the competent workers in his field. In fact, the reputable scientist does not even know of the crank's existence unless his work is given wide-spread publicity through non-academic channels, or unless the scientist makes a hobby of collecting crank literature. The eccentric is forced, therefore, to tread a lonely way. He speaks before organizations he himself has founded, contributes to journals he himself may edit, and - until recently - publishes books only when his followers can raise sufficient funds to have them printed privately.

A second characteristic of the pseudo-scientist, which greatly strengthens his isolation, is a tendency toward paranoia. This is a mental condition (to quote a recent textbook) "marked by chronic, systematized, gradually developing delusions, without hallucinations, and with little tendency toward deterioration, remission, or recovery." There is a wide disagreement among psychiatrists about the causes of paranoia. Even if this were not so, it obviously is not within the scope of this book to discuss the possible origins of paranoid traits in individual cases. It is easy to understand, however, that a strong sense of personal greatness must be involved whenever a crank stands in solitary, bitter opposition to every recognized authority in his field.

If the self-styled scientist is rationalizing strong religious convictions, as often is the case, his paranoid drives may be reduced to a minimum. The desire to bolster religious beliefs with science can be a powerful motive. For example, in our examination of George McCready Price, the greatest of modern opponents of evolution, we shall see that his devout faith in Seventh Day Adventism is a sufficient explanation for his curious geological views. But even in such cases, an element of paranoia is nearly always present. Otherwise the pseudo-scientist would lack the stamina to fight a vigorous, single-handed battle against such overwhelming odds. If the crank is insincere - interested only in making money, playing a hoax, or both - then obviously paranoia need not enter his make-up. However, very few cases of this sort will be considered.

There are five ways in which the sincere pseudo-scientist's paranoid tendencies are likely to be exhibited

(1) He considers himself a genius.

(2) He regards his colleagues, without exception, as ignorant blockheads. Everyone is out of step except himself. Frequently he insults his opponents by accusing them of stupidity, dishonesty, or other base motives. If they ignore him, he takes this to mean his arguments are unanswerable. If they retaliate in kind, this strengthens his delusion that he is battling scoundrels.

Consider the following quotation: "To me truth is precious. ... I should rather be right and stand alone than to run with the multitude and be wrong. ... The holding of the views herein set forth has already won for me the scorn and contempt and ridicule of some of my fellowmen. I am looked upon as being odd, strange, peculiar. ... But truth is truth and though all the world reject it and turn against me, I will cling to truth still."

These sentences are from the preface of a booklet, published in 1931, by Charles Silvester de Ford, of Fairfield, Washington, in which he proves the earth is flat. Sooner or later, almost every pseudo-scientist expresses similar sentiments.

(3) He believes himself unjustly persecuted and discriminated against. The recognized societies refuse to let him lecture. The journals reject his papers and either ignore his books or assign them to "enemies" for review. It is all part of a dastardly plot. It never occurs to the crank that this opposition may be due to error in his work. It springs solely, he is convinced, from blind prejudice on the part of the established hierarchy - the high priests of science who fear to have their orthodoxy overthrown.

Vicious slanders and unprovoked attacks, he usually insists, are constantly being made against him. He likens himself to Bruno, Galileo, Copernicus, Pasteur, and other great men who were unjustly persecuted for their heresies. If he has had no formal training in the field in which he works, he will attribute this persecution to a scientific masonry, unwilling to admit into its inner sanctums anyone who has not gone through the proper initiation rituals. He repeatedly calls your attention to important scientific discoveries made by laymen.

(4) He has strong compulsions to focus his attacks on the greatest scientists and the best-established theories. When Newton was the outstanding name in physics, eccentric works in that science were violently anti-Newton. Today, with Einstein the father-symbol of authority, a crank theory of physics is likely to attack Einstein in the name of Newton. This same defiance can be seen in a tendency to assert the diametrical opposite of well-established beliefs. Mathematicians prove the angle cannot be trisected. So the crank trisects it. A perpetual motion machine cannot be built. He builds one. There are many eccentric theories in which the "pull" of gravity is replaced by a "push." Germs do not cause disease, some modern cranks insist. Disease produces the germs. Glasses do not help the eyes, said Dr. Bates. They make them worse. In our next chapter we shall learn how Cyrus Teed literally turned the entire cosmos inside-out, compressing it within the confines of a hollow earth, inhabited only on the inside.

(5) He often has a tendency to write in a complex jargon, in many cases making use of terms and phrases he himself has coined. Schizophrenics sometimes talk in what psychiatrists call "neologisms" - words which have meaning to the patient, but sound like Jabberwocky to everyone else. Many of the classics of crackpot science exhibit a neologistic tendency.

When the crank's IQ is low, as in the case of the late Wilbur Glenn Voliva who thought the earth shaped like a pancake, he rarely achieves much of a following. But if he is a brilliant thinker, he is capable of developing incredibly complex theories. He will be able to defend them in books of vast erudition, with profound observations, and often liberal portions of sound science. His rhetoric may be enormously persuasive. All the parts of his world usually fit together beautifully, like a jig-saw puzzle. It is impossible to get the best of him in any type of argument. He has anticipated all your objections. He counters them with unexpected answers of great ingenuity. Even on the subject of the shape of the earth, a layman may find himself powerless in a debate with a flat-earther. George Bernard Shaw, in Everybody's Political What's What?, gives an hilarious description of a meeting at which a flat-earth speaker completely silenced all opponents who raised objections from the floor. "Opposition such as no atheist could have provoked assailed him"; writes Shaw, "and he, having heard their arguments hundreds of times, played skittles with them, lashing the meeting into a spluttering fury as he answered easily what it considered unanswerable."

In the chapters to follow, we shall take a close look at the leading pseudo-scientists of recent years, with special attention to native specimens. Some British books will be discussed, and a few Continental eccentric ones, but the bulk of crank literature in foreign tongues will not be touched upon. Very little of it has been translated into English, and it is extremely difficult to get access to the original works. In addition, it is usually so unrelated to the American scene that it loses interest in comparison with the work of cranks closer home.

With few exceptions, little time will be spent on theories which come under the broad heading of "occult." Astrology, for example, still has millions of contemporary followers, but is so far removed from anything resembling science that it does not seem worth while to discuss it. The theory that sunspots cause depressions (popular among conservative businessmen who like to think of booms and busts as natural phenomena to be blamed on something remote) is the last respectable survival of the ancient view that human affairs are linked with astronomical phenomena. This literature, however, belongs more properly to economics than to astronomy. The social sciences have, of course, their share of eccentric works, but for many reasons they form a separate subject for study.

Our survey will begin with curious theories of astronomy, the science most removed from the human landscape. It will proceed through physics and geology to the biological sciences, then into human affairs by way of anthropology and archeology. Four chapters will be devoted to medical quasi-science, followed by discussions of sexual theories, psychiatric cults, and methods of reading character. Finally, we shall make a serious appraisal of the reputable work of Dr. Rhine, with quick and not so serious glances at a few other venturers into the psychic fields.

The amount of intellectual energy that has been wasted on these lost causes is almost unbelievable. It will be amusing - at times frightening - to witness the grotesque extremes to which deluded scientists can be misled, and the extremes to which they in turn can mislead others. As we shall see, their disciples are often intelligent and sometimes eminent men - men not well enough informed on the subject in question to penetrate the Master's counterfeit trappings, and who frequently find in their devotion an outlet for their own neurotic rebellions. More important, we shall have impressed upon us the traits which these "scientists" hold in common. The atmosphere in which they move will become familiar to us as we begin to breathe the air of their fantastic worlds.

Just as an experienced doctor is able to diagnose certain ailments the instant a new patient walks into his office, or a police officer learns to recognize criminal types from subtle behavior clues which escape the untrained eye, so we, perhaps, may learn to recognize the future scientific crank when we first encounter him.

And encounter him we shall. If the present trend continues, we can expect a wide variety of these men, with theories yet unimaginable, to put in their appearance in the years immediately ahead. They will write impressive books, give inspiring lectures, organize exciting cults. The may achieve a following of one - or one million. In any case, it will be well for ourselves and for society if we are on our guard against them."