using pseudoscience to teach science

By Alison Campbell 20/12/2011

The following post is an article that I originally wrote for the New Zealand Science Teacher journal (the official journal of the New Zealand Association of Science Educators), and is reproduced here by kind permission of the editor.

We live in a time when science features large in our lives, probably more so than ever before. It is  important that people have at least some understanding of how science works, not least so that they can make informed decisions when aspects of science impinge on them. Yet pseudoscience seems to be on the increase. While some argue that we simply ignore it, I suggest we use pseudoscience to help teach the nature of science (and I recommend Jane Young’s excellent book, The uncertainty of it all: understanding the nature of science,(2010) as a resource).

The New Zealand Curriculum (MoE, 2007) makes it clear that there’s more to studying science than simply accumulating facts: Science is a way of investigating, understanding, and explaining our natural, physical world and the wider Universe. It involves generating and testing ideas, gathering evidence — including by making observations, carrying out investigations and modeling, and communicating and debating with others — in order to develop scientific knowledge, understanding and explanations (p28). In other words, studying science also involves learning about the nature of science: that it is a process as much as, or more than, a set of facts. Pseudoscience offers a lens through which to approach this.

1. Check the information
Students should be encouraged to think about the validity and reliability of particular statements. They should learn about the process of peer review. They should ask: has a particular claim been peer reviewed; who reviewed it; where was it published? There is a big difference between information that’s been tested and reviewed, and information (or misinformation) that simply represents a particular point of view and is promoted via the popular press (and Internet).

‘Cold fusion’ is a good example. Cold fusion was a claim that nuclear fusion could be achieved in the laboratory at room temperatures. The claim was trumpeted to the world via a press release, but was subsequently debunked because other researchers tried, and failed, to duplicate its findings.

Thus checking the source of the information is vital. There is a hierarchy of journals, with publications such as Science considered prestigious, and publications such as Medical Hypotheses considered less so. The key distinction between these journals is the peer review process. For example, papers submitted to Science are subject to stringent peer review processes (and many don’t make the grade), while Medical Hypotheses seems to accept submissions uncritically, with minimal review.

By considering the source of information students can begin to develop the sort of critical thinking skills that they need to make sense of the cornucopia of information on the Internet. When viewing a particular Internet site they should ask (and answer!) questions about the source of the information: has it been subject to peer review (you could argue that the Internet is an excellent ‘venue’ for peer review, but all too often it’s simply self-referential), does it fit into our existing scientific knowledge, and do we need to know anything else about the data or its source?

2. Analyse the information
The following example is excellent for a discussion around both evolution and experimental design, in addition to the nature of science. There is an online article entitled Darwin at the drugstore: testing the biological fitness of antibiotic-resistant bacteria (Gillen & Anderson, 2008) where the researchers tested the concept that a mutation conferring antibiotic resistance rendered the bacteria less ‘fit’. Note: There is an energy cost to bacteria in producing any protein, but whether this renders them less fit — in the Darwinian sense — is entirely dependent on context.

The researchers used two populations of the bacterium Serratia marcescens: an ampicillin-resistant lab-grown strain, which produces white colonies, and a pink, non-resistant (‘wild-type’) population obtained from pond water. ‘Fitness’ was defined as ‘growth rate and colony “robustness” in minimal media.’ After 12 hours’ incubation the two populations showed no difference in growth on normal lab media (though there were differences between 4 and 6 hours) but the wild-type strain did better on minimal media. It is difficult to know whether the difference was of any statistical significance as the paper’s graphs lack error bars and there are no tables showing the results of statistical comparisons. Nonetheless, the authors describe the differences in growth as ‘significant’.

The authors concluded that antibiotic resistance did not enhance the fitness of Serratia marcescens: wild-type [S.marcescens] has a significant fitness advantage over the mutant strains due to its growth rate and colony size. Therefore, it can be argued that ampicillin resistance mutations reduce the growth rate and therefore the general biological fitness of S.marcescens. This study concurs with Anderson (2005) that while mutations providing antibiotic resistance may be beneficial in certain, specific, environments, they often come at the expense of pre-existing function, and thus do not provide a mechanism for macroevolution (Gillen & Anderson, 2008).

Let us now apply some critical thinking to this paper. Your students will be familiar with the concept of a fair test, so they will probably recognise fairly quickly that such a test was not performed in this case because the researchers were not comparing ‘apples with apples’. When one strain of the test organism is lab-bred and not only antibiotic-resistant but forms different coloured colonies from the pond-dwelling wild-type, there are a lot of different variables involved, not just the one whose effects are supposedly being examined.

In addition, and perhaps more tellingly, the experiment did not test the fi tness of the antibiotic-resistance gene in the environment where it might convey an advantage. The two Serratia marcescens strains were not grown in media containing ampicillin! Evolutionary biology predicts that the resistant strain would be at a disadvantage in minimal media. This is due to it using energy to express a gene that provides no benefit in that environment, making it short of energy for other cellular processes. And, as I commented earlier, the data do not show any significant differences between the two bacterial strains.

Also, the authors work at Liberty University, a private faith-based institution with strong creationist leanings, and the article is an online publication in the ‘Answers in Depth’ section of the website of Answers in Genesis (a young-Earth creationist organisation). This is not a mainstream peer-reviewed science journal. This does suggest that a priori assumptions may have coloured the experimental design.

3. Verify the information
Your students should learn how to recognise ‘bogus’ science. To begin with, students should scrutinise information presented via the popular media (including websites) and ask: why is this happening? Another warning sign is the presence of conspiracy theories.

One conspiracy theory worth discussing relates to the validity of vaccination programmes: ’Is vaccination really for the good of our health, or the result of a conspiracy between government and ‘big pharma’ to make us all sick so that pharmaceutical companies can make more money selling products to help us get better?’

Dr A. Kalokerinos is often quoted on anti-vaccination websites as saying: My final conclusion after forty years or more in this business is that the unofficial policy of the World Health Organisation and the unofficial policy of ‘Save the Children’s Fund and almost all those organisations is one of murder and genocide. They want to make it appear as if they are saving these kids, but in actual fact they don’t.

This quote is a good example of how conspiracy theorists often use an argument from an ‘authority’. Yet it is easy to pull together a list of names with PhD or MD after them to support an argument. Try giving your students a list of names of ‘experts’ and see if they can work out their field of expertise.

Recently, New Zealand schools received a mailout from a group called ‘Scientists Anonymous’ offering an article purporting to support ‘intelligent design’ rather than an evolutionary explanation for a feature of neuroanatomy. The article was authored by Dr Jerry Bergman.

A literature search indicates that Dr Bergman has made no recent contributions to the scientific literature in this field, but he has published a number of articles with a creationist slant. So Dr Bergman cannot really be regarded as an expert authority in this particular area. Similarly, it is well worth reviewing the credentials of many anti-vaccination ‘experts’ — the fact that someone has a PhD by itself is irrelevant; the discipline in which that degree was gained, is important. Observant students may also wonder why the originators of the mail out feel it necessary to remain anonymous.

Students need to know the difference between anecdote and data. Humans are pattern-seeking animals and we dohave a tendency to see non-existent correlations where in fact we are looking at coincidences. For example, a child may develop a fever a day after receiving a vaccination. But without knowing how many non-vaccinated children also developed a fever on that particular day, it’s not actually possible to say that there’s a causal link between the two.

Another important message to get across to students is that there are not always two equal sides to every argument, not withstanding the catchcry of “teach the controversy!” This is an area where the media, with their tendency to allot equal time to each side for the sake of ‘fairness’, are not helping. Balance is all very well, but not without due cause.

For example, apply scientific thinking to claims such as the health benefi ts of homeopathy. Homeopathy makes quite specific claims concerning health and well-being. How would you test those claims of efficacy? What are the mechanisms by which homeopathy — or indeed any other alternative health product — is supposed to have its effects? Claims that homeopathy works through mechanisms as yet unknown to science don’t address this question, but in addition, they presuppose that it does actually work.

Students will have some knowledge of the properties of matter and the effects of dilution, and senior classes may be aware of Avogadro’s number. They could apply this to the claim that homeopathic remedies become more effective at higher and higher dilutions, something that, if correct, would overturn our understanding of basic chemistry and physics. The 10:23 Campaign — in which people take ‘overdoses’ of homeopathic remedies — is a humorous way of highlighting the improbability of such claims.

If students can learn to apply these tools to questions of science and pseudoscience, they will become better equipped to find their way through the maze of conflicting information that the modern world presents, regardless of whether they go on to further study in the sciences.

A.Campbell (2011) Using pseudoscience to teach science. New Zealand Science Teacher 128: 38-39

0 Responses to “using pseudoscience to teach science”

  • For the umpteenth time, Derek: youtube videos =/= scientific evidence. Your second link points out that peer-reviewed publications on this topic declined (& have continued to decline) since 1989.

    Also, this post is rather old; on teh intertubes, revisiting old posts often draws the label ‘necromancing’. If you want to promote your views on cold fusion I suggest you start your own blog.

  • Well I disagree with your pseudo science label on cold fusion and the proof is the papers. The reason I am on this blog is because this a New Zealand science blog. Where people talk science and discuss relevant issues. Cold fusion is very relevant and I want to keep it in the young peoples minds and educate them as to the relevance of this issue, especially in these energy dependant times. Thanks

  • Derek, I think you’ve missed my point; the number of actual science papers published in this area has been in decline for over 20 years; youtube doesn’t count.

    In addition, necromancing an old thread is unlikely to result in much of the way of discussion. As I said, if you’re really wanting to discuss this issue, & it’s one that you’re obviously passionate about, you should set up your own blog. It’s easy to do & wordpress is free.

  • Scientific method tells us that if we have an effect that bcan be reproduced it is no longer pseudoscience. The cold fusion debate still rages and a true scientist would look at all the eveidence and report on the truth. Unfortunately this objectivity is not part of the cold fusion debate and it will be labled pseudoscience until you wave one in your house. Which by the looks of things is not to far away. It is real it is happening the smart minds are working on this.
    Look at the reports,read the evidence then evaluate scientificly
    ” With the head scientist at NASA Langley research saying LENR is confirmed along with confirmation from Labs at Toyota, Mitsubishi, and STMicroelectronics as well as Amaco, the US Navy research labs, along with a course on the Fleischmann/Pons effect at MIT and working replications of the Celani reactor at academic sites around the world as well as hundreds of confirmed and peer reviewed experimental paper, that professors and Nobel prize winners are saying it is real and that Patents now being granted, the case that LENR is a real working system of cold fusion is proven. … The fact that in August President Obama signed a rare executive order that combined heat and power units can be licensed and sited in any factory in the USA, that the EEC has started a crash funding project for LENR research…. All point to one fact: The world is about to change. ”
    So get with the times and don’t listen to the nay sayers and their unscientific reasoning.

  • And what does cogeneration (‘combined heat & power units’) have to do with your claims around cold fusion?

    Also, how about that blog of yours? I am not particularly keen on continuing to give you a platform for promoting your own views, especially considering that they bear little apparent relationship to the material canvassed in this particular post.

  • Back closer to on-topic, perhaps:

    Findings want to be considered with caution, no matter how impressive they initially sound, until others have had time to critique, test and verify them.

    An easy “way out” for schools would be to only teach older science that (for the large part) will have become “settled” and to avoid topics that are questionable. This seems a bit boring, though 🙂 I prefer the idea of mixing in a little newer science, provided their “state of play” is discussed, too. I’d help students see science as on-going, “here and now” and to see and exercise a little of process themselves, with the critical thinking needed. Ditto for pseudo-science and loose claims (e.g. in the media) – it’d help students see a use for the approach in everyday life. I like the examples you mention of critically looking at claims, they fit that bill. (Of course!)

  • Pretty much true for first-year (& later) uni students as well, Grant. Consequently, while I refer them to the textbook for core, basic content I also introduce my first-years to the current literature & discuss it in class. In fact, one of the essay topics they’re currently working on asks them to critically evaluate a recent paper (one which I’ve chosen because the authors made a number of assumptions that can’t really be justified, plus some methodological errors). It will be interesting to see what they make of it 🙂 I give them the marking rubric in advance, plus we discuss the topics in tutorial class, so I’m not leaving them to sink or swim!

  • Your course sounds good 🙂 In my undergraduate degree, I didn’t do critical analysis of papers until a bit later. It makes me think now that if they’d done a little of it all the way through I might have viewed the core material differently. (At the time, that is.)

  • I think it’s absolutely essential to start them early. Not least because my paper may be the only science paper that some students take, & to me the science literacy/critical thinking skills are just as important to them as gaining an appreciation of biology & some content knowledge in that area.

  • I’ve noticed that ‘appeal to authority’ and ‘not verifying sources’ are at near epidemic levels amongst the creationists I encounter.

  • Brendan,
    Of course they are very selective about who the authority is the appeal to.
    Another common approach is to “just make stuff up”, which is common in all areas of psuedoscience.