SciBlogs

Posts Tagged criticalthinking

contaminated dietary supplements Alison Campbell Jun 19

No Comments

Trawling through my ‘blogging’ folder, wondering what to write about, I came across a paper from the New England Journal of Medicine that discusses problems with contaminated dietary supplements in the US (Cohen, 2009). I’ve previously written about the recall of ‘natural’ treatments for impotence, & Grant’s talked on more than one occasion for the need for ‘truth in labelling’ for such supplements & other forms of complementary & alternative medicine. So I thought it was about time for a follow-up.

Every so often the issue of regulating complementary & alternative health products comes to the fore in NZ. And when it does there are usually fairly strident arguments made against the suggestion. I’ve never really been able to understand why, given the evidence that these products can be adulterated, or aren’t standardised in terms of dosage. I’m also at a loss to see how some (many?) of these products can be described as ‘natural’, and held to be much better for you than those made by ‘Big Pharma", when in fact they’re often (as we shall see) not all-natural & also often produced by the same pharmaceutical companies that make prescription drugs.

Cohen’s paper begins with the cautionary tale of an American police officer who took what was presented as a ‘natural’ weight-loss supplement to help him lose some excess kilos. The supplement also lost him his job – it contained amphetamine, which was detected in a routine urine test & led to him being fired. Apparently, by August 2009 the US Food & Drug Administration had identified more than 140 ‘natural’ products containing active pharmaceutical ingredients, most of them marketed as dietary supplements – & this is regarded as the tip of the iceberg.

Apparently, before 1994 herbal products fell under the rubric of food additives; manufacturers had to prove their products were safe before they could market them. These days, since the 1994 US Dietary Supplement Health & Education Act, it’s assumed that supplements are safe & there’s little control over their marketing. However, it seems that this deregulated environment isn’t well understood by either consumers or doctors. The majority of consumers believe that the supplements they take have been approved by the relevant government agency, & must carry warning labels about any side effects that may exist. (The absence of such warnings is then taken to mean that the product is safe, where in fact they may simply be missing.) Similarly, a survey of doctors in training found that a large minority also believed that the products had to have FDA approval, while most didn’t know that adverse events had to be reported to the FDA.

Cohen’s list of contaminants found in ‘health’ products on the US market is alarming. While poisonous plant materials, heavy metals, & bacterial contamination are commonly found, what’s even worse are the many supplements – touted as ‘natural’ – that contain ‘prescription medications, controlled substances, experimental compounds, or drugs rejected by the FDA because of safety concerns’ (Cohen 2009). They’re most often detected in products sold to enhance sexual or athletic perfomance, or for weight loss but are also found in supplements aimed at people with serious health concerns, such as diabetes. In the light of all this I find it more than a little ironic that a New Zealand natural health products website – arguing against regulation of these products in NZ – says that "the status quo, mirrored in the USA, has been shown over many years to be safe, inexpensive and efficacious. Existing legislation protects consumers from dangerous products and misleading advertising." As Cohen has pointed out, this is a long way from reality. 

Given patients’ tendency not to tell their GPs what supplements they are using (unless the doctor asks fairly specific questions), & the fact that some supplements can act as antagonists to prescription medicines**, & that the contaminants themselves can have serious health effects, such widespread contamination may well represent a significant public health risk in the US (where it’s estimated that 114 million Americans use some sort of dietary supplement: Cohen, 2009)). And in New Zealand. You might argue that ‘our’ products are much better formulated – but remember that many supplements are readily available on-line from overseas sellers, or are imported from overseas and, as the recent withdrawal of sexual enhancement products shows, may be subject to the same serious problems as those discussed by Cohen.

Personally, I think there’s a good argument for regulation of dietary supplements & other over-the-counter health products. You may argue that it’s a case of ‘buyer beware’ & individual freedom to choose – but there’s likely to be a significant cost to the individual and to the public health service when (& it is when, rather than if) things go wrong.

** For example, Oneschuk & Younus (2008) note that while some ‘natural health products’ may have the potential (based on animal & in vitro studies) to help cancer patients manage the side effects of chemo- & radiotherapy, others significantly reduce the effectiveness of chemotherapeutic drugs.

PS (23/06/2010) Anyone interested in a more detailed coverage of the US situation should have a look at Steven Barrett’s post on Quackwatch.

P.A.Cohen (2009) American roulette – contaminated dietary supplements. New England Journal of Medicine 361(16): 1523-1525. doi 10.1056/NEJMp0904768

D.Oneschuk & J.Younus (2008) Natural health products and cancer chemotherapy and radiation therapy. Oncology Review 1: 233-242. doi 10.1007/s12156-008-0028-6 

what science has given us Alison Campbell May 10

No Comments

Had a not-the-best ending to a platelets donation today (syncope = fainting; very strange for platelets since you get all the red stuff back…) & I’m still feeling somewhat under the weather & don’t feel like writing a ’serious’ post. So… what follows is something I’ve had tucked away for a while, wondering when to post it.

From Thunderfoot: a visually stunning video clip highliighting some of the achievements of science & technology – made in response to a ‘creation science’ claim that the Bible is a one of the top science books around. All to the sounds of one of my most-favourite pieces of music by J.S.Bach: the toccata & fugue in D minor, played by Vanessa Mae :-)

sensing nonsense Alison Campbell May 07

No Comments

The idea for this post comes via the team at the most excellent Silly Beliefs blogStuff (repository of news & what looks like an awful lot of other stuff) reported about a Massey University research project. The Stuff report kicks off by saying

Spirits are increasingly making their presence felt in New Zealand, spurred on by celebrity ghost whisperers.

Hmmm. I have to say, what first came to mind was the Dr Who episode where the good folks at Torchwood had been fooling around with the space-time continuum, so that cybermen were pushing through from some other dimension, & people were interpreting their partial manifestations as ghosts. (It all turned to tears, even for the Doctor, although he did eventually save the day.) But here I am, getting side-tracked again. Back to the chase!

The Stuff item goes on to say:

Massey University research reveals growing numbers of Kiwis are sensing spirits. In a recent survey, the proportion of respondents who have felt a spiritual force rose from 33 per cent in 1991, to 40 per cent.

So I trotted off to Google Scholar – couldn’t find any published papers that matched the Stuff description, so I must assume that their breathless article was based on a press release. Going by said article, it appears that the researchers were looking at New Zealanders’ beliefs about the existence of ghosts/spirits. Among other things, they seem to have found that around 50% of people are ‘interested in spiritual forces’ (not quite the same thing as ’sensing’ them), while 25% believe that ‘the dead have supernatural powers.’

Now, that’s about all that can be inferred about the research, so I’m not going to discuss that further here. What I do want to do is look at the way the findings were portrayed by Stuff (& presumably by other media outlets who picked up the story). Listen up, Stuff: a statement by x% of respondents that they believe in a spirit world is NOT THE SAME as spirits actually existing! The researchers seem to have been examining changes in beliefs or belief systems, not accumulating data to test the idea that the object(s) of belief are real. The fact that somone claims to believe in ghosts does not mean that ghosts exist. The great (& unfortunately late) Carl Sagan commented in The demon-haunted world that he could claim that there was an invisible dragon living in his garage. A sceptical response to this claim might be, sorry, can’t see anything. Ah, said Sagan, but what if I said it’s an invisible dragon?

The lead researcher is also quoted as saying

Programmes like Sensing Murder and Ghost Whisperer have popularised psychic experiences that in previous times would have been dismissed as symptoms of psychosis.

The Sensing Murder psychics have almost become spiritual celebrities.

First up, I suspect that it’s only fairly recently that anyone claiming to see ghosts & spirits would have been encouraged to have a quiet chat with a psychiatrist. Go back a few hundred years and someone making these claims might instead have been treated with respect (& in some societies that’s probably still the case).

What’s more, where’s the evidence? Stuff makes the fascinating claim that [s]pirits are increasingly making their presence felt in New Zealand without any real data to support it. Where’s the cold, hard, unequivocal evidence that a ghostly presence has indeed made itself felt? And I don’t mean via self-professed psychics, either. Why would a ghost need to be ’spurred on’ by ‘celebrity ghost whisperers’ or anybody else, if they really wanted to contact the living? Particularly when as interpreted by said ghost whisperers, they say such inane things… (Not to mention the cost – why would your dearly departed wish to speak with you only after you’ve forked out a reasonable amount of money? For those who think, there might just be something in what psychics claim to be able to do – you might just want to read this article on ‘cold reading’ and other tricks of the trade.)

On the thoughtful, investigative journalism scale, the Stuff item deserves an F.

theorists of the lost ark Alison Campbell Apr 28

5 Comments

 From today’s Royal Society compendium of science-related headlines comes this newsflash:

Evangelists claim Noah’s Ark discovery on Turkish mountain: Archaeologists have recovered 4,800-year-old pieces of wood from a structure 4,000 metres up Mount Ararat.
Well. Claims like this crop up fairly regularly, & then disappear without trace. And I have to say, I’m rather underwhelmed by this one, as well. Not least by the nature of the evidence.
 
For example, you can find pictures from the expedition on-line (& thanks to PZ for the link) – it’s news to me that the Ark had stone steps and squared-off stone walls, for example… That & the wooden structures shown suggest to my untutored eye that we’re looking at the remains of a land-based settlement rather than a floating bestiary. It’s also intriguing that carbon-dating data are being claimed as evidence for the veracity of this interpretation, given the way in which many creationists reject any form of radioisotope dating mechanism as inherently flawed. There’s a contradication there somewhere.
 
And – the supposed ‘Ark’ in the images looks awfully like a mountain ridge with an oval drawn round it. Outlines like that do a lot to help the eye ’see’ something that isn’t there; something to do with the fact that we are pattern-seeking animals. (This also explains why some people see the ‘man in the moon’, and a giant ‘face’ on Mars.) Nup. Not convinced.
 
(If it is the Ark, shouldn’t it contain an awful lot of, well, sub-fossil poo? A ship full of animals would generate an awful lot of organic waste over the duration of the voyage…)
 

think before you write (or at least, before you hand it in) Alison Campbell Apr 26

4 Comments

I’ve spent a lot of time lately marking essays from my first-year students. For many of them, this may be the first essay they’ve written in a while, & along with getting their heads around the essay-writing process, they’ve also got to come to terms with the academic environment that they’re working in. That means: making sure that they research the topic; read reasonably widely around the question they’ve chosen to work on (I always give a choice); make sure that as they write they cite the sources that they’ve used; include a properly-formatted References section; choose good-quality sources of information, & so on & so forth.

All that is probably a fairly daunting task if you’re new to the game, so I try to give as much guidance & direction as possible. There’s an outline of some of the key ideas i’ll be looking for, for example. And we give a lot of instruction, in the Study Guide & in tutorials, on things like references, proper citations, how to paraphrase, together with the really basic stuff like double-spacing, wide left-hand margins (for marker’s comments)…

Now, if you’re given that sort of support, use it! Follow instructions! I have lost count of the number of times I’ve written ‘please follow instructions’ on these essays, but overall far too many people have lost marks that they didn’t need to…

But going beyond that, it’s also necessary to think carefully & critically about the question & how you’re intending to answer it – the meaty stuff, that goes beyond issues of presentation. If you’ve been following this blog for a while, & you’re preparing for Scholarship Biology at the end of the year, you might remember me saying that a common problem for schol candidates is a tendency to do a ‘brain dump’: to write down anything and everything that might seem remotely relevant to the topic. This doesn’t do you any favours, because it does rather suggest that you haven’t thought your answer through – and skills such as critical thinking & the ability to integrate information into a coherent whole are some of the attributes that the examiner is looking for in successful candidates.

To take one of my essay topics as an example (I’ll blog about the science itself later on, cos it’s really very cool and interesting stuff): the question was based on a research paper looking at the relationship between a species of marine crustacean called Santia and the algae that grow on the animal’s exoskeleton. I asked my students to explain the nature fo the relationship and to discuss its advantages and disadvantages to the organisms involved.

Now, the relationship is essentially a symbiosis (where 2 different species live in close contact for part or all of their life cycles) or, more specifically, a mutualism, because there are advantages to both species. So the first thing I’m looking for is some definitions, and an explanation of why it’s a mutualism. But you wouldn’t include a whole lot of stuff on endosymbiosis & the origins of mitochondria & chloroplasts, for example, because that’s not relevant to the question in the form I set. (I could have asked my students to place the Santia/algal relationship in the wider context of the evolution of symbioses, but that would be a whole different ballgame.)

Similarly, once you got into discussing the advantages/disadvantages, you should be focusing on the two organisms involved in this particular example. Yes, there are a lot of other symbioses around, and perhaps fewer mutualistic relationships, but I don’t want to hear about those in a lot of detail. What you could do is point out that the whole symbiosis-mutualism thing isn’t actually all that clear-cut, and whereSantia & its carapace-dwelling algae fit on the spectrum.

But you might well include material on what closely-related species do, because the relationship we’re talking about is unique. How do other species of isopods & algae get by? What sets Santia apart? Attention to that sort of detail turns an otherwise OK essay into a very good one.

But it does require careful thought :-) So take the time to do that (yes, even in the pressure-filled context of a Scholarship exam!); it’ll repay you in the end.

chemo vs cancer, science vs disease Alison Campbell Apr 24

5 Comments

In another few weeks it’ll be 27 years since my mother died of metastatic breast cancer. Not a nice way to go – but eased by a very caring family GP and the wonderful people at the local hospice, who helped her die with dignity at home.

I was reminded of this by reading David Gorski’s recent post on Science-Based Medicine: chemotherapy vs death from cancer. In the US at least (although I suspect here as well), ‘alternative practitioners’ offer a wide range of ‘therapies’ for people with cancer, claiming ‘natural cures’ & the option of ‘dying healthy’ if you must die at all. Unfortunately for those choosing this option, modern chemotherapy really is the best treatment option for many cancers (alongside radiotherapy & surgery, depending on how the disease manifests itself). If those alternative therapies worked they’d have become part of the mainstream pharmacopaeia by now. Dr Gorski agrees that yes, chemo can be quite brutal in its effects – but the cancers it is aimed at are at least as bad. (The reason chemo can have serious side effects is that it’s a fine line between killing the cancerous cells & killing normal tissues.)

Anyway, Dr Gorski’s article led me to think about the way that other proponents of ‘alternative therapies’ make special claims for their own products, and level all sorts of accusations against mainstream medicine. Over on SciBlogs, for example, a local anti-vaccination advocate was quoted in the comments thread for an article on vaccination that the sooner New Zealand drops all vaccinations, the better. In support of their views that vaccinations are Bad, Bad, Bad, the commenters on that thread trotted out all the usual claims: that vaccines cause autism (false – there are no data to support this claim); that vaccines contain ‘neurotoxic’ materials including formaldehyde (true, but our bodies make far more of this, during normal metabolic processes, than is contained in any dose of a vaccine); that vaccines contain ‘aborted foetal tissues’ & ‘monkey kidneys’ (serious scare tactics, these, & also false). These claims have been ably addressed elsewhere, both on SciBlogs & on overseas sites such as Science-Based Medicine & Orac’s Respectful Insolence.

But I wonder - do the people advocating a complete cessation of vaccination really seriously think about the consequences of this? My mother contracted polio as a teenager in the 1930s. She was lucky – the virus ‘only’ paralysed nerves in her hand and leg. She recovered, but for the rest of her life the muscles in those areas were smaller & weaker than on the unaffected side. She never had to spend time in an iron lung – and at the height of polio epidemics, some overseas hospitals had entire wards devoted to patients in these machines, which ‘breathed’ for people who could no longer breathe for themselves because the necessary muscles were paralysed. Mortality rates from polio – before the widespread availability of a reliable vaccine – were around 5%, with a further 35% of those infected suffering some level of paralysis.

Or what about diphtheria? The mortality rate for this bacterial disease is between 5 & 10%, & outbreaks still occur, even in industrialised nations. Diphtheria often has respiratory symptoms, due in part to severely swollen lymph nodes in the neck. But the bacterium (Clostridium diphtheriae) also produces metabolic by-products that can lead to damage to the heart & nerves, & it can sometimes cause serious secondary infections in the skin.

And there’s measles, whooping cough, rubella – while in the industrialised world, with its generally good provision of health care, most of those who contract these infections go on to recover, they are not trivial diseases. (I couldn’t believe one comment I read a few months ago, where the writer commented that whooping cough was a trivial illness; her child had ‘only’ had a serious cough for a week… & was unwell for several more.) All have a rate of serious complications, including death, that is several orders of magnitude higher than the unquestioned rate of complications due to vaccination.

And I wonder – are people so ready to advocate a return to a world where these diseases are common because they’ve never had first-hand experience of the effects? After all, the highest rates of illness occur in the ‘third world’, which is a long way from the experiences of most people in comfortably first-world New Zealand. And is part of it due to a failure on the part of scientists, doctors, the education system at large to help people understand things like relative risk, and how science-based medicine operates? And – a key part of this – how well do we communicate the idea that correlation does not equal causation: that because B happens soon after A, for example, this is not proof that A caused B?

I think we still have a long way to go on these things.

______________________________________________________________________________

PS And those with a genuine interest on what <i>is</i> in vaccines (as opposed to the wilder claims being made over at Sciblogs) might like to read this post from ERV:  – basically a group of researchers did DNA analysis on most of the main vaccines, looking for evidence of contamination from other sources (monkey tissue, foetal tissue, etc etc). The result: modern vaccines are clean.

what science is Alison Campbell Apr 18

No Comments

“Science can give us answers, but they are not true just because science says so. They are true or at least a usefully accurate approximation of reality because anyone (at least with training and equipment) can perform the same tests or experiments and replicate the results for themselves.”

From a commenter over at Science-Based Medicine. Says it all, really.

_________________________________________________________________________________

and also, from the same thread (different ’speaker’):

“You can have faith in religion, you can have faith in leadership, you can have faith that a treatment will help you since it is based on scientific study, but you cannot have faith in science. In science, you should only have skepticism and curiosity. The only faith that you should be asked to accept in Science-Based Medicine (which is not science), is that what has been observed in the past, will likely be observed in the present.

“You need only believe in a part of science when you repeatedly observe that part of science being correct. That belief is justified so long as you continue to observe the same results. Science should be belief in what you observe, not faith. There are questions that science cannot answer, faith can be applied to those questions.

“In a scientific argument, the better argument will lead to a better hypothesis or experiment, not to a change in policy or lifestyle. Scientific arguments are often obtuse to anybody who has not been involved in the study of a particular subject. There are many who take advantage of that obtuse nature, and use sounding sciency to sway opinion without having the data to back it up.”

i get mail… Alison Campbell Apr 14

No Comments

… although I have to say, it’s nothing like as interesting (!) as some of PZ’s correspondence :-)

However, I thought I’d reproduce it here (despite the fact it isn’t really ’science’) as it could form a useful basis for a critical thinking exercise (& possibly one in creative writing…). I’ve included my correspondent’s name as I very much doubt that it’s her (?) real one.

Subject: hello, dear

Greetings,

 I would like you to permit me to apply through this medium for your co-operation and to secure an opportunity to invest with you in your country.

 I have a substantial concealed capital honorably inherited from my late father (Mr. Timothy Cohen); He was killed by the rebels in the ongoing political crisis in our country that have resulted to war since this past few years.

 I intend to invest this money in profitable and lucrative business venture of which you are to advise and execute the said venture over there for the mutual benefits of both of us. I shall be glad to reserve this respect and opportunity for you, if you so desire, I want you to be rest assured that everything is in order and legitimate.

 I am 19years old, an orphan presently living with a family that I never knew from Adam, Imaging being alone at this tender age.

 I will give you all information?s needed as soon as I hear from you to further this transaction immediately.

 Best Regards,

 Miss Janet Cohen

 

OK, for a start, e-mails with subject lines like that go straight in my junk folder & often don’t see the light of day. (I have to check the folder occasionally as for some reason the system also junks e-mails from my students if they aren’t using their Uni e-mail addresses.) If you want me to look at a message, at least give it an informative title! Even my Significant Other doesn’t write like that :-) So, ‘another scamming e-mail’, I thought to myself.

I’m not quite sure how one could dishonourably inherit something. Short of nefarious activity on the part of the inheritor, that is. But I notice that while Janet (?) names her ‘father’(?) she has somehow forgotten to identify the country they lived in. I’m sure that was accidental… But of course this makes it a) harder to check her bona fides & b) increasingly likely that her intentions are dishonorable.

The spelling? Well, that could be excused from someone who (genuine or otherwise) doesn’t have English as their first language. It’s interestingly inconsistent, isn’t it?

What are they offering? Unusually, this particular letter-writer doesn’t say (they generally wave the carrot of 10% – or some similar proportion – of a rather large sum of money). I guess s/he wants me to be sufficiently intrigued to write back for these all-important details, & then s/he’d be able to string me along some more. And then get me to commit – because the punchline is generally that I need to either make a ’small’ enabling payment, or hand over my bank account details, in order to expedite the deal. It’s often a few hundred US dollars – might seem like small bikkies, but it would rapidly add up if enough people were foolish enough to send the cash. (And of course, they’d never see it again.)

But – why on Earth, if this person is up-front, would they make an offer like this to someone they’ve never had contact with before? Surely, if they’re genuine, they’d be dealing with a mainstream financial institution? Would you be following through on this wonderful offer from someone completely unknown to you, one which seems almost too good to be true?

Well, unfortunately, far too many gullible people do just that every year. despite warnings from government and other agencies. I guess the lure of what looks like easy money, at ridiculously high rates of return, is just too hard to resist. Just remember – if something looks too good to be true, then it almost certainly is.

(I mentioned creative writing… The Scambuster419 site, based in the UK, contains some excellent examples. And of course there’s the very creative Scamming the Scammers site. However, I would recommend that you don’t try this at home; leave it to the professionals! Seriously – look at the examples for interest, education, & amusement. But some of the scammers can turn a bit nasty when they realise the tables have been turned.)

more bad stats & other stories Alison Campbell Apr 12

No Comments

I have a pile of marking to get through this week, & so that I can make a good start today I thought I might just point you at some interesting posts from other science bloggers.

Another tale of statistics from Ben Goldacre: this time it’s the frankly appalling story of where the lack of understanding cases of statistics can take us. The ‘comments’ section of Ben’s post is also well worth reading.

From Brian Switek: the potential link between forensic science and left-over leopard dinners

And from Orac: a thorough critical examination of a recent NZ press release that announced a study of chiropractic as a means of improving labour….

Enjoy. And hopefully I will have more time tomorrow!

science embargoes & early releases – an update on the ‘new hominin’ story Alison Campbell Apr 09

No Comments

I wrote a few days ago about the over-hyped media stories around the then-upcoming release of a new Science paper about a possible new hominin species. At the time is seemed really strange & definitely a spoiler rather than a teaser – by the time the actual paper came out, there’d already be a set of public perceptions around the story that the actual science would be unlikely to change. Anyway, here – courtesy of Grant – is an excellent take on the various goings-on & what seems to be a less-than-optimal response by Science to whoever broke the original press embargo. Fascinating insight into the world of journalism.