12 Comments

In an earlier article, Do TED lectures need better vetting?, I pointed to recurring ‘slips’ in TED(x) events where unsound material were being presented and asked if better vetting of speakers and their material might be needed, especially for the independent local/regional TEDx events.

TED editor Emily McMagnus joined the discussion and invited suggestions. I’ve copied my latest reply to her here as a separate post to give it a wider readership and to invited readers to offer their thoughts and suggestions, as the original is currently buried in the comments of an old post. (I’d encourage interested readers to read the original discussion as it offers some background to how TED and TEDx events are hosted and run.)

Being pushed for time I’ve presented my comment verbatim, bar some very light editing and removing the first paragraph as it would be out of context here.[1] Some less-then-ideal grammar or phrasing remains! Readers should take care to distinguish TED and TEDx events.

Emily,

[…]

As I see things TED has successfully introduced what we might describe as an ‘intellectual entertainment’ venture, which aims to have high standards.

When products that state aiming to high standards succeed, then is often push-back from the customer base if they perceive it as falling short of it’s aims. This is true, for example, of some higher-end electronic goods. It seems to me that this comes with the territory!

I perceive that the core product (TED.com) will be concerned about events or talks that embarrass the TED brand, in much the same way that an electronics company might have concerns over product flaws in an higher-end devices.

A point I’m trying make here is that the concern lies with the image of core product, even if the issue itself occurs within the nominally ‘independent’ events. There’s a splash-back effect.

One element of this is that many consumers will not (fully) appreciate the independence (to whatever degree) of the TEDx events – they’ll simply see the global branding. I don’t think education of the details of the TEDx events will fix this – that sort of consumer is unlikely to spend the time on it.

As I wrote fairly early on in the discussion I was thinking of “a vetting of the speakers and their topics independently of the regional organisers, essentially crowd-sourcing the problem”, “loosely thinking [along] the lines of TEDx event organisers being made to present the talk titles and speakers, say, a few weeks ahead of time and these being available on a common channel for comment, so that people can give a heads-up if the speaker or topic needs closer inspection or is likely to be unsound, etc.”

What I am thinking of might be considered as an extension of the discussion forums on the TED.com site.

One thing on-line communities like is to be able to engage in a real way, to feel that they are contributing.

I haven’t time to outlay all possibilities (of course!) but to at least give the general direction, you might imagine a channel that is part of or parallel to the discussion forums where the on-line community would be presented the initial list of speakers and topics for upcoming TEDx (and TED?) events and have a means to give feedback.

Each would be tagged with the particular event, so that organisers of that event can easily track comments on their particular event.

From this could be drawn summarises for both the TED and TEDx organisers. TEDx organisers would hopefully use the summaries to aid their decisions. TED organisers can use the summaries to be alerted of TEDx events which might be of concern to them.

I can’t suggest precisely what these summaries might involve – that would come after a channel would be developed. One might be a simple score of a voting scheme, perhaps accompanied by a short text summary of a moderator of that event’s channel (with the summary put to readers of the channel and a vote of how they feel it represents the consensus?). There are numerous variations, of course, too many to explore here. The mechanism need not be complex unless it shows later to need refining – after all you would hope the number of truly difficult cases would be (relatively) rare.

A key aim would be to get this feedback before TEDx (or TED) websites show the speakers and their topics in any sort of ‘official’ way.

Another aim is to provide information in a way that involves little time to the respective organisers of the events. As each event has a limited number of speakers, at worse they would the same number of summaries as speakers – in the event that every speaker they offered was considered dubious! In practice, you’d hope they would only receive ‘red flags’ for a small minority of the speakers and their topics.

Another aim is to provide the core TED team some early alert of potential problems before they become tied to the brand.

Finally, there’s community involvement. ‘Spun’ properly this might be a way to draw in an on-line community through giving them a means to be actively involved that doesn’t require they be physically present at the location or attend meetings, etc.

I should clarify my early comments in that by referring to ‘locals’ knowing the potential speaker’s inclinations, I do not mean ‘local’ in the sense that the person can walk up to the organisers and shake their hand or contribute directly to an event‘s development in a physically-present way. I mean that they are in same country (or state in the USA), that they are within the ‘sphere’ that the speaker is known.

I hope it’s clear this does not involve the on-the-ground, physical presence at the local TEDx organising group that Jason keeps insisting that it does. A key point is that is does not and that it assists those that are doing the on-the-ground work, aiding them to do better through drawing on the on-line community (aka ‘crowd-sourcing’).

One element of this that the speakers will almost certainly have presented elsewhere – it’s why TEDx events will be aware of them – and these more ‘local’ presentations can clue in on-line contributions to the [vetting] process.

Alison’s suggestion of strengthening the licensing is an alternative, but my opinion is that mistakes will continue because, as I tried to relate earlier, a small group of individuals simply can’t spot all the problems.

Taking the up-coming TEDx Auckland event as an example, and just taking the first name on the list, I couldn’t really assess, say, Sean Gourley’s likely contribution. Nothing against him, I’m sure (hope!) he’s fine fellow, but I’ve seen any number of physicists express some truly awful biology, for example!

In practice, it seems that he’s to speak on High Frequency Trading and the New Algorithmic Ecosystem. I know very little about financial trading systems (although I know quite a bit about algorithms, but probably not the kind he will be referring to).

In that article Sean writes, “The only requirement is that the content was somewhat experimental, with bonus points if it was a touch controversial.”

So, the TEDx organisers asked for “somewhat experimental” and “a touch controversial” material.

Let’s leave aside debate how “somewhat experimental” or “a touch controversial” might relate to “ideas worth spreading” [the TED slogan] for the sake of using it as an example.

Experimental would mean that it’s not yet fully vetted as ‘sound’ – in this case I’d want an assurance that this is made explicitly clear in the talk, lest the audience be (unintentionally) mislead.

Controversial can mean different things to different people. Were I involved in organising this, I’d be out-sourcing feedback on what kind of controversial this is. Do financial traders think he’s off-the-wall, or solid? I couldn’t possibly tell. Point here is that this will repeat itself in every TEDx event.

A common on-line channel might allow people to step up and relate what they know without either the TEDx or TED organisers having to actively source this feedback (bar the effort of setting up the channel in the first instance) before presenting the speaker or the topic on an ‘official’ website. In Sean Gourley’s case ‘local’ feedback would most likely be from San Francisco, where he now lives, not Auckland.

I have little doubt effort is already put in, but wouldn’t wide contributions make this easier and help avoid some the sillier cases we’ve seen end up in TED(x) events?

Footnotes

1. Also because readers would have to wade past it! It reads:

I’d like to elaborate on my suggestion so that it’s ‘place’ might be properly seen. This will regrettably be briefer than I would like as I’m pressed for time. I may later revisit the issue with a fresh article, which I hope will help readers focus on the suggestion, rather than sidelines. (In fact, looking at the length of this I may anyway to draw fresh readers and commentary – I’m sticking with posting it here in the interim as you’ve written here and I’d welcome your comments.)


Other articles at Code for life:

Do TED lectures need better vetting?

Media reporting of subsequent findings

Media thought: Ask what is known, not the expert’s opinion

XMRV prompts media thought: ask for the ’state of play’

Banished from science writing. Words, that is.