Thread by @ejames_c

1/ Let's talk about accelerating expertise.

You want to get good. You want to get good fast. How do you do this?

In 2008 and 2009 the US Department of Defence convened two meetings on this very topic.

Here's what they found. (Hint: the answer is NOT deliberate practice).

2/ First: let's put ourselves in the position of a training program designer.

You are told that you need to get a bunch of novices to a good level of competency in 3 months.

It used to take them a year.

How do you do this?

3/ If you're like most people, you'd probably say "Ok, let's create a skill tree. Let's map out all the skills needed from most basic to most advanced. Then let's design a syllabus, where complex skills build on simpler skills."

In other words, you'd replicate school.

4/ Aaand you would have failed your assignment.

The researchers who the DoD consulted said, basically: "No. Stop. Get rid of all that."

Your approach, the mainstream pedagogical approach, is too slow.

But why is it too slow?

5/ For two reasons:

1. Teaching novices atomised skills means they will build incomplete mental models of a domain. At some point, these incomplete models will interfere with progress. They become knowledge shields. You now have more work: you will need to break those shields.

6/ But the second reason is more pernicious.

2. Experts are able to see connections between concepts that novices cannot. Teaching novices a hierarchy of skills usually prevents them from learning those linkages early.

In other words, they're likely to get stuck.

So: SLOWWWW.

7/ So what do you do?

Well, you cheat.

It turns out that if you can go to domain experts and EXTRACT their mental models of expertise, you can use those models for training!

This means you'll be able to train for what the experts ACTUALLY HAVE in their heads.

8/ The set of techniques that allow you to extract mental models of expertise is called 'Cognitive Task Analysis'. It's been around for 30 years now.

You know how experts can't really explain how they 'know' things? Yeah. CTA gets around that.

9/ I've written about CTA in the past. For instance, I helped @johncutlefish with some skill extraction a few weeks ago. You may read about that experience here: commoncog.com/blog/john-cutl…

And the most comprehensive book on it is this one: goodreads.com/book/show/4433…

10/ Anyway, back to accelerating expertise. So you now know there is this superpower called CTA. Well, how do these researchers use it?

The short answer is that they use it to create training simulations, so that students CONSTRUCT the mental model that the experts have.

11/ Here's how they do it:

1. They identify the domain experts.
2. They do CTA.
3. During CTA, they collect details of difficult cases to build a case library.
4. They turn that case library into a set of training simulations.
5. They sort the scenarios according to difficulty.

12/ The training simulations serve as the training program.

This is much better, because:

1. Good simulations have good cognitive fidelity to the real work task. Performance transfers.
2. There is no artificial atomisation of concepts! Learners must deal with full complexity!

13/ Ok, here's an example. Trigger warning: Afghanistan, IEDs, military. Skip ahead if necessary.

After 9/11 the US military had problems with IEDs. These were roadside bombs. Think: Hurt Locker. The DoD started spending a lot of money to detect and defeat IEDs.

14/ As part of that effort, the DoD commissioned a CTA. Apparently some of the Marines and Soldiers were able to detect IEDs. They would 'have a bad feeling', and take measures to avoid a danger zone.

The military wanted to know how. If they could extract, they could train.

15/ The group of NDM researchers quickly realised this was a bloody difficult skill domain. Think about it: Iraq is large. Within Iraq, different towns and even neighbourhoods had different IED tactics. And Afghanistan was different still.

Plus the enemy was constantly adapting.

16/ And they needed to extract something general. Something that would work regardless of where a young Marine was deployed.

Eventually they realised that the most skilled Marines were putting themselves in the insurgent's shoes.

They could think like an IED emplacer.

17/ Think about it: if you wanted to emplace an IED, how would you trigger it? Say you trigger wirelessly. You would need a spotter. You would need to know when the Marine convoy was near enough to the bomb.

So the insurgents would use a marker. Like a pole, or a rock formation.

18/ These were the cues the Marines were picking up on.

The researchers had successfully extracted this mental model of expertise. Now: how to train?

Ask yourself this: would you set up a Powerpoint presentation? A lecture of IED tactics?

That would be dumb.

19/ Here's what the researchers did: they took a video game that the military used for training (called VBS) and built a module for it.

The players had to play AS an insurgent.

They had to emplace IEDs and target blue team convoys. This is what one of the researchers said:

20/ Note how rapid the training could be. Note how quickly you could enable the construction of the actual mental model.

Eventually, Marines and Soldiers would play a few scenarios before deployment. It saved lives.

21/ Let's wrap up. I've described an accelerated expertise training program, developed by applied researchers in military and industry contexts.

It is remarkably novel. I've written about some of the underlying theories before:

https://twitter.com/ejames_c/status/1422123042432380928?s=20

22/ And it's just scratching the surface. For a full summary, including some other uses of the research, read my blog post here: commoncog.com/blog/accelerat…

23/ Follow for more threads about expertise, business decision making, and so on.

Or subscribe to my newsletter if you don't want to miss out on longform essays here: commoncog.com/blog/subscribe…

Thank you for reading!

PS: If you want to learn CTA, you may sign up for a course here: cta.institute

It's run by the OG researchers who invented some of the techniques. 😊

One of them was involved with the IED project.

I've signed up, and I encourage you to do so too!