I think (and I’m not the first to say this) NDM really suffers from a branding problem.

If you say ‘deliberate practice’, people think “ahh, practicing deliberately, that makes sense!” (Even though it’s not about that).

But Naturalistic Decision Making? What’s that?
Whereas if I say “tacit skill extraction”, suddenly people pay attention.

And then if I follow it up with “it’s totally not theoretical, it’s been used for training and UI design in the military and in health care for three decades”, they REALLY pay attention.
“Wait, does this mean I can use these techniques on experts around me to learn from them?”

Yes.

“And I can use it to interview expert users, so I can design UIs to enable or augment their expertise?”

Yes; Nasdaq already does it: nasdaq.com/articles/apply…
And then the more interesting questions:

“Are extracted tacit mental models of expertise useful when put to paper?”

If you know how to use them, yes!

“So what if we have a knowledge base with the extracted tacit mental models of our company’s experts?”

Hmmmm
“What kind of training programs can you create when you are able to extract tacit knowledge?”

Well, very interesting ones:
“Wait, you mean to say you don’t have to synthesise the expertise into an easily consumable framework?”

The bar is lower. You probably have some idea of the shape of the expertise, but you don’t have to do TOO much theorycrafting.
“So you just do simulation exercises as a form of training?”

Yes! It seems that NDM training prioritises ‘cognitive fidelity’. So long as the simulation exercise captures salient features of the actual task, you get fairly rapid expertise acquisition.
In fact they wrote a whole book for the Department of Defence on accelerating trial and error cycles! It’s called Accelerated Expertise: goodreads.com/book/show/1739…
If you want to get started with NDM, there’s an easier path now. A couple of the field’s OG researchers have set up something they’re calling the CTA Institute. Courses are available for pre-order now: cta.institute

(I’ve signed up for the self-learn version)
Otherwise, you can just give ACTA (a simpler tacit skill extraction technique) here: commoncog.com/blog/an-easier…

What was what I did. 🙃

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Cedric Chin

Cedric Chin Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @ejames_c

21 Jul
1/ I recently finished digging into a body of work around extracted tacit mental models of business expertise, and it is wild.

It turns out that business experts all share a common mental model of business, and you can do all sorts of interesting things if you have that model.
2/ Lia DiBello writes, of her work:

“… we noticed that highly talented business performers are very similar to each other. (…) business is an orderly closed system of relations between principles, and so-called intuitive experts in business have an implicit grasp of this.” Image
3/ That's an excerpt from her chapter in the Oxford Handbook of Expertise, a chonky book that I shouldn't have any right in owning.

The excerpt was so compelling I dove into Lia DiBello's entire publication history. Image
Read 34 tweets
20 Jul
My most useful tip for writing job postings is the same as my most commonly shared tip for writing, period: show, don't tell.

You want to give lots of little, hard-to-lie details that SHOW you mean what you're saying.
Don't write 'you'll have a lot of autonomy'. Write 'we want you to iterate on picking, experimenting, and measuring new marketing channels, with the support of leadership'.
Don't write 'you'll receive on-the-job training'; write 'you don't need to have domain experience because we'll teach you that. What we need you to have is a strong grasp of marketing fundamentals, so you can hit the ground running on execution.'
Read 5 tweets
14 Jul
Latest Commonplace piece is about the difference between exec development and training individual contributors.

commoncog.com/blog/exec-deve…
This is one of those essays where I'm not 100% sure of the conclusions — I'll have to put it to practice before I can say for certain.

But there *does* seem to be a tension between 'handholding' ICs, and 'throwing execs into the deep end', and it seems productive to investigate.
One thing that I'm actively chewing over: perhaps 'throwing people into the deep end' is simply a pedagogical thing, but for high potential hires.
Read 5 tweets
13 Jul
Totally obvious once you know it exists, but training methods for when you can extract tacit expertise (assuming you have access to experts, and the skill to do so) look VERY different from training methods without such an ability.
Example: tacit expertise is basically a pattern recognition process that generates 4 things: cues, expectancies, a prioritised and fluid list of goals, and an action script.

So, with this in mind, your training program ends up looking like a series of scenario simulations.
This is very different from the ‘pedagogical development and subskill identification’ view of teaching.

Here it’s “what series of varied scenarios may I design that allows students to gain the right set of cues, expectancies, goals, and actions that experts tacitly generate?”
Read 8 tweets
7 Jul
1/ My post on product taste spent 1 day on the Hacker News front page.

In that piece, I argued that 'product validation frameworks like Lean Startup consist of two bits: an explicit bit which is process, and a tacit bit which is product taste.'

So what IS product taste?
2/ If you want to succeed at product, you need to build taste. This is really the hard bit of the game.

I've spent about a decade collecting links and snippets about product taste, mostly because I suck at it (and I'm still trying to get better).

Here are some of them.
3/ Paul Buchheit, in 2010: 'if your product is great, it doesn't have to be good'.

paulbuchheit.blogspot.com/2010/02/if-you…

Buchheit's post is fascinating. It was the first time I'd seen this idea of 'just pick 3 great features, and half-ass everything else.'
Read 17 tweets
29 Jun
Something that's always bothered me: product validation frameworks (Lean Startup, etc, but mostly Lean Startup) usually talk about the methodology like the methodology is the thing.

But I've often found that product taste is just as important. commoncog.com/blog/product-v…
Product taste is tacit, and so it doesn't get talked about as much. Here's a throwaway paragraph in Working Backwards, for instance, on Amazon's PR/FAQ process:

(It *does* seem like it runs on the backs of 'people who've done it before, doesn't it?)
Corollary: if you attempt to copy the process without putting in place experienced people, the people with good product taste, odds are pretty good that you'll fail.
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!

:(