Thread by @shiwalimohan

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird It is a great paper for two reasons.
1. It is a systematic analysis of what DALL-E does, its strengths and weaknesses. I find that a lot of #LLM 'papers' are descriptions of the engineering with very little analysis.

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird 2. It highlights what a language model will need when it is used for communication between intelligent agents.

Language for communication is a different computational problem than language for information retrieval. Most modern #NLP is the latter.

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird We @PARCinc are exploring the former - arxiv.org/abs/1604.02509. We use the Common Model of Cognition #CMC as an agent architecture and instantiate language comprehension in a complex agent.

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird @PARCinc In related work, @preetiramaraj found that humans use language/dialog to teach other agents about #WorldModels: i.e., how to represent structure in our physical world, how to reason about tasks.

arxiv.org/abs/2102.06755

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird @PARCinc @preetiramaraj The difference is nuanced but very important:

1. Learning patterns in human language
2. Learning language to communicate & learn about our world.

1. is classic #NLP, #LLM research - powerful for information retrieval.

2. is a nascent research and also why humans use language

@TheRealDrDre2 @ElliotMurphy91 @GaryMarcus @EvelinaLeivada @john_e_laird @PARCinc @preetiramaraj Lawrence Barsalou in @DProcesses highlights the difference between 'language for archival purposes' v/s 'language for communication'.

Seems like in #AI and #ML we ran far with the first use of language but don't know enough about the second.

web.archive.org/web/2003120619…