We identified a neural substrate for compositional computation through reverse engineering multitasking artificial recurrent neural networks. We call these building blocks dynamical motifs, and they can be composed in different ways to implement different tasks.