Tau li et al. effectively augment NNs with logical constraints works to provide interpretability and control over some layers.
"If you have large datasets you should just believe in the data but with smaller datasets logical rules definitely help"
Augmenting Neural Networks with First-order Logic
Tao Li and Vivek Srikumar
arxiv.org/abs/1906.06298