Niru Maheswaranathan Profile picture
Trying to separate signal from the noise; research engineer at Google Brain. Formerly @Stanford, @DukeU, @SC_GSSM. @dnag09’s +1. Opinions my own. ⚽️☕️👨🏾‍💻
Jun 27, 2019 4 tweets 3 min read
New work out on arXiv! Reverse engineering recurrent networks for sentiment classification reveals line attractor dynamics (arxiv.org/abs/1906.10720), with fantastic co-authors @ItsNeuronal, @MattGolub_Neuro, @SuryaGanguli and @SussilloDavid. #tweetprint summary below! 👇🏾 (1/4) We analyze recurrent networks trained to perform sentiment classification, a standard natural language processing (NLP) task. We find that RNNs trained on this task as surprisingly interpretable using tools from dynamical systems. (2/4)