denoising in a discrete input has always fascinated me ever since i read jmlr.org/papers/volume1… by Vincent & @hugo_larochelle et al., and yoshua has always motivated me to look into denoising for sequence modeling ever since 2013.
it took me 5 years to look at refinement in the discrete space with @jasondeanlee & @elmanmansimov arxiv.org/abs/1802.06901. it took another 2 years to look at refinement in the hybrid space with jason and @raphaelshu aaai.org/Papers/AAAI/20…
now, we have finally moved on to refinement in the continuous space for sequence modeling with discrete tokens, again with awesome @jasondeanlee & @raphaelshu arxiv.org/abs/2009.07177.
and, ofc, the journey continues!
it's a small step overall that took 7 years, but i like it!
tagged a wrong jason lee. it should’vebeen @jasonleeinf
same here. it should’ve been @jasonleeinf
here's the new link to the latent variable approach: arxiv.org/abs/1908.07181
Share this Scrolly Tale with your friends.
A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.