Discover and read the best of Twitter Threads about #actionrecognition
Most recents (1)
📢 Introducing SynSE, a language-guided approach for generalized zero shot learning of pose-based action representations! Great effort by @bublaasaur and @divyanshu1709 #actionrecognition
Paper: arxiv.org/abs/2101.11530…
Code: github.com/skelemoa/synse…
🧵👇
Paper: arxiv.org/abs/2101.11530…
Code: github.com/skelemoa/synse…
🧵👇
For enabling compositional generalization to novel action-object combinations, the action description is transformed into individual Part-of-Speech based embeddings.
The PoS-based embeddings are aligned with action sequence embedding via a VAE-based generative space. This alignment is optimized using within and cross modality constraints.
