Discover and read the best of Twitter Threads about #StationaryRepresentation

Most recents (1)

🧩Three intriguing concepts in the world of #DeepLearning: #BackwardCompatibility, #StationaryRepresentation, and #NeuralCollapse. Their connection may hold the key to better deep learning models with possibly novel ways to use them
(1/7)
🤝Backward Compatibility enables matching internal feature representations from different neural networks. Stationary Representation maintains feature spatial configurations fixed during learning. How does Neural Collapse fit in?
(2/7)
💥Neural Collapse is when feature representations converge towards a simpler structure during training. This fascinating phenomenon is strongly related to compatibility and stationary representation.
(3/7)
Read 7 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!