Federico Pernici Profile picture
Computer Vision, Machine Learning, Deep Learning, AI. Assistant Professor at University of Florence | DINFO | MICC. Opinions are my own.
Mar 21, 2023 7 tweets 3 min read
🧩Three intriguing concepts in the world of #DeepLearning: #BackwardCompatibility, #StationaryRepresentation, and #NeuralCollapse. Their connection may hold the key to better deep learning models with possibly novel ways to use them
(1/7) 🤝Backward Compatibility enables matching internal feature representations from different neural networks. Stationary Representation maintains feature spatial configurations fixed during learning. How does Neural Collapse fit in?
(2/7)