Over-squashing is a common plight of GNNs occurring when message passing fails to propagate information efficiently on the graph. In a new post, we discuss how this phenomenon can be understood and remedied through the concept of Ricci curvature
(though in a different order I have initially promised :-)
The second installment of this post will discuss whether (and when) diffusion improves graph learning, analysing the popular DIGL rewiring method of @klicperajo@guennemann Weissenberger from a geometric perspective
Our work was inspired by the influential paper of @urialon1 that studied over-squashing in graphs
Ricci curvature is a fundamental object in differential geometry of manifolds. It has gained visibility outside this field thanks to Ricci flow, a geometric PDE used by Grigori Perelman to prove the famous Poincaré Conjecture
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Some personal news: I will be joining @CompSciOxford@UniofOxford as @DeepMind chair in #AI and Fellow at @ExeterCollegeOx I owe this honour to the amazing students and collaborators with whom I have had the privilege to work during my career
I would like to thank the HoD Leslie Goldberg and former HoD @wooldridgemike for their support and patience that allowed this appointment to happen
I will remain the Head of GraphML at Twitter and will keep an honorary affiliation at Imperial where I have many amazing colleagues and exciting collaborations
After a hiatus, a new series of blogs posts. Do differential geometry and algebraic topology sound too exotic for ML? In recent works, we show that tools from these fields bring a new perspective on graph neural networks
This geometric view on deep learning is the convergence of many old and recent research threads and joint work with @joanbruna@PetarV_93 and @TacoCohen
It was a new and rewarding experience, from which I learned a lot. I was surprised that such a technical topic would attract >200K views and >6K claps in less than half a year.