prev: @BrownUniversity, @uwcse/@uw_wail phd, curr: research scientist @cruise. 0.1x engineer, 10x friend.
machine learning, cars ruin cities, open source
Jan 9, 2023 • 7 tweets • 3 min read
Prediction: @Microsoft will launch an AI assistant product in the next 5 years, built on ChatGPT. It will blow Google Assistant, Amazon Alexa, etc out of the water 🌊
Think about it... 1/n
Imagine @AdeptAILabs's demo video (
) but with ChatGPT and working with any app running on Windows...
MSFT already has the necessary puzzle pieces in place: 1. Exclusive access to ChatGPT/related tech, thanks to their close partnership with @OpenAI
Sep 13, 2022 • 13 tweets • 5 min read
📜🚨📜🚨
NN loss landscapes are full of permutation symmetries, ie. swap any 2 units in a hidden layer. What does this mean for SGD? Is this practically useful?
For the past 5 yrs these Qs have fascinated me. Today, I am ready to announce "Git Re-Basin"!
arxiv.org/abs/2209.04836
We show that NN loss landscapes contain effectively only a single basin(!) provided sufficient width. Even better, we develop practical algos to navigate these basins...