2/3 The multicam + video data, temporal continuity of a slowly moving viewpoint, close collaboration with data sourcing and labeling, and the infinity-sized dataset of unlabeled clips dramatically expands creative modeling opportunities on the neural net side
3/3 It's still early for this task; Help us make these panoptic segmentation predictions perfect and realize the downstream impact: tesla.com/AI
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
Really excellent reading and pointers from @ericjang11, putting into words a new "Just Ask for Generalization" approach/philosophy to AI that the field has been slowly internalizing recently. Few more thoughts in thread ->
The first time I was personally shook by this philosophy was when I saw the "Just tell the AI to be nice" meme on my Twitter, which is the same idea - GPT can be seen as a super multi-task policy (trained via supervised learning), and prompt engineering is the goal conditioning.
wrt consciousness I do suspect it can just emerge in large-enough models trained on hard-enough tasks. The idea that emergence of consciousness is just another "grokking" phenomenon was the inspiration for my earlier short story "Forward Pass" karpathy.github.io/2021/03/27/forβ¦
A fun story of trying to buy one small black coffee at Starbucks the other day. Normally this is one $5 transaction at the register, 5 seconds at the drip, done. But this Starbucks store (for some reason, covid?) was only taking online orders. There's a QR code to get started.
Now I really wanted my coffee but braced for what was to come. I unlocked my phone, scanned the QR code, went to the site, am told to download the app. So I download the app. Now I'm told I have to create an account. So I create an account. Now the app is asking my location.
Err, deny location privilege, of course! I scroll through the USA map all the way to the store I'm at, tap on it to select it. I scroll through the entire menu trying to find my simple small black coffee. I add it to the cart. Check out. Luckily, looks like I can Apple Pay!