I was pretty excited to watch $INTC 's Architecture day yesterday - very cool upcoming parts. Intel is definitely coming back…. then I watched $TSLA 's AI day… OMG... How will others compete with them on any autonomy use case? 👇Thread
1 -Tesla has created the most advanced SW architecture for perception, with recurring neural nets refining in real time and selectively their environment, with spacial and temporal queuing - exactly like we humans do. @dileeplearning @karpathy - you guys should talk!
2 -The above requires monster infrastructure to gather relevant video streams and label them for training. Tesla has a million cars on the road and INTEGRATED semi-auto labeling with >1,000 labelers. This is a key success factor. The above is impossible without it:
3 - Labeling video is not trivial. Neural nets doing that vastly exceed the size of the actual perception one inferring in the car. very hard to train. How could you outsource that to a third party?
4 - Training speed of all this infrastructure is the key driver of the pace of innovation. Iterative process. Tesla designed in-house a training pod, orders of magnitude faster than anything else, with unique architecture, possible only within an integrated organization.
5 - : 25 * 362 TFLOPs dies fanned out on a wafer make one tile. This means each tile is 30x faster than an Nvidia A100 GPU, 15x faster than Intel’s Pontevecchio!
6 - Each tile has 36Tbps I/O, i.e. one to two orders of magnitude more than anything Intel or Nvidia does in a single package. As @ElonMusk put it: success for Dojo is the SW team turning off the GPU cluster!!
7 - And for scale-out: 6 tiles per rack, 2 racks per cabinet. This means 1 Peta-flop per Tile, 25 per cabinet, and a 1 Exaflop training system with 10 Tbps bandwidth across all nodes, (bi-dimensional mesh), holding in only 40 cabinets. This is INSANE.
8 - Last but not least: The only bottle neck is talents. Tesla need the best A.I. engineers to run this operation and deliver the best AI, and given the toys they have, they will keep attracting the best!
9 - conclusion: Tesla is years ahead of anyone else for real-world perception A.I. and autonomy, has a fully integrated operation with the highest pace of innovation. Rings a bell? $Tesla is in A.I. EXACTLY where Tesla was in cars in 2011….
10 - The next ten years will be fun to watch!
• • •
Missing some Tweet in this thread? You can try to
force a refresh
