Discover and read the best of Twitter Threads about #dojo

Most recents (7)

On #biocompute news, $TSLA Tesla AI day gave some technical details on how they do their training and video labelling. It seems $NVDA Nvidia GPUs are the norm, with a 14,000 HPC heavily optimised on the software side. #pytorch #AVX2 #CUDA #SMT #smol #CUDNN Image
None of this is for the purpose of #Bioinformatics applications, rather here it's for Full Self-Driving software, but the technical details show some choices for high-throughput #AI training that one could compare to the #ComputationalBiology #ComputeAcceleration world.
Read 12 tweets
@boblautenbach @Alan_L_Lovejoy @Ryu_Zoku Yes Chris Lattner is very interesting, been following his #LLVM and #SWIFT work.

1/
@boblautenbach @Alan_L_Lovejoy @Ryu_Zoku Actually #ZokuTalk adopts the portion of SWIFT #EBNF for #Unicode as they seems have done good job on that, as well as parts of the EBNF for numerics such as "1_234.00" to expand privative data types entry.

\2
@boblautenbach @Alan_L_Lovejoy @Ryu_Zoku Borrowing C & Assembly data types: 0b0011, 0xFF, keeping 16r0A, plus many others.

Actually the numeric formats are one of more complicated part of the #EBNF of #ZokuTalk and the only non-#MOBS (#Messages #Objects #Block #Syntax) part of the evolved syntax.

\3
Read 10 tweets
A short thread on accelerated computing. How $TSLA's #Dojo, $GOOG's #TPU #Cerebras's #WSE-2, #Graphcore's #IPU, and others compare to $NVDA 's #GPU. This is an extract of work we published a few weeks ago. 👇1/6
It is difficult to compare chips. Designing a chip is all about managing trade-offs between multiple dimensions. A chip has limited potential resources and the architect allocates them over these multiple dimensions. 2/6 Image
With this framework in mind, one sees alternatives to #GPU have fundamentally different architectures, favoring the flow of data across the chip vs. the flow of data between the memory and the chip. 3/6 Image
Read 6 tweets
So instead of a working HPC, what we saw in #Dojo is a single node that’s is running a rudimentary NN on a single test bench. Designing a chip is easy. What’s hard is building the compiler, runtime scheduler in a HPC environment at scale. none of which @Tesla is anywhere close to Image
When asked, its brushed off as “No but we will”. This exapod doesn’t exist it’s a photoshopped image and won’t exist for many years. That’s why there’s no MLPerf benchmarks. There is only one exapod in existence & that’s @Google TPU version 4. In use today by @Waymo #Dojo Image
By the time this is working and ready in the presented form and specs there will already be a TPU V5. @Tesla will always be 3-4 years behind on this front. But this won’t stop the fanboys because ignorance is bliss.

Read 4 tweets
I will be live tweeting @Tesla AI Day Here. Personally looking at the data flow, latency, low power and performance of #Dojo and how it compares to @Google #TPU version 4 and other HPC systems and how it directly relate to #AutonomousVehicles #FSDBeta
Well as usual, Tesla is fashionably late and we are almost 18 mins past the start time. And the beat goes on...
#AIDay starts with a demo of FSD with the driver griping the steering wheel with his left hand in what looks to be the streets of California. #DojovsTPU #Dojo @Tesla Image
Read 22 tweets
1/3
Já retuitei isso, mas vale o ênfase:

O projeto #Dojo é um passo IMPORTANTÍSSIMO em direção à FSD.

Imagine uma neural net onde todos os carros rodando nas ruas conectam-se em tempo real.

O Dojo é o cérebro, processando quantidades imensas de dados e imagens em tempo real.
2/3
Exemplo:
Imagina que o Tesla à sua frente identifica um buraco no asfalto.

O informação é processada imediatamente, e distribuída para toda a frota, fazendo assim com que o seu carro desvie do buraco. 🤯
Read 3 tweets
2. How did it happen? A large man followed a frantic woman inside #Ephraim’s #Charlotte, North Carolina #karate studio claiming he was there to pick her up. She repeatedly insisted that she did not know him and that he “tried to #kidnap her. nydailynews.com/news/crime/ny-…
3. The man refused to leave and tried to force himself further into the #Dojo. In #Ephraim's words: "I then went into action defending myself and got him out of the #Dojo...Once outside he attempted to attack again and was dealt with accordingly." nypost.com/2019/01/04/wou…
Read 4 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!