Hemant Mohapatra Profile picture
VC @lightspeedindia, ex: @a16z, prod/engg @Google @AMD; @supabase @pixxelspace @composioHQ @sarvamai @solana @unslothAI @emergentlabsHQ @airbound_aero & more

Jul 5, 2024, 18 tweets

So now that Nvidia has far outstripped the market cap of AMD and Intel, I thought this would be a fun story to tell. I spent 6+yrs @ AMD engg in mid to late 2000s helping design the CPU/APU/GPUs that we see today. Back then it was unimaginable for AMD to beat Intel in market-cap (we did in 2020!) and for Nvidia to beat both! In fact, AMD almost bought Nvidia but Jensen wasn’t ready to sell unless he replace Hector Ruiz of AMD as the CEO of the joint company. The world would have looked very different had that happened. Here’s the inside scoop of how & why AMD saw the GPU oppty, lost it, and then won it back in the backdrop of Nvidia’s far more insane trajectory, & lessons I still carry from those heady days:

After my MS, I had an offer from Intel & AMD. I chose AMD at 20% lower pay. Growing up in India, AMD was always the hacker’s choice - they allowed overclocking, were cheaper, noisier, grungier and somehow just felt like the underdog david to back against the Intel goliath!

Through the 90s, AMD was nipping @ Intel’s heels but ~2003 we were 1st to mkt w/ a 64-bit chip &, for the FIRST time, had a far superior core architecture. Oh boy, those were exciting times! Outside of SV, I haven’t seen a place where hardcore engg was so revered. Maybe NASA.

I joined AMD right when their stock price was ~$40, and worked on the 1st dual-core architecture (single die, two cores) AMD-X2. Our first mistake -- and AMD insiders won’t like me saying this -- was made here.

We were always engineering-led and there was a lot of hubris around “building a pure dual-core” -- single die split into two separate CPU cores w/ independent instruction & data pipes, but shared cache, page tables etc. Even the fabs didn’t yet have the processes ready.

While we kept plodding on the “pure dual-core”, Intel, still smarting from the x64 defeat just slapped two 1x cores together, did some smart interconnects, & marketed it as “dual core”. Joke at AMD was that Intel’s marketing budget was > our R&D (true fact). Customers ate it up.

We did launch a “true” dual core, but nobody cared. By then Intel’s “fake” dual core already had AR/PR love. We then started working on a “true” quad core, but AGAIN, Intel just slapped 2 dual cores together & called it a quad-core. How did we miss that playbook?!

AMD always launched w/ better CPUs but always late to market. Customers didn’t grok what is fake vs real dual/quad core. If you do `cat /proc/cpu` and see cpu{0-3} you were happy. I was a proud engineer till then but then saw the value of launching 1st & fast. MARKET PERCEPTION IS A MOAT.

Somewhere between this dual→ quad journey, AMD acquired ATI, the canadian GPU company. Back in 2006, acquiring a GPU company did not make a lot of sense to me as an engineer. The market was in servers & client CPUs and GPUs were still niche. We didn’t want a GPU company so much that the internal joke was AMD+ATI=DAMIT.

But clearly, someone at AMD saw the future. We just saw it partially. We should have acquired Nvidia - and we tried. Nvidia – for those who remember – was mostly a “niche” CPU for hardcore gamers and they went hard on CUDA and AMD was a big believer in OpenGL. Developers preferred OpenGL vs CUDA given the lock-in with the latter. Jensen clearly thought very long term and was building his “Apple'' strategy of both HW and SW lock-in. He refused to sell unless he was made the joint-company’s CEO to align with this strategy. AMD blinked and our future trajectories splintered forever.

ATI was a tough nut - we didn’t really “get” them; they saw the world very differently. We wanted to merge GPU+CPU into an APU but it took years of trust & and process-building to get them to collaborate. Maybe if we had Slack, but we only had MSFT Sharepoint 😅

While all this APU work was going on, AMD totally missed the iPhone wave. When we built chips for the PC, world was moving to laptops, when we moved to laptops, world moved to tablets, & when we moved there, world moved to cell phones.

We also missed the GPU wave trying to introduce a fundamentally better but also fundamentally new architecture: APUs (CPU+GPU on the same die - we love “same die everything” I guess). CATEGORY CREATION IS HELL but “if you’re going through hell, keep going”. We hesitated and...

...2008 crisis happened & we were totally caught with our pants down. After that, AMD basically lost the market to pretty much everyone: Intel, ARM, Nvidia. I learned it the hard way how SUPERIOR PRODUCTS LOSE TO SUPERIOR DISTRIBUTION LOCK-INS & GTM.

Few yrs later in '11, I left AMD to join Google via a short 1yr MBA. AMD stock was hovering b/w $2-4 - lower than BOOK VALUE if we sold it for scraps. I should’ve bought some stock but my salary coming out was ~30% lower than salary going in - I was basically broke w/ MBA loans

Huge respect for Nvidia though. They were just one of the little boys back then - we lost some GPU sales to them but never thought of them in the same league as ARM/Intel. They stuck to their guns, and the market came to them eventually when AI took off. BELIEF IN YOUR VISION and an unrelenting and dogged pursuit of your goals is a HIGHLY UNDERRATED SKILL. Most give up, Jensen just kept going harder.

Also mad props to Lisa Su who now leads AMD. Lot of my engineer friends are still there building world best tech and I can’t imagine what they must have had to go through all through the 2010s: multiple heavy layoffs, salary cuts, leadership changes (2 CEO changes b/w 08-11 alone), low morale. Lisa is just absolutely world class - I seriously wish Nvidia and AMD could merge now – a technology cross-licensing that takes advantages of each other’s fab capabilities is going to help a lot in bringing the cost of GPU cycles down much further!

AMD was a “TRIBE”. For so many it was their 1st job out of college in the late 80s 90s and 2000s & they are still there after 30-40yrs! My first manager @ AMD retired from there after 30+ yrs. My second manager is still there. My super-manager has spent 40yrs there by now. I guess this is how AMD survived multiple near-deaths & this is also why when it comes to AMD I still say “we” as if I’m still the fanboy I was as a college student!

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling