VC at @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.
7 subscribers
Dec 17 • 5 tweets • 2 min read
o1-preview is far superior to doctors on reasoning tasks and it's not even close, according to OpenAI's latest paper.
AI does ~80% vs ~30% on the 143 hard NEJM CPC diagnoses.
It's dangerous now to trust your doctor and NOT consult an AI model.
Here are some actual tasks:
1/5
Here's an example case looking at phosphate wasting and elevated FGF23, then proceeded to imaging to localize a potential tumor.
o1-preview suggested testing plan takes a broader, more methodical approach, systematically ruling out other causes of hypophosphatemia.
2/5
Dec 16 • 10 tweets • 4 min read
Want to design better AI agents? Take notes from code writing systems.
Techniques include
— Multi-agent
— Tool choice
— Underlying model
— Diff format
— Innovative Signals
— Code retrieval + knowledge graphs
— LSP
— Fault localization
Let's dive deeper with real examples:
1/10
Multi-agent
Use agents with different roles / prompts that have access to different tools and can hand off to another agent.
Some roles used in coding: searcher, planner, reproducer, coder, tester, editor
2/10
Dec 10 • 5 tweets • 2 min read
As cool as the new Sora is, gymnastics is still very much the Turing test for AI video.
1/4
Attempt 2.
2/4
Dec 10 • 6 tweets • 3 min read
HUGE Immigration News!
We have the first EVER look at H-1B lottery data. Did you also suspect the lottery wasn't truly random? They're not.
Certain companies like Tiktok and Bytedance have 50% higher odds than average.
I broke it down by nationality, company and age...
1/5
By Age.
In 2024, there were 350,084 applications and 85,304 were selected, a 24.4% acceptance rate.
The process seems to have rampant ageism, with only ages 26-32 having above average acceptance rates.
A 26yo has 50% higher odds than a 36yo+!
2/5
Dec 4 • 10 tweets • 2 min read
A small company in the <1M city of Niigata, Japan has a monopoly on the equipment that makes every single modern iPhone and TV display on the planet.
Here's the story of Tokki, the most important company you've never heard of...
1/8
Tokki makes just ~10 ELVESS machines a year.
Each one is a clean room within a clean room, stretching longer than an Olympic swimming pool, and can costs $ 100M+. They're the only ones who can do it.
2/8
Dec 3 • 4 tweets • 1 min read
The middle manager is the biggest culprit of the "quiet quitting" SWE epidemic.
They have 0 incentive to fire. The entire job is bargaining for more headcount so they can get promoted.
They'll say "we are understaffed, we need more people" no matter how little they do.
1/4
If you have multiple levels of this, its often dysfunctional down the entire chain.
The non technical middle manager are the worst culprits. ICs can (and will) swindle them endlessly into their infinite timelines. I've never worked with a good one.
2/4
Dec 2 • 4 tweets • 1 min read
The youth of India spends money they don't have to play status games.
Multiple people making <₹50k ($600)/mo in their 20s are buying
— iPhone & other Apple products (on interest)
— Coldplay / Dua Lipa concerts
— trips to Thailand / Vietnam / Goa
They save little to no money.
I’ve been in India and multiple people have told me they’re essentially broke after multiple years of working.
Income asymmetry amongst similar social groups is high which can force this “suddenly my college buddy makes 90LPA but I’m at 12”
The peer pressure to “fit in” is high
Dec 1 • 4 tweets • 3 min read
A viral thread about a growing number of "quiet quitting" SWEs was seen 15M+ times (and led to a crack down at Box)
My DMs have been full of ppl telling me that people badge in for 30mins/day and go on 5+ intl vacations/yr at these companies.
Here's what went down..
1/4
— Stanford researcher concluded ~10% of SWEs are ghosts
— Box Founder / CEO said "fml", his mom texted him, and then he sent a company-wide email
— Karpathy backed it up saying he's heard it happen
2/4
Nov 28 • 6 tweets • 1 min read
Software engineers aren't lazy.
They just have no incentive to be productive at bigCos.
Here's why:
— No reward for simplicity / deleting things
— No prizes for doing it quickly (everyone assumes it was easy)
— Little interesting work. Business needs are often boring.
1/5
— No dearth of alternate career options. Get fired? Just change jobs
— No accelerated career growth.
— No innovation. Middle managers only get fired for rocking the boat.
— No $$ reward. Stock goes up for reasons beyond your control.
2/5
Nov 28 • 9 tweets • 2 min read
Using light as a neural network, as this viral video depicts, is actually closer than you think. In 5-10yrs, we could have matrix multiplications in constant time O(1) with 95% less energy. This is the next era of Moore's Law.
Let's talk about Silicon Photonics...
1/9
The core concept: Replace electrical signals with photons.
While current processors push electrons through metal pathways, photonic systems use light beams, operating at fundamentally higher speeds (electronic signals in copper are 3x slower) with minimal heat generation.
2/9
Nov 26 • 9 tweets • 2 min read
A single fairly unknown Dutch company makes maybe the most expensive and complex non-military device ($200M) that builds on 40 years of Physics and has a monopoly responsible for all AI advancement today.
Here's the story of ASML, the company powering Moore's Law..
1/9
ASML's extreme ultraviolet (EUV) machines are engineering marvels.
They shoot molten tin droplets 50,000x/s with a 25kW laser turning it into plasma as hot as the sun's surface to create 13.5nm UV light —so energetic it's absorbed by air itself.
2/9
Nov 24 • 9 tweets • 2 min read
Guide to starting a US company as an international founder.
Here are ALL your options:
—O-1A /EB-1A visa
—International Entrepreneur Rule
—H-4, dependent on your spouse
—US citizen cofounder with transition timeline
—E-2 Treaty investor (not Indian / Chinese)
—EB-5 investor
1/9
O-1A/EB-1A visa
- For founders with "extraordinary ability"
- Need press, awards, high salary, patents
- Can own & operate your company
- Start building evidence NOW
- EB-1A = permanent version (green card)
2/9
Nov 23 • 12 tweets • 2 min read
NVIDIA's $7B Mellanox acquisition was actually one of tech's most strategic deals ever.
The untold story of the most important company in AI that most people haven't heard of
1/12
Most people think NVIDIA = GPUs. But modern AI training is actually a networking problem.
A single A100 can only hold ~50B parameters. Training large models requires splitting them across hundreds of GPUs.
2/12
Nov 19 • 5 tweets • 1 min read
Everyone thinks this is an exaggeration but there are so many software engineers, not just at FAANG, who I know personally who literally make ~2 code changes a month, few emails, few meetings, remote work, < 5 hours/ week, for ~$200-300k.
Here are some of those companies:
Oracle
Salesforce
Cisco
Workday
SAP
IBM
VMware
Intuit
Autodesk
Veeva
Box
Citrix
Adobe
Oct 29 • 4 tweets • 2 min read
Programming languages have widely varying ability to communicate logic succinctly.
If you look at character counts of 10 basic programs in each, Java has 2x higher entropy than Python.
Very different result for natural spoken languages.
Heres a sample of 5 algorithms that were compared and their respective character counts.
Oct 22 • 5 tweets • 3 min read
Height in China has exploded faster than any country in history at 1.75cm/decade!
Studies show the average male height over the last ~50yrs went from 5'6" to 5'9", leaving only Lebanon, Russia and Turkey are higher in Asia.
This is proof of how economy affects genetics.
1/4
Causes of growth:
— Socioeconomic improvements
— One-child policy may have led to concentration of resources
— Increased protein and dairy consumption.
The 2.5cm/decade growth in the 70s far outdoes the 1cm/decade the west saw in the 1870-1970 period!
2/4
Oct 16 • 4 tweets • 2 min read
Compilers was was known to be the hardest CS class at Cornell which was hard as it is.
We were handed a 8-page PDF at the start of sem for a language spec we'd be implementing by the end of sem, split into 6 parts.
On part 5, the median was a 0/100 and most the class failed.
For those curious, here's the rest of the spec. Part 1:
Oct 9 • 4 tweets • 1 min read
BREAKING: One of India's most massive hacks is happening right now!
~31M rows of Star Health Insurance data — name, DOB, address, phone, PAN card and salary for Indians is selling it for $150k.
Hacker claims CISO Amarjeet Khurana sold him the data.
Nothing is private in India.
You can buy and see a sample of the data here: starhealthleak.st
Oct 9 • 7 tweets • 2 min read
Nobel Physics Prize winner Geoff Hinton's middle name is Everest.
It comes from his great-great-granduncle Sir George Everest, once British surveyor-general of India, after whom Mount Everest was named.
Talk about lofty family expectations.
His lineage is full of shockers.
His great-great-grandfather? George Boole, the namesake of "boolean" that is essential to computers and the Information Age.
Sep 23 • 7 tweets • 5 min read
Indian startup Dotpe, that raised ~$100M to build point of sale systems for restaurants left their entire API fully public.
A clever hacker found out the most ordered thing at every Social in India.
And did a prank to order what he wanted for a person next to him!
I want to dispel certain accusations made about my EB-1 blog on X.
I wrote that to help people. To not gate-keep knowledge. It's not great to be punished for that. The primary reason I write online is to help.
I'll break down the claims and why they're patently false:
1/8
On low quality science journals.
1 I did not use them, you can check Scholar.
2 These were recommended in the onboarding email of one of the biggest immi law firms that I used at first who have done 1000s of EB-1s.
I don't recommend it, but people have the right to know.