The US has LOST their stronghold as the premier education destination for Indian students.
In 2022:
—225k to Canada, 0.6% of population
—200k to US 0.06%
—127k to UK 0.17%
Why?
—Unaffordable tuition
—Impossible to get work visa
—No path to citizenship
1/3
Even Chinese students find US a less attractive destination with -8% reduction for students to 290k in 2022 even though it’s much higher than the UK (150k) and Australia (140k*). Canada is much lower at 52k.
*total enrolled, not annual
2/3
A decrease in academic is one of the leading indicators of the decline in the US’s long term global power.
A large part of its historical supremacy was the ability to attract the best talent from around the world that would help build companies that drive the economy!
3/3
Every other AI demo uses Pinecone and Langchain for retrieval-augmented generation. This makes sense because:
—It's easy to build
—It works reasonably well
—Cost is tractable
—Can answer "fresh" / recent queries
🧵 Here why its not easy to make that demo a company (today)
1/6
1 You're only as good as your ranking.
Pure vector search isn't always high search quality. Even hybrid techniques with BM25 is better, and if you add better document signals, you get much better. If your underlying ranking is bad your answer is bad.
2/6
2 Embeddings have issues
- The quality of your out-of-the-box embeddings may not be good enough for specific domain tasks.
- You need to find the right token size for your documents. Embedding a large document is nonsensical. Embedding a small sentence is nonsensical.
3/6
It's going to be fascinating to see how the unit economics of Ads in language models will unfold and affect search advertising.
1/3
Given
—the click through rates / conversions on these ads aren't comparable to search
—LLM-powered chat is eating into search as a information retrieval medium
it could radically reduce the size of the $100B+ search advertising industry, unless..
2/3
—As early demos of ChatGPT Plugins show, you can unify any internet purchase flow into text and greatly reduce barrier to buy
—
3/3
It allows you to interact with your apps (Search, Compile, Calculator, WolframAlpha, Calendar, Zapier) via text, but how does it work?
I'm going to explain 3 techniques — ReAct, Toolformer, LaMDA — and what GPT-4 does.
🧵
1/10
ReAct
Uses some clever few-shot prompt engineering to guide the LLM into dissecting your prompt / question into 3 parts:
—Thought: Introspect on what I need to do.
—Action: Communicate with a tool
—Observation: Reason about the response
And repeating until it's finished.
2/10
ReAct
Facts
—Available today in LangChain!
—Requires more powerful models (100B+)
—Finetuning > prompting, at least for ~50B param models
—API must be text-based (Zapier NLA, Calculator, Search)
I asked a text AI to tell me a prompt for a drawing AI to draw and here are the BEST results!
GPT4 x MidJourneyV5
Pixar Narendra Modi —
1/8
Bertrand Russell, erudite, analytical, illuminated, by the golden hues of a radiant intellect, within a serene temple of wisdom, surrounded by towering stacks of ancient tomes, amidst a symphony of fluttering pages, under the watchful eyes of the great philosophers
2/8
Ravi Shankar, transcendent, melodic, enigmatic, playing sitar atop a crystalline mountain peak, orchestrating a celestial symphony, surrounded by clouds swirling in rhythm
EB-2 final action date for Indians has retrogressed to Jan 1 2011 in the latest Visa Bulletin: HUGE setback!
If you
—came to the US in 04 for an MS in 06
—got an H-1B in 08
—applied for EB2 in 10
Congrats! you can get your green card after being here for ~20yrs, at age 41.
1/4
Framed differently, a high-skilled Indian immigrant in early 00s will likely naturalize in the US at age 50 if they followed the near-perfect legal path.
If you came to the US later than that, it could take up to is 150yrs — you'll never get it.
2/4
Imagine paying over a $1m in taxes over 20+yrs and contributing tremendous amounts of economic value entrepreneurially and technologically, for nothing in return!
The US stays ahead of China predominantly because of its technical innovation, built on the back of immigrants!
3/4