Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
andrew gao Profile picture
@itsandrewgao
May 13, 2024 β€’ 11 tweets β€’ 3 min read β€’ Read on X
Scrolly
To everyone disappointed by @openai today... don't be. The livestream was for a general consumer audience.

The cool stuff is "hidden" on their site.

I am really excited. (Text to 3D??)
🧡🧡
@OpenAI 1/ Lightyears ahead of anyone at having text in AI generated images. Gorgeous
Image
Image
@OpenAI 2/ so confident in their text image abilities they can create fonts with #GPT4-o Image
@OpenAI 3/ casual 3d rendering.... Image
4/ sound effect synthesis, not just speech Image
5/ effectively one shot stable diffusion finetuning, in context!? Image
@willdepue why didn’t yall talk about this in the livestream
Follow for AI projects and sneak peeks on stuff!
@willdepue Follow for AI news
Follow me for AI newss
New tokenizer

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with andrew gao

andrew gao Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @itsandrewgao

andrew gao Profile picture
Jun 27
curious/confused about all the async autonomous coding agents out there? it can be tricky at first to figure out how to use em. we wrote up a guide

the five biggest things you should know imo 🧡 Image
1/ as a human your time is the most valuable thing. so stop getting stuck trying to figure out which of 10 approaches is the best one. just make agents try all of them for u
its often hard/impossible to know in advance what the best approach is. i.e. designs Image
2/ can not emphasize enough how helpful it is to set up preview deployments i.e. hook up ur github to @vercel

good async agents can look at these to check their work, and it's also super convenient to just test a preview link rather than checking out the commit to your local, and running all the commands to launch localhost and stuffImage
Read 8 tweets
andrew gao Profile picture
Jun 5, 2024
We embedded 250,000 works of art 🎨 from The Met using @nomic_ai's new SOTA #multimodal embeddings model!

It's the *first ever* semantic search tool of its kind πŸ‘©β€πŸŽ¨ πŸ”Ž
Search with smart queries like "oil painting with flowers & dogs".

How we did it & how to use itπŸ‘‡ Nomic Atlas 2D interactive visualization of 250,000 works of art from the Met museum
@nomic_ai @WilliamGao1729 Nomic just released their newest model, Nomic-Embed-Vision.
It transforms the way we can interact with images. Instead of using CLIP to get text captions for models and using those captions for semantic search, you can work directly with image embeddings!πŸ‘‡ Image
@nomic_ai @WilliamGao1729 "A picture is worth a thousand words" so any caption is going to be super lossy. By dealing directly with original image embeddings, you retain all the important aspects of the image, from style to subject.

We realized Nomic Embed Vision would be perfect for art discovery πŸ‘‡
Read 18 tweets
andrew gao Profile picture
May 8, 2024
πŸ””the guy who invented the LSTM just dropped a new LLM architecture! (Sepp Hochreiter)

Major component is a new parallelizable LSTM.
⚠️one of the major weaknesses of prior LSTMs was the sequential nature (can't be done at once)

Everything we know about the XLSTM: πŸ‘‡πŸ‘‡πŸ§΅ Image
1/
 Three major weaknesses of LSTMs that make Transformers better:
"Inability to revise storage decisions"
"Limited storage capacities"
"Lack of parallelizability due to memory mixing".

SEE THE GIF, if you don't get it. LSTMs are sequential which basically means you have to go through the green boxes (simplified) one after the other. You need the results from the prior box before you can move on.

Transformers don't do this. They parallelize operations across tokens, which is a really really big deal.

So how did Sepp and team solve?
Keep reading: πŸ‘‡πŸ‘‡
GIF credit: Michael Phi
towardsdatascience.com/illustrated-gu…
2/
Here is the overview from the paper:

Main contributions:
matrix memory for LSTM (NO memory mixing)
exponential gating

This might mean nothing to you so I'll break it down with the help of Claude! πŸ§΅πŸ‘‡ arxiv.org/pdf/2405.04517
Image
Read 15 tweets
andrew gao Profile picture
May 7, 2024
gpt2-chatbot RETURNS! it's now TWO similarly performing models.

i've been testing them.

everything i can tell you πŸ‘‡πŸ§΅ #gpt2
Image
1/ first of all, @sama posted this cryptic tweet a few days ago.
that tweet contains the name of one of the two new GPT2 models.

can I confirm that it is from OpenAI? no. However, model creators need to work with @lmsysorg to add the model and it seems strange for LMSYS team to allow someone to pretend

how good are the mystery models? πŸ‘‡πŸ‘‡πŸ‘‡πŸ§΅πŸ‘€
2/ it seems like the models behave similarly to the OG #gpt2-chatbot. They seem to be fine-tuned for agentic reasoning and planning.

Take a look at the screenshots.

Now for coding abilities (what I really care about): πŸ§΅πŸ‘‡ Image
Read 15 tweets
andrew gao Profile picture
Apr 29, 2024
uh.... gpt2-chatbot just solved an International Math Olympiad (IMO) problem in one-shot

the IMO is insanely hard. only the FOUR best math students in the USA get to compete

prompt + its thoughts 🧡
Image
megathread:
damn i accidentally closed the tab.
Read 8 tweets
andrew gao Profile picture
Apr 29, 2024
🧡megathread of speculations on "gpt2-chatbot": tuned for agentic capabilities?

some of my thoughts, some from reddit, some from other tweeters

my early impression is πŸ‘‡Image
Image
Image
1/
there's a limit of 8 messages per day so i didn't get to try it much but it feels around GPT-4 level, i don't know yet if I would say better... (could be placebo effect and i think it's too easy to delude yourself)

it sounds similar but different to gpt-4's voice

as for agentic abilities...
2/ look at the screenshots i attached but it seems to be better than GPT-4 at planning out what needs to be done.

for instance, it comes up with potential sites to look at, and potential search queries. GPT-4 gives a much more vague answer (go to top tweet)

but imo
πŸ‘‡ Image
Read 21 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(