Pete Profile picture
Mar 27 23 tweets 5 min read Twitter logo Read on Twitter
Every AI hobbyist needs to realize how soon your laptop and smartphone will have a ChatGPT on it.

It's happening soon and way faster than you think.

Here's what you need to know (the non-technical version):
First, let's talk about WHY you want it on your own device.

Isn't ChatGPT online good enough?

Putting it on every device gives us:

1. Privacy
2. Speed
3. Personalization
1. Privacy

Whatever you put into Bing Chat and ChatGPT today is traveling all over the place.

Firms like JP Morgan, Verizon and Amazon have all banned ChatGPT at work.

Microsoft has had to explicitly advise its users never to put confidential information into its chat.
1. Privacy

Any sensitive AI use case, personal or business, will be 10x better if the model is on your device.

Data doesn't go anywhere. All of the thinking lives on your device, not on the cloud.
2. Speed and reliability

People freaked out (in a good way) when ChatGPT Plus came out and it was a lot faster than regular ChatGPT.

People freaked out (in a bad way) when ChatGPT went down.

You get more of the first and less of the second when you have it in your pocket.
3. Personalization

We're headed to a world where everyone could have their own personalized AI model.

But it would be ridiculous to expect OpenAI to support 7 billion versions.

Putting models on our devices lets everyone customize their own model based on their preferences.
So why hasn't this happened yet?

These large language models like GPT-4 are, well, large. Like very, very big.

You'd need to tape together dozens of Macbook Pros to 1) store something like GPT-3 in the first place and 2) run it.
That is, until recently. Enter the LLaMA experiments.

Meta released a family of GPT-3 quality models to researchers starting end of February.

Since then, it's been leaked. And people have been pushing to get them running on smaller and smaller devices.

A quick runthrough:
Just 3 weeks after LLaMA release, someone got it running on an M1 Macbook Pro:

Alpaca (a version of LLaMA prepped for chat) on an iPhone 14:

Voice chat to Alpaca on an M1 Macbook Pro:

The same as above, but now fully offline!

In a matter of weeks, people have:

- Ran LLaMA on laptops, phones and even tiny Raspberry Pis
- Turned LLaMA into a chat-ready model
- Ran that on a phone
- Layered on voice chat and made *that* run on a laptop

ChatGPT on your laptop/phone isn't just coming. It's already here.
So, what's next? You should have your eyes on two players:

1. Apple
2. Stability AI
1. Apple

Everyone's been waiting for what they're going to do in this category.

Your iPhone, today, carries components optimized for AI.

Siri's about to have the craziest comeback. The question is when.

(Aside: We could also see Microsoft try phones again. All because of AI.)

2. Stability AI

CEO Emad Mostaque has repeatedly stated that their vision is to put models "on the edge" - i.e., in your pocket.

2. Stability AI

They're already hiring to make this happen:

This is going to be the biggest shift in our day-to-day as consumers.

We will have superpowers in our pockets.

And *it's actually happening*.
Liked this? I'd appreciate a like and RT :)

32,000+ business professionals rely on us to understand what's going on AI.

Join them here:

join.theneurondaily.com

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Pete

Pete Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @nonmayorpete

Mar 23
Wow. ChatGPT just got even more interesting.

Plugins now available, including one that allows ChatGPT to browse the Internet!

It's not just about writing poems and blog posts anymore. It's about DOING stuff.

Some of my favorite examples:
Web Browser plugs into Bing.

ChatGPT will now know when and how to search for information.
You can also:

- Order groceries via Instacart
- Search for restaurants, flights and hotels via OpenTable, Expedia and Kayak
- Shop online via Klarna and Shop
Read 7 tweets
Mar 23
JUST IN: Canva announces a suite of new AI tools.

This follows just after Adobe Firefly yesterday. What's with the timing!?

Here's what's new for Canva's 125 million users:
First, Canva already had basic AI features:

- Text to Image
- Magic Write, an AI copywriting assistant

Today's announcement goes on top of these
Magic Design:

Turn an image into a completely personalized design template
Read 10 tweets
Mar 22
Super interesting launch today:

Zapier Natural Language Actions API

Use natural language commands to work with over 5,000 apps: Image
Some tidbits:

- API has a single parameter: "instructions"
- Uses GPT3.5 to process instructions and map to specific API calls
- Returns a response optimized for both humans and language models
Read 4 tweets
Mar 16
🚨 BREAKING: Microsoft is releasing Copilot for Microsoft 365:

- Word
- Powerpoint
- Excel
- Teams

Here's the summary:
1. "Prepare me for my meeting"

Plugging into your calendar and email, it can help you get ready for the day, generating bullets for you to focus on in your next meeting.
2. Generate documents based on existing documents

In Word, you can type in a prompt like "Generate a product announcement" and link to an existing product spec elsewhere.

The Copilot will read in that document, then generate the new product announcement with perfect context!
Read 9 tweets
Mar 7
We hosted #emergencychatgpthackathon this past Sunday for the new ChatGPT and Whisper APIs.

It all came together in just 4 days, but we had 250+ people and 70+ teams demo!

Here’s a recap of our winning demos:
First, a huge thank you to our sponsors for allowing us to feed our attendees and sponsoring some amazing prizes:

@Readwise
@OpenAI
@Replit
@TryChroma
@AmplifyPartners
@GradientVC
@Deep__AI
@reactathon
@VocodeHQ
@learndotxyz
@CeloOrg
@stripe
Double thank you to Celo for giving us a space.

Triple thank you to @christianbyza and Arndt Voges of Learn.xyz for setting up the space, and making it beautiful, functional and comfortable for the attendees!

They also took so many great photos for us!
Read 16 tweets
Jan 27
Google's new music model MusicLM is the breakthrough of the week.

Here it is in action.

Just describe the music and it'll generate the track:
You can also give it:

- a genre
- an instrument
- a time period
- an IMAGE(??)

And it'll spit out music.
Quality feels better than Riffusion, and the stats back it up.

MusicLM beats Riffusion 75% of the time. Image
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(