A mega thread on GPT-4 🔥

Capabilities, API access, pricing, model size, use cases, and limitations.

👇🏻👇🏻👇🏻 1. Capabilities 🤖

1️⃣ GPT4 is Multimodal

Accepts images & text as inputs to generate text outputs

2️⃣ It has higher reasoning than ChatGPT

It passes a simulated bar exam with a score around the top 10% of test takers; in contrast, GPT-3.5’s score was around the bottom 10%.

The current ChatGPT behavior is flawed.

So, OpenAI will let you customize your own chatbot.🚨

Here's how they plan to do it: ChatGPT's behavior today:

Networks learn from a broad range of data, which is then fine-tuned (from human reviews who follow guidelines) to shape their behavior.

This behavior results in lots of mistakes, bias, executing requests that are marked as illegal, etc.

Toolformer is a new language model that can learn to use tools (on its own), via simple API calls.

Probably the most important paper this year so far.

Here's the low down: Large LMs ➡️ good at performing new tasks with a few text instructions.

Small LMs ➡️ good at basic functionalities like math/fact checks.

Toolformer can achieve the best of both
worlds.

How?👇🏻

OpenAI is working on a watermarking tool to mark GPT-generated text with a special, hidden signal.

And they have a working prototype.👀

How does it work?👇🏻 For GPT, every input and output is a string of tokens.

Tokens can be words, punctuation marks, parts of words, etc.

Based on previous tokens, GPT is constantly generating a probability distribution over the next token to generate.

So to watermark ... 👇🏻

Want to build with AI but don't know where to start?

Here are 7 great resources on how to use and build with @OpenAI & @StabilityAI.

-- and they're all free.

🧵 1. @OpenAI + @bubble tutorial

Even if you don't know how to code, you can still build with AI, using no-code tools like Bubble.

@marinatrajk's simple tutorial shows you how.

openai.marinatrajk.com/home

If you're looking to explore the world of AI, here are 6 great apps on @huggingface that you can try out today

– and they're all free!

🧵 1. Wikipedia Assistant 📖

Using this demo you can ask Wikipedia any open question, and you'll get your answer in an instant

huggingface.co/spaces/deepset…

Shutting down the noise is hard.

Staying focused on your startup goals is key to overcoming any challenges you face.

Here are some tips that help me every day:

🧵 1. Every Monday, I get clear on what success looks like for me and write it down.

Every time I feel distracted, and come back to it.