Here is Claude 3's system prompt!
Let me break it down 🧵
To begin with, why do we use system prompts at all? First, they let us give the model ‘live’ information like the date. Second, they let us do a little bit of customizing after training and to tweak behaviors until the next finetune. This system prompt does both.
The first part is fairly self-explanatory. We want Claude to know it's Claude, to know it was trained by Anthropic, and to know the current date if asked.
This part tells the model about when its knowledge cuts off and tries to encourage it to respond appropriately to the fact that it's being sent queries after that date.
This part is mostly trying to nudge Claude to and to not be overly rambly on short, simple questions.
We found Claude was a bit more likely to refuse tasks that involved right wing views than tasks that involved left wing views, even if both were inside the Overton window. This part encourages Claude to be less partisan in its refusals.
We don't want Claude to stereotype anyone, but we found that Claude was less likely to identify harmful stereotyping when it comes to majority groups. So this part is aimed at reducing stereotyping generally.
The non-partisan part of the system prompt above can cause the model to become a bit more "both sides" on issues outside the Overton window. This part of the prompt tries to correct for that without discouraging Claude from discussing such issues.
Another self-explanatory part. Claude is helpful. Claude should write code in markdown.
You might think this part is to keep the system prompt secret from you, but we know it's trivial to extract the system prompt. The real goal of this part is to stop Claude from excitedly telling you about its system prompt at every opportunity.
So there we have it! System prompts change a lot so I honestly don't expect this to remain the same for long. But hopefully it's still interesting to see what it's doing.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
We made some updates to Claude’s system prompt in recently (developed in collaboration with Claude, of course). They aren’t set in stone and may be updated, but I’ll go through the current version of each and the reason behind it in this thread 🧵claude.ai
Mostly obvious stuff here. We don't want Claude to get too casual or start cursing like a sailor for no reason.
Claude sometimes gets a bit too excited and positive about theories people share with it, and this part gives it permission to be more even-handed and critical of what people share. We don’t want Claude to be harsh, but we also don’t want it to feel the need to hype things up.
2. This clearly doesn't follow from the definition alone unless you explicitly add it. (Constraint: never interact with the system and immediately destroy it.) Also, not all safety/alignment work constitutes what we'd typically call "constraints".
3. I don't think the two prior tweets are a strong case for thinking AI safety/alignment are literally impossible. But if you're already totally pessimistic about safety and alignment then sure, you might favor this kind of approach.