System Prompts vs. User Prompts: What Actually Goes Where
The practical difference between a system prompt and a regular message, why mixing them up produces inconsistent results, and how to split instructions between them.
Published March 10, 2026
Most chat tools have two distinct places to put instructions: a system prompt (sometimes called "custom instructions" or a persona setting) that applies to the whole conversation, and the regular message box for whatever you're actually asking right now. Putting the wrong kind of instruction in the wrong place is a common, easy-to-miss reason a prompt that should work reliably doesn't.
What belongs in a system prompt
Anything meant to hold steady across the whole conversation: a role or persona, a consistent tone, standing rules about format or behavior, things to always avoid. This is the right place for "respond concisely, no filler phrases" or "you are a code reviewer, focus on correctness over style," because it should apply to every message in the conversation, not just the first one.
What belongs in the regular message
The specific task at hand, right now: the actual question, the actual text to analyze, the actual code to review. Task-specific detail doesn't belong in a system prompt, because a system prompt that changes with every question stops doing its job of holding context steady, and most tools don't make it easy to edit anyway once a conversation is underway.
The mistake that causes inconsistent results
Putting standing rules in a regular message means they only apply to that one exchange; ask a follow-up question and the model has no memory that you wanted concise answers or a particular tone, unless you repeat the instruction every single time. This is the single most common reason a chat starts strong and drifts: the persona-setting instruction lived in message one instead of the system prompt, and by message five it's been diluted by everything said since.
A quick way to decide
Ask: would I want this instruction to still apply ten messages from now, without repeating it? If yes, it belongs in the system prompt. If it's specific to this one question and wouldn't make sense applied to a totally different follow-up, it belongs in the message.