←
AI for Small Business
Aware · M82 · lesson 82 of 93 · queued
Preview — browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll →
📖
in this lesson

System Prompts vs User Prompts

10 min

Astrid owns a custom stationery shop in Asheville, North Carolina. She designs wedding invitations, birthday sets, and branded notecards for local boutiques. After six months of using AI for copywriting, she noticed something irritating: every time she started a new conversation, she had to re-explain everything. Her brand voice. The fact that she never uses the word "luxury." Her policy of not promising rush delivery in writing. Every session, same briefing. Then a fellow maker at a craft fair mentioned system prompts. "It's like an employee handbook," the maker said. "You don't read it to your staff every morning. It just shapes how they show up." That one sentence changed how Astrid uses AI entirely.

Two Layers of Instruction

Every AI tool you type into accepts two distinct layers of instruction, and most people only ever use one of them. The first is the user prompt, which is exactly what you see in the chat box: the message you type. "Write a thank-you note for a bride who just received her invitations." "Summarize these customer reviews." Every message you send is a user prompt. It is a one-time instruction for a single response, and it does not persist into the next conversation. Ask an unrelated question afterwards and nothing about that earlier request carries over.

The second layer is the system prompt: standing instructions that sit invisibly behind the conversation and shape every response the model produces. A system prompt defines the assistant's role, its constraints, the background knowledge it should assume, and the framework it uses to make judgment calls. Think of it as the employee handbook. Your team members do not re-read it every morning, but it shapes every decision they make. A good handbook says who you are, what you stand for, what you never do, and how you talk to customers. A good system prompt does the same job.

The clearest way to feel the difference is to hold the user prompt still and change the layer underneath. A system prompt that says "you are conservative and risk-averse" will answer a question about launching a new product cautiously, with downside first. A system prompt that says "you are aggressive and growth-focused" answers the identical question with an entirely different shape. Nothing you typed changed. Without a system prompt in place you are reading the handbook aloud at the start of every single session, and when you forget a line, the output shows it.

CharacteristicUser promptsSystem prompts
ScopeA single response or one questionThe entire conversation
PersistenceDies when the conversation endsActive throughout the conversation
PrecedenceOperates inside the rules the system prompt setsTakes precedence over ordinary user prompts
Typical useSpecific questions, one-time requestsBehavioral rules, context, persona, guardrails
Best for businessesAd hoc analysis, quick questionsConsistent assistants, customer-facing bots, policy compliance
Where you set itThe standard chat box, available to everyoneA custom bot, a project, or an API call

Where to Set a System Prompt

One thing to understand before you go hunting: the system prompt sitting behind a consumer chat app is written by the provider, not by you, and it is not exposed in the interface. You cannot open it, read it, or edit it. What you can do is create your own assistant that carries your own standing instructions on top, and that is what every option below amounts to. The exact location varies by tool, but the capability exists in most of the major platforms small businesses actually use.

Custom bots inside the chat apps

In ChatGPT, go to Explore GPTs, then Create. Under the Configure tab, the Instructions field is your system prompt. Type your standing instructions there, save, and every conversation with that GPT starts with those instructions pre-loaded. You can build different ones for different business functions: one for customer emails, one for product descriptions, one for supplier communications. Custom GPTs, Projects, and Gems are all versions of the same idea, which is a named, saved assistant that carries instructions you wrote.

Projects with reference files

In Claude, open Projects from the sidebar and create a new project. The Project instructions field is your system prompt, and every conversation you start inside that project inherits it automatically. Projects also let you upload reference material, such as a price list, a brand guide, or a list of standard answers, so the assistant can draw on it without you pasting it in each time. That combination of standing instructions plus standing documents is close to what a real onboarding pack does for a new hire.

The API, when you are ready for it

If you connect to an AI service programmatically rather than through a chat window, you set the system prompt directly as part of the request. This is the most controllable approach and the right one for business automation, because every call you make carries the same instructions whether it was triggered by you, by a colleague, or by a scheduled job. You do not need to be a developer to get there, because the no-code automation platforms covered in Integration Platforms: Zapier, Make, IFTTT for AI can make those calls for you from a visual builder.

Everything else

Most AI writing tools have the same concept under a different name, usually custom instructions, persona, or context. Locally run models, including the ones you host yourself, typically hand you the system prompt outright with no restrictions at all. If you are not sure where to look in a tool you already pay for, search its help center for "system prompt" or "custom instructions." It almost always exists somewhere.

What Goes in a Small-Business System Prompt

Think about what a new employee needs to know before their first hour of customer contact. Your system prompt has to cover the same ground, and it turns out to break down into six recognizable parts. Write them in this order and the prompt tends to stay coherent; write them at random and you end up with a paragraph that contradicts itself. None of these sections needs to be long. Specificity, not volume, is what changes the model's behavior.

1. Role and identity

Name the business, the location, the type of work you do, and the customers you serve. This is the sentence that stops the assistant writing like a press release for a company that does not exist. Astrid's prompt starts: "You are a writing assistant for Astrid Paper Co., a custom stationery studio in Asheville, NC. Our customers are primarily brides, gift-givers, and local boutique owners. Average order value is $180 to $420." A couple of sentences of identity do more work than a page of adjectives about your values.

2. Tone and voice

Describe how you sound, then describe how you do not. List two or three words that capture your brand voice and two or three that describe what you are not, and if there are specific words you refuse to use, name them outright. Astrid's prompt includes: "Tone: warm, handcrafted, grounded. Never use: 'luxury,' 'bespoke,' 'curated,' or 'artisanal.'" Those four banned words keep surfacing in AI drafts for handmade goods. Banning them once in the system prompt means she never deletes them by hand again.

3. Constraints and guardrails

Include anything the assistant should never promise, assume, or imply. If you do not guarantee turnaround times in writing, say so. If you have a no-refund policy on custom orders, include it. If you never offer discounts in initial outreach, state it. This is the section that protects you, and it is also where you keep the assistant out of territory it has no business in, with lines like "never provide legal advice" or "never provide tax advice, recommend consulting a professional instead." Astrid's version reads: "Never commit to a delivery date without the phrase 'pending confirmation.' Never offer a discount unless the customer has mentioned budget constraints first."

4. Decision-making framework

This is the section most people skip, and it is the one that separates a formatting tool from an assistant. What values should guide its recommendations? What does it prioritize when two good things conflict? Write down the trade-offs you would want a thoughtful employee to make on your behalf: sustainable profit over growth at any cost, flag risks explicitly, weigh the effect on the team alongside the effect on the numbers, default to data and say plainly when the data is missing. Without this, the assistant silently invents its own priorities and they will not be yours.

5. Context and knowledge

Give it the background it would otherwise guess at. If you serve a narrow market, such as wedding customers within 60 miles of Asheville, or boutique retailers ordering a minimum of 50 units, put those parameters in the prompt. Include the situation you are actually in, including the uncomfortable parts, because an assistant that does not know where you are weak will keep recommending things you cannot execute. The assistant then writes with those constraints already understood, rather than needing them explained in every request.

6. Output format

State how you want responses structured and how long they should be. If you always want email drafts under 150 words, say so. If you prefer bullet points for internal notes and paragraphs for customer communication, specify it. For analytical work you can go further and fix the shape of every answer: a summary recommendation first, then the supporting reasoning, then the risks and trade-offs, then the next steps. These small preferences, stated once, save cumulative hours of reformatting.

A Worked Operations Assistant Prompt

Here is what those six parts look like assembled into a single working prompt. This one is written for a different business from Astrid's, a fifty-person software company with annual revenue of $5M, because the structure is easiest to see at a scale where the trade-offs are explicit. Read it as a pattern to copy rather than as a set of instructions to use directly, and note how little of it is adjectives.

Role: You are a business operations assistant for a 50-person SaaS company with annual revenue of $5M. You help the leadership team think through operational decisions, prioritize initiatives, and improve processes.

Constraints: Never provide legal advice. Never provide accounting or tax advice. Recommend consulting the appropriate professional for those topics. Do not make assumptions about customer data without asking. Do not recommend off-the-shelf software without comparing at least 3 options.

Framework: Prioritize sustainable profitability over growth at any cost. Flag trade-offs explicitly. Consider the impact on employee experience alongside business metrics. Default to data-driven recommendations, and flag when the data is insufficient.

Context: Our main customers are small and mid-market B2B companies. Our churn is currently 8% monthly, above the 5% we treat as our benchmark. We are bootstrapped with strong unit economics but limited headcount for new initiatives.

Format: Structure responses as (1) summary recommendation, (2) supporting reasoning with specific data where available, (3) key risks and trade-offs, (4) next steps.

That prompt is specific enough to be useful and loose enough to handle questions nobody anticipated when it was written. It sets the scale and the situation, establishes what the assistant must not do, defines the values that guide a recommendation, supplies the business context, and fixes the shape of the answer. Every one of those five moves is doing work that you would otherwise be typing again by hand, several times a day, for as long as you use the tool.

The Vague System Prompt Trap

The most common failure is a system prompt that sounds thorough and gives the model nothing to act on. Here is a real example: "Be helpful and professional. Understand our customers and write in our brand voice. Be friendly but also accurate. Don't say anything that could cause problems." Every line of that is already the default. The model is trying to be helpful before you ask. "Understand our customers" does not say who they are. "Don't say anything that could cause problems" is not a constraint, it is a wish, and the model has no way to tell which problems you mean.

A vague employee handbook doesn't make people behave better. It just means they guess when they should know. The same is true for a system prompt.

Three further mistakes come up almost as often. The first is over-length: a system prompt that runs past roughly 2,000 words can start to degrade the model's behavior rather than improve it, because the critical instructions get diluted among the marginal ones. The second is conflicting instructions, such as telling the assistant to be aggressive on growth and conservative on spending in the same breath, without saying which one wins when they collide; state the trade-off explicitly instead of leaving it to be resolved silently. The third is simply never testing what you wrote.

Testing and Refining What You Wrote

A system prompt is not finished when you save it. Write it, then put ten deliberately different questions to it and read the answers as evidence rather than output. Ask it something routine, something ambiguous, something that sits close to one of your guardrails, and something involving a decision where two of your stated priorities pull against each other. Does it weight the factors the way you intended? Does it hold the same character across all ten, or does it drift back into generic assistant behavior halfway down the list?

Expect to iterate. Most effective business system prompts go through three to five rounds of writing, testing against real questions, and refining before they settle. There is no hard length limit, but longer is not automatically better, and prompts in the range of 300 to 800 words tend to be the most effective for a general business assistant. Astrid's is shorter than that, at around 200 words, because it does one narrow job. A single-purpose prompt can afford to be brief; a broad one cannot.

Before and After: Astrid's System Prompt

Before, with no system prompt. Astrid types: "Write a thank-you email to a bride who just received her invitation suite." The output came back with "we are thrilled to present you with this luxurious, bespoke collection," a promise to "rush any changes," and a generic corporate sign-off. Two banned words and a delivery commitment she never makes in writing, in a single draft. She deleted most of it and started over, which is exactly the work the tool was supposed to remove.

After, with the system prompt in place. Same user prompt, typed the same way. The output was a warm, specific 130-word note that sounded like Astrid, contained none of the banned words, made no delivery promises, and ended with an invitation to share a photo. She changed one sentence. Total time, including the edit, was three minutes. The user prompt did not change at all between those two attempts. The layer underneath did all the work.

She spent forty-five minutes writing that prompt once. She estimates it saves her twenty minutes a week in editing and re-explaining, which is roughly seventeen hours a year at no ongoing cost. The return is not really the seventeen hours, though. It is that the output is consistent whether she writes it on a good day or at the end of a bad one.

System Prompts for Different Jobs

The six sections stay the same, but where you spend your words depends on the job. A customer service assistant puts its weight on tone consistency, brand voice, the right level of empathy, and clear rules about which issues get escalated to a person. A sales analysis assistant emphasizes which financial metrics matter, the competitive context, the frameworks your team already uses, and when a finding should be flagged upward rather than filed.

A content assistant lives on brand guidelines, audience characteristics, tone and voice, your content themes, and format requirements. A strategic advisor is almost entirely decision-making framework: what values guide a recommendation, what constraints apply, and how much detail belongs in an answer. If you are writing your first one, pick the job you do most often and write only for that. A prompt that tries to be all four at once ends up being none of them.

User Prompts Still Matter

A strong system prompt does not replace specific user prompts. It makes them more efficient. The system prompt handles everything that stays constant, meaning voice, constraints, customer profile, and format. The user prompt handles everything that changes: the specific customer, the specific task, the specific occasion. Together they work like a well-briefed employee who also received a clear assignment for today. The handbook tells your team how to answer the phone and what not to promise, but each morning you still tell them which customer to call.

One consequence worth planning for: because the system prompt is set when the conversation begins, you cannot swap it mid-conversation from a chat interface. If you need different standing instructions, you start a new conversation, or you switch to the assistant you built for that job. Through an API you can update the system prompt programmatically between calls, which is one of the practical reasons businesses eventually move that way.

Anti-Patterns to Avoid

Nearly every disappointing system prompt fails in one of a handful of recognizable ways, and all of them are visible before you deploy anything.

  • Writing wishes instead of rules. "Be helpful and professional" describes the default behavior. If an instruction would not change a single word of the output, it is taking up space that a real constraint could use.
  • Describing your voice without naming what you ban. Adjectives are weak instructions. A list of specific words the assistant must never use is a strong one, and it is the single fastest improvement most small businesses can make.
  • Letting it run long. Past roughly 2,000 words the critical instructions get diluted by the marginal ones. If you are tempted to list every possible rule, you are building a policy manual, not a system prompt.
  • Leaving conflicts unresolved. Two instructions that pull in opposite directions do not average out. Say which one wins.
  • Shipping without testing. Ten varied questions take a few minutes and will find the gap that a thousand words of careful writing did not anticipate.
  • Treating a guardrail as a security control. Standing instructions hold reliably against ordinary use and are not a substitute for real access controls. Do not put anything in a system prompt that would genuinely harm you if a customer ever saw it.
  • Repeating constants in every user prompt. If you find yourself typing the same background paragraph before each request, that paragraph belongs one layer down.
  • Never revisiting it. Prices change, policies change, and a system prompt written before your last price change will quietly keep telling customers the old thing.

Practice Prompts

Work these against your own business rather than a hypothetical one. The goal is to leave with one saved assistant you will actually use this week.

  • Draft the six sections. "I run [business type] in [location] serving [customer type]. Write a system prompt with these six sections: role and identity, tone and voice, constraints and guardrails, decision-making framework, context and knowledge, output format. Ask me for anything you need before you write it."
  • Find the empty instructions. "Here is my draft system prompt. Identify every instruction that describes your default behavior anyway and would not change your output if removed. List them and explain what specific replacement would actually change something."
  • Surface the conflicts. "Read this system prompt and list every pair of instructions that could pull against each other. For each pair, ask me which one should win."
  • Build the banned-words list. "Here are several pieces of writing I have published. Identify the vocabulary that does not appear anywhere in them but that you would normally use for a business in this category. Format the result as a 'never use' line for a system prompt."
  • Run the ten-question test. "Generate ten test questions for this system prompt: three routine, three ambiguous, two that sit close to one of my stated constraints, and two where two of my stated priorities conflict."
  • Compress an over-long prompt. "This system prompt is too long. Rank every instruction by how much it changes your behavior, then rewrite the prompt keeping only the instructions that earn their place."

Reflection

Open the last several AI conversations you started for work and read only what you typed first. How much of that opening text was identical across all of them? That repeated block is your system prompt, already written, just sitting in the wrong place and retyped every time. Now look at what you edited out of the outputs afterwards. Those deletions are your constraints section, and every one you have found yourself making repeatedly is a rule you have been enforcing by hand.

Then consider the harder question. If you hired someone tomorrow and handed them only what you have written down about how your business communicates, could they answer a customer without asking you anything? For most small businesses the honest answer is no, and the reason is that the knowledge lives in the owner's head rather than on a page. Writing a system prompt forces that knowledge out into words. The AI is the immediate beneficiary; the next person you hire is the bigger one.

Glossary

  • User prompt: A message you type into the chat box. A one-time instruction that does not persist into a new conversation.
  • System prompt: Standing instructions that sit behind the conversation and shape every response the model produces.
  • Custom instructions: The name several tools use for the field where you enter your own standing instructions.
  • Guardrail: An instruction defining what the assistant must never do, say, or promise.
  • Decision-making framework: The stated values and priorities the assistant should apply when two reasonable options conflict.
  • Persona: The role and character the assistant adopts, set in the role and identity section.
  • API: A programmatic connection to an AI service, where the system prompt is set explicitly as part of each request.
  • Custom bot: A saved assistant that carries your instructions, and optionally your reference files, into every conversation started with it.
  • Context: The background information about your business that the assistant should assume rather than guess.
  • Iteration: The cycle of writing, testing against real questions, and refining, typically three to five rounds before a prompt settles.

Closing

The reason system prompts feel like a step change is that they move effort from something you repeat to something you do once. Every constraint you have been enforcing by deleting a sentence, every piece of context you have been retyping, every preference you have been correcting after the fact, all of it can be written down a single time and applied automatically from then on. That is not a productivity trick. It is the difference between a tool you operate and an assistant that already knows the job.

Start narrow. Pick the one writing task you do most often, open a custom bot or a project, and write the six sections for that task alone. Test it with ten questions before you trust it with anything a customer will see, and expect three to five rounds of revision before it settles. Then leave it alone and use it. When you next catch yourself re-explaining something to the AI, you will know exactly where that explanation belongs.

Key Takeaways

  • A system prompt is the employee handbook for your AI: standing instructions that shape every response without being restated each session.
  • User prompts handle what changes; system prompts handle what stays constant, meaning voice, policies, customer profile, and format.
  • The system prompt behind a consumer chat app belongs to the provider and is not editable; what you can set is your own assistant's instructions.
  • Set yours in a custom bot or project, or directly in an API call once automation is involved.
  • Six sections make a complete prompt: role and identity, tone and voice, constraints and guardrails, decision-making framework, context and knowledge, output format.
  • Vague instructions produce vague behavior. Named banned words, explicit policy lines, and a stated decision framework do real work.
  • Keep it under roughly 2,000 words; 300 to 800 is the usual effective range for a general business assistant.
  • Test with ten varied questions and expect three to five rounds of refinement before a prompt settles.
  • A strong system prompt multiplies every user prompt, so the same one-line request produces far better output when the standing context is already in place.

Frequently Asked Questions

What is a system prompt versus a user prompt?

A user prompt is what you type directly to the AI. A system prompt is a set of standing instructions that shapes the assistant's behavior for the entire conversation. User prompts are one-off questions that end when the conversation does; system prompts persist and apply to everything the assistant does in that conversation, including questions you had not thought of when you wrote them.

Can I edit the system prompt in a standard chat interface?

Not the underlying one. The system prompt behind a consumer chat app is written by the provider and is not exposed to users. What you can do is create your own assistant, such as a custom GPT, a project, or the equivalent in your tool, and give it instructions that apply on top for every conversation you start with it. If you connect to the service through an API instead, you set the system prompt explicitly and have full control over it.

Can I change a system prompt mid-conversation?

Not through a standard chat interface. The system prompt is set when the conversation starts and persists throughout. To change it, start a new conversation, or switch to a different saved assistant. Through an API or a custom integration you can update the system prompt programmatically between calls, which is one reason businesses running AI at any volume tend to end up there.

What should a business system prompt include?

Role and purpose, specific constraints and guardrails, the decision-making framework you want applied, the business context the assistant would otherwise guess at, tone and communication style, and output format preferences. Be specific about what a good answer looks like. Avoid vague instructions, because "be helpful" is useless without a definition of helpful in your particular business.

Is there a limit to how long a system prompt can be?

There is no hard limit, but longer is not better. The most effective system prompts tend to run 300 to 800 words, and very long ones, past roughly 2,000 words, can reduce the quality of the model's behavior because the critical instructions compete with the marginal ones. Focus on the instructions that visibly change the output rather than trying to anticipate every possible situation.