For a useful AI visibility baseline, start with 40 to 100 prompts, track them across 2 or 3 AI engines, and aim for about 300 to 900 prompt-runs per reporting period. Treat that as a working range, not a universal statistical guarantee: the right sample depends on your category, how often you repeat each prompt and whether you need a broad diagnosis or a precise comparison. If you are setting up measurement for the first time, SearchFIT’s AI search resources can help you plan the wider work around your tracking.
The key is to count prompt-runs, not just prompts. One prompt asked once is one observation; the same prompt asked on three engines and repeated on several dates creates more observations. Even a large total can be misleading if it is concentrated in one topic, so you need a balanced prompt set as well as enough runs.
The short answer: how many prompts do you need for AI visibility?
For many brands, 40 to 100 well-chosen prompts is a sensible core panel. It is enough to cover a few important buyer questions without creating a tracking project that is hard to review. A small business testing the waters can begin with 15 to 30 prompts. An e-commerce brand with several product categories, or an agency tracking several clients, will usually need more.
Use these as starting points:
| Tracking situation | Starting prompt count | A useful first purpose |
|---|---|---|
| Manual or low-cost exploration | 15 to 30 | Find obvious gaps, brand-description issues and recurring sources |
| One focused B2B SaaS product | 40 to 80 | Compare visibility across key buyer questions and topics |
| A broader B2B category or more than one product line | 60 to 120 | Separate product, persona and use-case visibility |
| E-commerce with several product categories | 100 to 300 | Cover product attributes, use cases, budgets and category choices |
| Agency portfolio or large multi-market brand | 150 to 350 or more per brand or market | Compare brands, locations, categories and competitors in a repeatable way |
These are planning ranges, not sample sizes guaranteed to make a result statistically significant. A prompt panel with 100 near-duplicates is weaker than a carefully balanced panel with 40 prompts. The sample-size discussion from Cloro also highlights the need to distinguish the number of prompts from the number of observations collected by repeating them.
For initial tracking, think in three layers: a manageable set of prompts, more than one relevant AI engine, and repeated observations over time. If your budget is tight, reduce the number of engines or the frequency first. Do not fill the panel with low-value variations just to make the prompt count look bigger.
What is a prompt-run?
A prompt is the question or instruction you submit to an AI search tool. For example: “What are good project management platforms for a small construction business?” A prompt-run is one occasion when that prompt is submitted to one particular engine.
If you track 50 prompts on three engines and run each prompt once on each engine during a reporting period, you have 150 prompt-runs. If you repeat the same set four times during that period, you have 600 prompt-runs.
The basic calculation is:
Prompt-runs = prompts × engines × runs per prompt in the period
For example:
- 40 prompts × 2 engines × 2 runs = 160 prompt-runs.
- 50 prompts × 3 engines × 2 runs = 300 prompt-runs.
- 100 prompts × 3 engines × 3 runs = 900 prompt-runs.
This count is useful, but it does not tell the whole story. These observations are not automatically independent. Prompts about the same product category can produce similar answers. Two engines may also use related sources or models. A large prompt-run total is not a substitute for coverage across your actual audience, intent types and markets.
Why AI visibility is harder to measure than a rank
A search rank is a position for a particular query, location and time. AI answers are more variable. An engine may generate a different answer when asked the same question again. It may also retrieve different pages, mention different brands or change the order of recommendations.
That variability is one reason a single answer is not reliable evidence of a trend. Search Engine Land’s guide to tracking AI prompts describes prompt tracking as a way to monitor how answers change, rather than as a one-off check. In practice, a repeated sample helps you separate a recurring pattern from an unusual response.
A few terms make the measurement easier to understand:
- AI visibility means how often, and in what ways, a brand appears in the answers to a defined set of relevant prompts.
- Mention rate is the share of tracked answers that name your brand. It does not say whether the mention is positive, accurate or prominent.
- Citation rate is the share of answers that include a link or source citation to your site. Some tools also count citations to other sources that mention your brand, so check the definition.
- Share of voice is a comparison of your brand’s appearances with the appearances of competitors in the tracked answers. It is meaningful only in relation to the prompt set and method used.
- Prompt cluster is a group of prompts about the same topic or buyer need, such as “accounting software for freelancers”.
Generative systems are often described as non-deterministic: the same input can produce different outputs. Retrieval can also change as an engine updates its index or uses different sources. That does not mean the data is useless. It means the measurement needs a repeatable method and a sensible level of caution.
What do sample size and confidence mean?
A sample is the set of answers you collect and analyse. A confidence interval is a range around an observed estimate that expresses how much uncertainty there may be in that estimate under a statistical model. It is not a promise that the true value always falls inside that range. It also does not fix a biased prompt list.
As a simple illustration, suppose your brand appears in 18 of 72 answers. That is a 25% mention rate in the sample. The estimate is still uncertain because 72 observations are limited. Cloro’s sample-size analysis gives an example of a 25% rate across 72 answers with an approximate 95% margin of error of 10 percentage points, under its stated assumptions. It estimates a margin near 5 percentage points at around 300 observations. These figures are useful illustrations of how uncertainty can narrow as a sample grows, not a guarantee for every prompt set.
The MaxAEO explanation of prompt-run maths discusses the difference between collecting more prompt-runs and drawing a stronger conclusion. If you are comparing a result over time, the details matter: the same prompts should be used, the engine and settings should be recorded, and you should avoid treating related observations as fully independent.
A further distinction matters: total prompt-runs across engines are not the same as prompt-runs on each engine. If you collect 300 runs split evenly across three engines, that is roughly 100 runs per engine. It can support a broad, directional view, but it is not the same as 300 observations for each engine. If the decision is specifically about whether your visibility on one engine improved, evaluate that engine’s sample on its own.
A source such as Cloro estimates that detecting a change from a 20% to a 30% rate may require roughly 294 answered runs per period on an engine, given the assumptions behind its calculation. Treat that as an illustration of the amount of data a relatively narrow comparison can take. It is not a universal threshold: the required sample changes with the size of the change you want to detect, the underlying rate, the test design and the dependence between prompts.
What small samples can and cannot tell you
A panel of 15 to 30 prompts can be valuable. It is simply better for exploration than for proving that a change happened.
A small panel can help you:
- Check whether an AI engine recognises your brand and describes what it does.
- Spot factual errors, outdated product details or an unhelpful brand description.
- See which competitors commonly appear in answers to a first set of buyer questions.
- Find publications, review sites and community discussions that recur as sources.
- Identify topic areas where your brand is absent and decide what to investigate next.
- Make a first draft of a prompt taxonomy: the topics and types of questions worth tracking.
For instance, a SaaS marketer might test 20 questions about analytics tools. If the brand appears in answers about data dashboards but not in answers about forecasting, that is a useful lead. It suggests a topic gap worth checking with a broader set of prompts and sources. It does not prove that the brand is invisible to all buyers looking for forecasting software.
A small panel cannot reliably prove that:
- An AEO change, public relations campaign or new page caused a visibility lift.
- Your share of voice is representative of the whole market.
- One AI engine consistently prefers a competitor across all use cases.
- A result applies to every location, audience or product category.
- A week-to-week movement is a lasting trend rather than ordinary answer variation.
AEO, or Answer Engine Optimisation, is the work of making useful, accurate information easier for search and AI systems to understand and use. It can include improving pages, providing clear product information and earning relevant third-party coverage. Seeing a change after this work does not, by itself, prove that the work caused the change. Other things may have changed too, including the engine, the sources it retrieves or the wording of the prompts.
A small sample is especially sensitive to individual answers. In a set of 20 answers, one answer represents 5% of the total. If the brand goes from absent to mentioned in one answer, the rate moves by five percentage points even though there has been no broad shift. Report that as a change in the sample, not as proof of a market-level improvement.
How to choose the right sample for your budget
Your budget affects how many prompts you can monitor and how often you can repeat them. It does not decide which questions matter. Start with the business decision, then choose a tracking plan that fits the available time and monitoring capacity.
If you have little or no tool budget
Begin with 15 to 30 prompts and check them manually on one or two engines. Keep a spreadsheet with the date, engine, exact prompt, answer, brand mention, citations and any notable competitors. Repeat the same prompts on a consistent schedule rather than changing them every time.
This is an audit, not a high-confidence measurement programme. Use it to learn how engines describe the category and to form hypotheses. You might discover that every answer points to a comparison site, or that the engine confuses two similarly named products. Those findings can guide further research, but do not overstate the size of a change from a small set.
If you can fund focused tracking for one product
A practical starting point is 40 to 80 prompts, grouped into three or four topics. Track the same prompts on two or three engines that matter to your audience. A weekly check can reveal broad patterns; more frequent runs can help when you are investigating a specific change or a fast-moving category.
A simple example is a B2B software company that sells an expense platform. It could track prompts about expense policy, receipt capture, finance integrations and alternatives to existing platforms. If it has 60 prompts across three engines and runs them twice each in a month, that creates 360 prompt-runs in total. Each engine contributes 120 of those runs if the distribution is even. The example is a planning calculation, not a promise that 360 runs will detect any particular lift.
If you manage a broad product catalogue
Use more prompts when each category creates a distinct buying journey. An outdoor retailer selling footwear, tents and packs should not treat all product discovery as one topic. People ask about fit, weather, material, weight, price and intended use. A panel of 100 to 300 prompts may be more practical for covering several product groups, but the team should prioritise its highest-value categories first.
To keep costs under control, do not run every prompt on every engine every day by default. You could track a core set weekly and run a smaller set of high-priority prompts more often. If seasonal demand is important, increase coverage for the relevant category during the period when decisions are being made.
If you are an agency or tracking several markets
Separate each client, brand or market into its own panel. A combined account total can hide the fact that one client has a very small sample or that one region is underrepresented. Use a shared prompt framework for consistency, but keep client-specific prompts where products, competitors or local language differ.
A larger panel, such as 150 to 350 prompts per brand or market, may be appropriate for a broad programme. It brings more coverage, but also more review work. A useful reporting system should let you group findings by client, engine, topic and intent. For practical reporting ideas, see SearchFIT’s guide to agency client reporting on AI visibility.
How to build a useful prompt panel
The purpose of your panel is not to collect every way someone could phrase a question. It is to represent the important questions your audience might ask when discovering, evaluating or verifying a solution.
1. Start with real customer language
Use evidence before brainstorming. Useful sources include:
- Google Search Console queries that show how people already find your site.
- Sales calls, customer interviews and support conversations.
- Product reviews, forums and relevant community discussions.
- Search queries that lead to category pages or product comparisons.
- Questions from your sales and customer success teams.
Search Console data reflects searches on Google, not all AI conversations. Still, it can help reveal customer wording and topics you may not have considered. Sales and support language can uncover constraints such as company size, integrations, location, materials or budget.
2. Group prompts by topic and intent
Intent means the purpose behind a question. A buyer might be learning about a problem, comparing possible solutions or checking a specific supplier before purchase. Put prompts with similar topics and purposes together so you can see where the pattern occurs.
For a B2B SaaS product, an initial panel might include:
| Cluster | Example prompt | What it helps investigate |
|---|---|---|
| Problem discovery | “How can a finance team reduce time spent processing employee expenses?” | Whether the brand appears when people describe a problem |
| Category discovery | “What expense management software suits a company with 200 staff?” | Visibility in broad solution selection |
| Constraint and persona | “Which expense tools support Xero and have approval controls for Australian businesses?” | Fit for a particular buyer or requirement |
| Alternatives | “What are alternatives to [competitor] for managing receipts?” | Whether the brand appears in comparison journeys |
| Branded verification | “[Brand] reviews, integrations and pricing: what should a buyer know?” | Whether descriptions of the brand are accurate and useful |
The example prompts are starting points, not claims that a particular engine will respond in a particular way.
3. Include both branded and non-branded prompts
A branded prompt includes your brand name. For example: “How does Brand A compare with Brand B?” A non-branded prompt describes a need or category without naming your company, such as: “What tools help a small team manage employee expenses?”
Track both, but report them separately. Branded prompts are useful for checking your reputation, product facts and comparisons. Non-branded prompts are more useful for exploring discovery: whether your brand surfaces when a buyer has not already named it.
If nearly every prompt contains your brand name, you have designed a test that makes brand mentions more likely. A strong result in that panel should not be presented as evidence of broad discovery visibility. Keep a clear label for each prompt so you can filter the results later.
4. Cover meaningful variations, not trivial rewrites
A prompt set should reflect differences that could change the answer. A buyer asking for software for a small Australian business may have different needs from an enterprise buyer in Germany. A shopper looking for waterproof hiking boots has different requirements from one looking for a lightweight summer shoe.
Do not inflate the panel with many prompts that differ only by swapping “best” for “top” or changing the word order. Those variations may be useful for a specific language test, but they do not add the same coverage as a distinct product use, persona, budget or market.
The prompt-selection guidance from Minineo is a useful companion for thinking about prompt coverage and organisation. The principle is straightforward: define what each prompt represents before adding it to the panel.
5. Freeze a core panel, then add new prompts deliberately
Keep a stable core panel for comparisons over time. If you replace half the prompts every month, a change in the overall score may reflect the new questions rather than a change in visibility.
You can still add prompts. Give them a label such as “new product launch”, “seasonal test” or “customer question”. Report results for the stable panel separately from the exploratory prompts until you have enough history to decide whether they belong in the core.
How many prompts should each topic have?
There is no fixed number that suits every topic. As a starting structure, try to give each major cluster roughly 10 to 20 prompts, then adjust based on how important and broad that topic is. One industry guide suggests clusters of around 15 to 20 prompts as a practical way to cover a theme without treating every phrasing as a separate market.
For a 60-prompt SaaS panel, four clusters of 15 prompts can be a clear starting shape. For a retailer with 180 prompts, you might allocate prompts across product categories and buying needs rather than force the same number into every cluster. A category responsible for a large share of revenue or strategic growth may deserve more coverage.
Think of clusters as a way to prevent a common analytical mistake: combining many observations from one topic and assuming they represent every topic. If 70% of your prompts concern pricing, your overall visibility score mostly describes pricing questions. It does not give equal evidence about integrations, customer support or product suitability.
How often should you run prompts?
Choose a cadence that matches your decision cycle. Weekly runs can help identify patterns without asking a team to react to every single answer. A monthly reporting period is often easier to communicate, while more frequent checks can be useful for a short experiment or a volatile product launch.
Avoid treating a daily score as a daily verdict on your marketing. Day-to-day changes can be ordinary output variation. Instead:
- Keep the prompt wording and engine settings consistent.
- Compare like with like: the same prompts, engine and time window.
- Review results by topic as well as in aggregate.
- Look for movement across repeated observations before escalating a change.
- Record major changes to your website, product, public information and tracking method.
If one answer changes, inspect it. If the same pattern appears across several prompts in a topic and persists across later runs, it is more worth investigating. A rolling average can make a chart easier to read, but it does not remove bias from a poor prompt set.
What should you measure in each answer?
A simple, consistent classification is more useful than an elaborate score that nobody can explain. For each answer, record:
- Whether your brand is mentioned.
- Whether a competitor is mentioned.
- Whether the answer links to or cites your site.
- Whether it cites a third-party page about your brand.
- Whether the description is accurate, inaccurate or unclear.
- Whether the brand is recommended, neutrally described or criticised.
- Which prompt cluster and buyer intent the prompt belongs to.
Keep “mentioned” separate from “recommended”. A brand may appear in an answer as an example, a comparison or a warning. These outcomes have different implications. Likewise, being cited is not the same as being recommended, and a citation to a third-party review is not the same as a citation to your product page.
Before reporting a score, write down its definition. For example: “Mention rate is the proportion of completed answers in this panel that include the brand name.” That makes it easier for another person to understand what the number does and does not measure.
A practical decision framework
Use the sample size that matches the decision you need to make:
- “Does the engine know who we are?” Start with a small diagnostic panel of branded and category prompts. Check how the brand is described and whether key facts are right.
- “Which topics should we work on?” Use a balanced set of about 40 to 100 prompts and review results by cluster. Look for repeated gaps, not just a single low score.
- “Did our work cause a measurable lift?” Keep prompts and methods stable, collect more repeated observations and compare a suitable baseline with a later period. Consider whether other changes could explain the result.
- “Which category or market has the best opportunity?” Give each category or market enough prompts to stand on its own. Avoid a single blended score that lets a large area dominate.
- “How does our visibility compare with a competitor?” Use the same prompt panel, engines, settings and time windows for both brands. State that the comparison applies to this panel, not to every possible AI answer.
If your team needs help turning findings into pages and content, connect the tracking work to an action plan. SearchFIT’s AEO content strategies cover practical ways to improve how content answers audience questions. For platform scope and current plan details, check SearchFIT pricing rather than estimating tool capacity from a prompt count alone.
Common mistakes that make a large sample weak
More prompt-runs do not automatically mean better measurement. Watch for these problems:
- Duplicate prompts: Many near-identical questions create volume without adding much coverage.
- Only branded questions: Results can overstate discovery because the question already supplies the brand name.
- One topic dominating: The overall rate may hide weak visibility in other important areas.
- Changing the panel constantly: You lose a clean basis for comparison between periods.
- Mixing engines without labels: A combined number can conceal different answer behaviour across engines.
- Ignoring missing answers or failures: Report how many prompts were successfully completed, rather than silently treating failed runs as negative answers.
- Claiming cause from timing alone: A score that rises after a content update does not prove that the update caused the rise.
- Treating all citations as equal: A citation to your site, a review site and a general reference page are different outcomes.
A larger panel makes these issues more consequential because it can produce a polished-looking dashboard from a flawed design. Document the prompts, categories, engines, schedule and metric definitions so that someone else can reproduce the method.
A simple 30-day setup
If you are starting from scratch, use the first month to establish a method rather than chase a perfect number.
Week 1: Define the decision. Choose the products, markets and buyer questions that matter. Decide whether you are checking brand accuracy, non-branded discovery, citations or competitor presence.
Week 2: Draft and group prompts. Build a starter list from customer language and search data. Label each prompt by topic, intent, brand status and market. Remove duplicates that do not represent a meaningful difference.
Week 3: Run a first baseline. Test the same prompts on the engines that matter to your audience. Save the exact answers or a consistent summary, along with the date and any citations.
Week 4: Review and refine. Look for recurring patterns by cluster. Correct factual errors where possible, identify promising content or third-party source gaps, and decide which prompts to retain. Keep the original core panel intact if you plan to compare later periods.
At the end of the month, your result is a baseline, not a verdict on the whole market. You should be able to explain how it was collected, what population of questions it represents and what you want to test next.
The takeaway
For many teams, 40 to 100 carefully selected prompts is a useful starting panel for AI visibility tracking. A smaller sample can surface obvious issues; a larger one can cover more categories and markets. In either case, interpret results in light of the number of prompt-runs per engine, how the prompts are grouped and how consistently you repeat them.
The strongest tracking programme is not the one with the biggest prompt count. It is the one that asks relevant questions, separates discovery from branded verification, keeps a stable core and connects observed patterns to a sensible next action. If you are ready to plan that work, explore SearchFIT’s platform and plans and choose a tracking scope that matches the decisions your team needs to make.