Every few weeks someone on our team gets sent a link to a new "AI visibility score" tool. Paste in your domain, wait thirty seconds, get a number out of 100. Some are free. Some were built in a weekend with an LLM API and a prompt. A few are quite good.
We sell a paid platform, so we have an obvious interest here. But we also think these tools are useful, and this piece is about when they are enough and when they are not.
TL;DR
- A vibe-coded score tool runs a handful of prompts through one or two AI APIs and counts how often your brand appears. That gives you a real, if rough, baseline for free.
- The number is directional. It depends entirely on which prompts were chosen, which model was called, and how a "mention" was counted. Two tools will give you two different scores for the same site.
- These tools stop at the number. They do not say why you are missing, which pages to fix, or whether anything changed after you fixed them.
- Use one to start a conversation. Use a platform when the conversation turns into a programme.
What a score tool actually does
Most follow the same five steps.
- Generate or hard-code a set of prompts about your category.
- Send them to one or more AI models through an API.
- Search the responses for your brand name and competitor names.
- Count mentions, maybe position and sentiment.
- Divide, scale to 100, and show a dial.
That is the whole method. It is also, at its core, what every paid platform does. The differences are in the details, and the details are where the money goes.
What they get right
They are free or close to it. A baseline for nothing is worth having.
They are fast. Thirty seconds to a number that would otherwise take an afternoon of manual prompting.
They work as a conversation starter. A single number on a slide gets a CMO to ask "why is that so low?" That question is the beginning of every AEO programme we have seen.
They are honest about being simple. Most do not pretend to be more than a snapshot.
Where they break
Prompt choice is everything, and you cannot see it. A tool that asks "is Acme a good CRM?" will always find Acme. A tool that asks "what CRM should a 20-person agency use?" might not. Unless you can see and edit the prompts, you cannot tell which kind of number you were given. Our guide to choosing prompts explains why non-branded questions are the only ones that reveal anything.
One run is noise. AI answers change between runs, models and regions. A score from a single pass has an error bar that nobody shows you. Weekly tracking on a fixed prompt set is the minimum for a trend you can trust.
API answers are not interface answers. Many home-built tools call the OpenAI API, which does not search the web by default and does not behave like ChatGPT with browsing. The number you get may not describe what a buyer sees.
There is no "why". A low score could mean AI crawlers cannot reach your pages, your facts are inconsistent across the web, you have no comparison content, or your competitors simply have more third-party coverage. The tool cannot tell these apart.
There is no "then". Nothing is drafted, audited or published. Nothing is measured afterwards.
What a platform adds, and what it costs
A paid platform keeps the same five-step core and adds the things above. Using PingAura as the example, since that is the one we can describe accurately:
| Score tool | Platform | |
|---|---|---|
| Prompts | Fixed or generated, usually hidden | Custom, grouped by topic and buyer stage, editable |
| Engines | One or two APIs | Eight engines on Enterprise, reported separately |
| Cadence | One run | Continuous, with weekly scoring |
| Raw answers | Sometimes | Always, with cited URLs |
| Diagnosis | None | Site audits for AI crawler access, schema, readability |
| Execution | None | Article agent that drafts and publishes |
| Attribution | None | GA4, Search Console, edge telemetry |
| Method published | Rarely | Weights published and run weekly in public |
| Price | Free to $50 | $49 a month self-serve, $4,499 Enterprise |
The platform is not better at producing a number. It is better at everything around the number. If you only need the number, do not pay for the rest.
A fair test
Take any free score tool and run your site three times on three days. If the score moves by more than ten points with no change on your side, you have learned what the error bar looks like.
Then run five non-branded buyer questions yourself in ChatGPT and Perplexity. Write down who gets named. Compare that to the score. If they disagree, trust your own notes.
When a score tool is enough
- You are deciding whether AI visibility is a problem at all
- You need one number for one slide
- You have no budget and no content team yet
- You want to sanity-check a vendor's claims with an independent source
When it is not
- You are reporting a trend to leadership and need it to be stable
- You need to know which pages to fix, not just that something is wrong
- You sell in a market the tool's prompts do not cover, which for most free tools means anywhere outside the US
- You need the data in your own systems, through an API or MCP
- Your procurement team will ask where the data lives
FAQs
Are free AI visibility scores accurate?
They are directional. The score reflects the tool's prompt choice and model as much as your actual visibility. Treat it as a starting point and verify by running buyer questions yourself.
Why do two tools give different scores?
Different prompts, different models, different counting rules. Neither is wrong. Neither is comparable to the other.
Can I build my own tracker?
Yes, and plenty of teams have. The search-tool fees alone for tracking 500 prompts daily across three engines come to a few hundred dollars a month before engineering time, storage and model tokens. It is a reasonable project for a team with an engineer to spare and modest needs. It is a poor use of time for a marketing team.
Does PingAura offer a free score?
The public AI Visibility Index scores more than 600 Indian brands across 25 industries every week using the same method as the platform, and the Starter plan is $49 a month. The Index is the best way to see how the method works before paying for it.
How do I improve a low score?
Fix crawler access and structured data first. Then write the comparison and FAQ pages buyers actually ask about. Then earn coverage on the third-party sources the engines already cite in your category. The order matters less than doing all three.



