Skip to main content

Field note · AI search

There’s No Such Thing as an AI Visibility Score

A single number averages four different problems with four different owners. Here is what you can observe instead, and what nobody can observe at all.

tl;dr

A single AI visibility score averages separate problems with different owners and hides which one needs fixing. What you can observe is more useful: whether you appear for a defined set of questions, whether the description is accurate, whether crawlers can reach your pages, and what Google and your analytics report. Nobody outside the platforms knows the ranking logic, including me, and nobody can guarantee a citation.

Allison MarxPublished 6 min read

Allison Marx at work.

Somebody is going to try to sell you a number between 0 and 100 this quarter.

It’ll be called an AI Visibility Score, or an AI Presence Index, or something with the word “readiness” in it. It’ll go on a slide. Your CEO will ask why it went from 61 to 58, and you won’t have an answer, because nobody who built the number can tell you either.

I understand the appeal. Your boss asked whether you show up in ChatGPT. A single number is an answer you can give in a meeting. But the number is doing something specific under the hood, and once you see what it’s doing, you can’t unsee it.

One Number Means Averaging Things That Shouldn’t Be Averaged

Every composite visibility score works the same way. It takes unrelated observations, normalizes them onto a shared scale, weights them by a formula the vendor won’t show you, and returns an average.

Say your score is 58. That could mean your content is clear but your pages block the crawlers that feed AI answers. It could mean your pages are perfectly accessible but the claims on them have no supporting evidence, so nothing gets quoted. It could mean you’re represented accurately in one platform and described as a competitor’s subsidiary in another.

Four different problems, four different owners, four different fixes. Averaged into a 58, they’re indistinguishable. The score tells you that something is wrong while actively concealing which thing.

Then there’s the second-order problem. One number turns into a target. The moment a score goes on a dashboard, someone gets measured on moving it, and the fastest way to move a composite is to optimize whichever input is cheapest to game. That’s usually volume of published content, which is how you end up with forty thin pages and a rising score while your representation gets worse.

What You Can Observe

Plenty. Just not as one number.

Observation What it tells you What it doesn’t
Brand appearance in a defined prompt set Whether you appear in the questions you chose to monitor Whether the mention was accurate, influential, or repeatable
Description accuracy Whether the answer represents your offer and category correctly Whether that description drove a visit or a sale
Citation or source link Whether an answer linked to one of your pages in that instance Whether anyone saw, trusted, or clicked it
Technical access Whether relevant crawlers can reach and render priority pages under your policies Whether a platform will select the page for an answer
Generative-search impressions Whether eligible pages appeared in Google’s reported generative surfaces Why the page appeared, or what it was worth
Identifiable AI referrals What attributable visitors from AI sources do on your site Total AI influence, including unattributed journeys
Retention and customer feedback Whether customers get the value the public representation implies Whether AI exposure caused the outcome

These aren’t ingredients for a score. They’re different kinds of evidence, with different owners, time horizons, and decisions attached.

Two of them need more than a row.

Answer content, on a dated baseline. Define 15 to 25 questions reflecting how a prospective customer discovers, compares, and evaluates what you sell. Include category questions, problem questions, comparison questions, and questions that test whether the platform understands your business at all. Run the same set across the platforms that matter to your audience, in fresh sessions, on a defined cadence. For each response record the platform, date, whether you appeared, how you were described, whether that description was accurate, whether a source link appeared, and which competitors showed up.

One run is a snapshot. Repeated runs are a pattern. This is structured qualitative observation rather than a stable platform metric, and that distinction is a strength rather than a defect.

Whether relevant systems can reach and render your pages. Access is a prerequisite, not a citation guarantee. Crawlers and answer products differ in capability, policy, and rendering behavior, so don’t assume a page visible in your browser is equally usable to every system. Review robots directives, server responses, indexing controls, JavaScript-dependent content, and the specific crawler policies you’ve chosen. The conditions are usually checkable. The right remediation may be quick, or it may require decisions about rendering, infrastructure, security, and crawler policy.

A reasonable first audit

Fifteen questions, two answer platforms, a spreadsheet. Record results in fresh sessions on the same day, then repeat monthly before drawing any conclusion.

Don’t start by monitoring every possible prompt. Start with the questions that would matter if the answer were wrong.

What You Can’t Observe

I’d rather say this plainly than let it get smoothed over in a proposal.

Nobody outside these companies knows the retrieval and ranking logic behind a given answer. Including me. Anyone claiming to have reverse-engineered it is describing correlations they’ve observed, which is a reasonable thing to do and a different thing from knowing.

You can’t guarantee a citation. No content change, schema addition, or structural fix produces a promise that a platform will quote a specific page for a specific question. Any offer including that promise is selling something it can’t deliver.

You can’t compare across platforms on a shared scale. Each retrieves differently, updates on its own cadence, and weights sources by its own logic. A number flattening ChatGPT, AI Overviews, and Perplexity into one index has already lost the information you’d need to act.

Track These Separately, With Owners

If you need to report upward, use a short set of distinct observations with their own trend lines, owners, and decision implications. Question coverage. Description accuracy. Access status. Generative impressions. Referral volume and behavior.

Five numbers that stay five numbers.

The purpose isn’t a new dashboard category. It’s making the next decision legible: whether the issue belongs with content, the technical web team, analytics, product marketing, customer experience, or leadership. A change in question coverage should start a different conversation from a change in description accuracy. That’s exactly why they can’t be averaged.

What the Evidence Supports

Public research helps here when it narrows bad assumptions, not when it claims to expose a platform’s hidden ranking system.

Ahrefs’ analysis of 75,000 brands, published May 2025, measured Spearman correlations against AI Overview brand mentions. Branded web mentions came in at 0.664, branded anchors at 0.527, branded search volume at 0.392. The link metrics that dominated classic SEO trailed: Domain Rating at 0.326, referring domains at 0.295, backlinks at 0.218.

The practical implication is modest and useful: broad, attributable discussion of a brand appears to track more closely with AI Overview mentions than traditional link metrics do in this dataset. It doesn’t establish that producing more mentions causes AI systems to represent a brand more often or more accurately.

The study says so itself. Correlation isn’t causation, and the authors describe the full set of factors as showing “moderate to very weak correlations.” Branded mentions and AI visibility may both be downstream of simply being a well-known company.

Visibility You Can’t Deliver On Is a Different Problem

High visibility in AI answers doesn’t help if the experience underneath can’t sustain the expectation it creates. If AI referrals rise while conversion quality, retention, or sentiment stays flat or falls, investigate whether the description circulating about you is more generous, broader, or simply different from what customers encounter.

That may be a discovery issue. It may also be a positioning, product, onboarding, or expectation-setting issue that AI-mediated discovery is making visible faster.

Net Promoter Score, retention, support themes, and review language won’t explain why an AI answer appeared. They’ll tell you whether the attention it sends is becoming earned demand or amplified mismatch.

The Honest Version

You can build a defensible, dated, repeatable picture of how AI answers represent your company. It takes reading, a defined question set, and the discipline to keep the observations separate.

What you can’t build is a number that means something. And the number is the part everyone wants to buy.

What an Honest Baseline Looks Like

If you can’t buy a score, the alternative is a dated set of observations you can defend: specific questions, specific platforms, specific pages, run on a specific day.

That’s what an AI Search Visibility Assessment produces. 25 priority pages, 15 customer questions, two named platforms. No score, no ranking guarantee, and the limits are written into the deliverable.

Inspired? Take the next step that’s right for you.

Occasional mail

New notes, when there's one worth sending.

No schedule and no roundup filler. One email when a note is published. Unsubscribe from any message.

Name and email

Used only to send new notes. See the privacy page for how it's stored.