augenmerk Documentation / How we measure

1 · Documentation

How we measure

What augenmerk measures, how a run works and what we do not claim.

augenmerk measures whether and how a brand appears in the answers of AI systems: ChatGPT, Claude, Gemini, Grok, Perplexity and Google's answer box. Every number in the application comes from stored answers, and every statement about a brand is backed by the exact passage in the original answer. This documentation explains how.

What we measure

How a run works

A run is one complete measurement of a project. It has six steps, in this order.

  1. The sentence before every question. Every question gets the same preceding sentence, which sets the role the AI answers from, with the project's region and language. It influences which brands are named at all and therefore stays the same across all runs. Its wording is shown in the application under "How we measure".
  2. The questions. Every active question is asked once in every channel. Which questions count towards presence and which do not is explained under Questions.
  3. The channels. Ten systems, in three channel types: model knowledge, live search, answer box. Every answer is stored in full, with model, channel, timestamp, source list and, where the system reveals them, the search queries it ran.
  4. The judge. A second model reads from every answer which brands are named, where, with what verdict and with what source. The judge does not form opinions; it extracts passages.
  5. The evidence check. Every passage is checked character by character against the stored answer. Whatever is not found there is discarded, not softened.
  6. The evaluation. From the verified mentions come presence, position, source picture, topics and findings. Each run also adds the domain check of your own website.

The raw answer is stored before it is judged and never changed. It cannot be repeated: the same question gives a different answer tomorrow. Better rules or a new competitor can therefore be applied retroactively to all stored answers without a new measurement.

Runs and movement

A single measurement is a sample. The same question gets two different answers on two days, and a brand can swing by ten or twenty percentage points between runs without anything having changed. augenmerk therefore states a noise band for every project and reports a movement only when it exceeds it. How it is calculated is explained under Noise band and runs.

What we do not claim

What Google itself says

In May 2026 Google published a guide to optimising for generative AI features. It states what is not needed for Google's own AI features: no AI files such as llms.txt, no splitting pages into small pieces, no rewriting for AI, no special markup. What counts is the usual: indexable, useful content, technical basics, genuine rather than manufactured mentions. augenmerk recommends none of what Google declares unnecessary, and measures precisely what Google leaves open: what the other systems say.

Since June 2026 Search Console also offers a report on impressions in AI Overviews and AI Mode, per page. It is the only figure on AI visibility that comes from an AI provider itself, and it applies to Google only. Google does not yet make this report available to tools like augenmerk (as of September 2026); the other Search Console data — impressions, clicks, queries per page — we already read once you connect your property. As soon as Google releases AI impressions, they will sit next to our measurement in the gap view.

Where the data lives

augenmerk is developed and operated in Hamburg. The data lives in Frankfurt. The AI systems themselves are queried through their providers' interfaces; the questions go there, not the customers' data.

Updated: 2026-09-16