1. Home
  2. Product
  3. Website intelligence

See whether AI can use your site.

XORV reads your robots.txt, your llms.txt, your sitemap and your pages, files each page it reads, and shows which of your pages the answers already cite — with no model involved anywhere in the check.

dunelight.coffeechecked Oct 26
Not ready9 of 40of the pages in your check’s scope
  • Missing somethingA title, description, main heading, structured data, language or 150 words7
  • Can’t be openedNo answer, an error, noindex, or refused to search crawlers2
  • ReadyRead, with nothing missing7
  • Never asked forIn scope, not read in this check24

5 of 12 buyer questions have no ready page of yours.

Example

The questions it answers

  • Can AI crawlers read our site?

    For nine AI crawlers, XORV reads your robots.txt rule for the home page and shows each one as allowed or refused, with what it feeds.

  • What are our pages missing?

    Each page XORV reads is filed as ready, missing something or can’t be opened — and missing something names what: a title, a description, a main heading, structured data, a declared language or at least 150 words of text.

  • Which of our pages do answers cite?

    Each page shows the buyer questions whose answers cite it, and the questions that miss you with no ready page of yours behind them.

  • What does XORV read on each page?

    Its status, whether it asks not to be indexed, its title and description, its main heading, its structured data, its declared language and language versions, its canonical address and how much text it holds.

  • When is a page counted as can’t be opened?

    When it gives no answer or an error, asks not to be indexed, or your robots.txt refuses OAI-SearchBot, PerplexityBot or Bingbot on it. Refusing only the crawlers that train models does not close a page.

  • How does XORV read our site?

    As a visitor under its own name, XORV-reader: public addresses only, no cookies, at most three redirects, five seconds and 600 KB per address — and it never runs your scripts.

What you see

One check of your public site, taken when you ask for it.

  • Crawler access

    GPTBot, OAI-SearchBot and ChatGPT-User, ClaudeBot and Claude-SearchBot, PerplexityBot, Google-Extended, Bingbot and CCBot — each with its operator, what it feeds, and your rule for it.

    The verdict comes from robots.txt alone. A firewall or CDN rule is not seen, so XORV never says a crawler actually reached you.

    What an AI crawler is
    AI crawlers your robots.txt refuses: 1 of 9
    • GPTBotOpenAI · trainingAllowed
    • OAI-SearchBotOpenAI · search indexAllowed
    • ChatGPT-UserOpenAI · fetching for a userAllowed
    • ClaudeBotAnthropic · trainingRefused
    • PerplexityBotPerplexity · search indexAllowed
    • Google-ExtendedGemini · trainingAllowed

    Read from robots.txt for your home page. A firewall or CDN rule is not seen.

    Example
  • robots.txt, llms.txt and sitemap

    Whether each file is there, and how many pages your sitemap lists, read at /sitemap.xml — a sitemap index is followed one level down.

    llms.txt is checked for presence only. XORV does not claim that engines read it.

    What llms.txt is
    Files for engines
    • robots.txtRead for every crawlerFound
    • llms.txtChecked for presence onlyNot found
    • sitemap.xmlLists 38 pagesFound

    The sitemap is read at /sitemap.xml.

    Example
  • Every page, filed

    XORV reads up to sixteen pages — your home page first, then its main sections — and files each as ready, missing something or can’t be opened.

    The rest of the up to eighty addresses in scope are filed as never asked for: nothing is known about them either way. Each check is kept with the time it ran, and the page says when the next one may run.

    What answer engine optimisation is
    Every page, filed
    • /wholesaleMarked noindexCan’t be opened
    • /brew-guides/v60Meta description · Structured dataMissing something
    • /shopStructured dataMissing something
    • /deliveryNothing missingReady
    • /blog/origin-notesNot read in this checkNever asked for
    Example
  • The pages behind the answers

    A page carries a buyer question when a valid answer cites it. Questions that miss you with no ready page of yours are listed apart.

    Both measurements are shown together, and neither is stated as the cause of the other. Only pages inside the check’s scope can carry a question.

    What a citation is
    The pages behind the answers
    • /deliveryCited in 2 answersReady
    • /shopCited in 1 answerMissing something
    • /brew-guidesCited in 1 answerMissing something
    • Specialty coffee subscription in Saudi ArabiaNo answer cited a page of yoursNo page ready

    Neither measurement is stated as the cause of the other.

    Example
Hands work at a keyboard and trackpad beside an open notebook.
What a crawler gets from your site is plain HTML. The site check reads exactly that, and nothing a script would add.Photo: Jakub Żerdzicki, Unsplash

How a check is taken

  1. Public pages only

    XORV reads raw HTML under its own name, without cookies, and never runs your scripts. It makes only read requests and changes nothing.

  2. Home first, then the sections

    The home page, its main sections, then your sitemap’s order, within a scope of up to eighty addresses.

  3. On request, with no model

    A check runs when you ask for it, at most once every ten minutes per brand, and every verdict comes from written rules — even a page’s kind, such as pricing or product, is read from its address alone.

Questions people ask

How often is the site checked?

When you ask for it, at most once every ten minutes. Nothing runs it on a schedule.

Does XORV run my site’s JavaScript?

No. It reads the raw HTML, as a crawler that runs no scripts would.

Does it measure page speed?

Yes, for your home page: Google’s PageSpeed lab test and Chrome’s field data, read daily once an administrator turns them on.

Does the check change anything on my site?

No. It only reads. Any change to your site goes through XORV Build’s approvals.

Why is a page “never asked for”?

It is in the check’s scope but was not read this time. Nothing is known about it either way, so it is not counted as ready or as not ready.

Find out if AI recommends you.

Start with your website. Check what XORV understood, then get a first reading with clear context — instead of a guess.

Free first reading: 10 buyer questions on ChatGPT. On paid plans, XORV Build (beta) drafts the fix.Free first reading, with what to fix first.