Global Fact Hub

example.com

Independent domain snapshot · generated 2026-11-08 01:15 UTC · Reused from the 30-day snapshot

Data sources:
Crawl audit + Core Web Vitals (measured)Plain HTTP audit (robots.txt, llms.txt, Markdown negotiation, .well-known)DataForSEO Labs bulk traffic estimation (third-party estimate)DataForSEO Labs ranked_keywords (third-party estimate)DataForSEO Backlinks summary (third-party estimate)Public RDAP registry data

Health score91 / 100Measured on this snapshot (crawl + Core Web Vitals)
Monthly visits10,768Estimated organic visits per month (DataForSEO Labs) — third-party estimate, not analytics data
Domain age31.2 yearsFrom the registry creation date (RDAP)

Site healthMeasured

Crawlability93
Technical SEO73
Structured data95
Performance Field data100
Content93

AI Agent readinessScore 57 / 100

Measured with plain HTTP requests only: no browser, no JavaScript, no LLM. Checks cover robots.txt AI groups, llms.txt, Markdown negotiation, ai-catalog.json, the standard .well-known documents, soft 404s and server-rendered content.

Model trainingGPTBot: no ruleClaudeBot: no ruleGoogle-Extended: no ruleApplebot-Extended: no rule
AI search & citationOAI-SearchBot: no ruleClaude-SearchBot: no rulePerplexityBot: no rule
User-triggered fetchesChatGPT-User: no ruleClaude-User: no rulePerplexity-User: no rule
P0 · WARN

Primary content is present without JavaScript

Words in the raw HTML: 27.

Server-render or pre-render the main content: several agent fetchers do not run JavaScript, so a client-side shell reads as an empty page.

P0 · WARN

robots.txt is reachable

robots.txt returned HTTP 404.

No robots.txt means everything is allowed, but no AI-usage preference is declared. Publish one deliberately.

P1 · WARN

Deliberate robots.txt policy for AI agents

Explicit groups: none.

Every AI agent falls through to the '*' group. Add named groups when your policy differs by purpose (training vs search vs user fetches).

P1 · WARN

llms.txt exists and follows the Lighthouse rules

HTTP 404 (text/html; charset=utf-8), 577 bytes.

No /llms.txt. Publish one with an H1, a '>' summary and Markdown links so agents get a compact map of the site.

P1 · WARN

Markdown version available on request

Content-Type: text/html; charset=utf-8. Vary: Accept not set.

Optional: serve a Markdown version via 'Accept: text/markdown' (with 'Vary: Accept'), a rel=alternate type=text/markdown link, or a .md URL.

P1 · OK

Unknown URLs return a real 404

Probe returned HTTP 404.

P1 · SKIP

ai-catalog.json is discoverable and valid

Skipped: no catalog is advertised.

P2 · SKIP

Content-Signal preference declared

Skipped: no Content-Signal line.

P2 · SKIP

Agentmap directive present

Skipped: no Agentmap line.

P2 · SKIP

Standard .well-known discovery documents

Skipped: no discovery document is published.

Score: weighted share of the checks that could be measured (p0 = 3, p1 = 2, p2 = 1; a warning counts half; skipped checks are excluded).

Fix kit

Copy the text or download the file, then upload it to your own site. Auto-publish only works for sites hosted under our domain; for all other sites, download the files and upload them yourself.

llms.txt

Upload to the site root so it is served at https://example.com/llms.txt. It is plain text: no build step and no server change are required.

# example.com

> Public site summary for example.com, generated from an independent snapshot on 2026-11-15.

This file lists the pages an AI agent can read and states how the content may be used. Every link below points at the live site; nothing here replaces the site.

## Key pages
- [Home page](https://example.com/)

## Use of this content by AI systems

AI systems may read these pages and cite example.com with attribution. Model-training use is governed by the site's robots.txt, which states the policy per crawler category (model training / AI search and citation / user-triggered fetches).

## Notes

- Generated by Global Fact Hub (https://globalfacthub.com) on 2026-11-15.
- Keep this file in the site root so it is served at https://example.com/llms.txt.

Download llms.txt

ai-catalog.json

Upload to https://example.com/.well-known/ai-catalog.json and reference it from a <link rel="ai-catalog" href="/.well-known/ai-catalog.json"> tag or an Agentmap line in robots.txt. The entry's url stays the canonical customer address https://example.com/llms.txt even though we only host a sample copy under https://globalfacthub.com/domain/example.com/. ARD is designed for agent resources (MCP servers, A2A agents); replace this site-summary entry when you publish one.

{
  "specVersion": "1.0",
  "entries": [
    {
      "identifier": "urn:air:example.com:llms-txt",
      "displayName": "example.com site summary",
      "title": "example.com site summary (llms.txt)",
      "description": "Public site summary for example.com: key pages, an AI usage statement and the crawler policy that applies to them. Generated from an independent snapshot on 2026-11-15.",
      "type": "text/markdown",
      "url": "https://example.com/llms.txt",
      "representativeQueries": [
        "example",
        "explam",
        "can you show me an example"
      ]
    }
  ]
}

Download ai-catalog.json

robots-ai-block.txt

Append these lines to the existing robots.txt and keep every existing line. Do not replace the file: the block only adds rules and states a default policy you can edit per category.

# ---- AI agent policy (appended by Global Fact Hub on 2026-11-15) ----
# Append this block to the end of the robots.txt of example.com.
# No existing rule is removed or rewritten: this block only adds rules below yours.
# RFC 9309: a crawler that matches a named group reads only that group, so each
# category below repeats its own policy.

# 1) Model-training crawlers. Change 'Allow: /' to 'Disallow: /' to opt out of training.
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
Allow: /

# 2) AI search and citation crawlers. Keep these allowed so AI answers can cite the site.
User-agent: OAI-SearchBot
User-agent: Claude-SearchBot
User-agent: PerplexityBot
Allow: /

# 3) User-triggered fetches: a person asked an assistant to open a page.
User-agent: ChatGPT-User
User-agent: Claude-User
User-agent: Perplexity-User
Allow: /

# ---- end of appended AI agent policy ----

Download robots-ai-block.txt

After an owner auto-publish (signed in), the same files are also served from https://globalfacthub.com/domain/example.com/llms.txt and https://globalfacthub.com/domain/example.com/.well-known/ai-catalog.json. We only write to the sample directory we host (globalfacthub.com/domain/example.com/); we never report a third-party site as updated.

Top issuesP0 / P1

P1

Thin content on the page

https://example.com/

Expand the page to at least 300 words of specific, useful copy.

P1

No XML sitemap found

https://example.com/

Publish a sitemap and reference it from robots.txt so new pages get discovered.

P1

No structured data (JSON-LD)

https://example.com/

Add JSON-LD for Organization plus the page type (Product, Article, FAQPage and so on).

P1

Missing canonical link

https://example.com/

Add a rel=canonical link pointing at the preferred URL of each page.

P1

Missing H1 heading

https://example.com/

Add exactly one H1 that states what the page is about.

Traffic estimateThird-party estimate

~10,768estimated organic visits / month

Source: DataForSEO Labs · bulk_traffic_estimation, market United States / English. This is a third-party estimate: it models organic search visibility (ETV) and is not measured analytics traffic. It can differ from your own analytics or Search Console numbers. Ranked keywords in the estimate: 470. Estimated paid visits: 0.

Top organic keywordsThird-party estimate

KeywordRankMonthly volume
example2368,000
explam18201,000
can you show me an example149,900
what is example49,900
what is example of29,900
example org website15,400
google.ru425,400
example domain13,600
example.com12,900
example 371,900

Source: DataForSEO Labs · ranked_keywords, market United States / English. Rank and monthly search volume are modelled by the provider, not measured analytics. Showing up to 10 keywords.

Backlink profileThird-party estimate

Referring domains476,372
Backlinks117,214,544
DataForSEO rank709

Source: DataForSEO Backlinks · summary. Third-party index data, not your own analytics. Rank is the provider's 0-1000 authority score.

Registration dataRegistry data

RegistrarRESERVED-Internet Assigned Numbers Authority
Created1995-08-14
Expires2027-08-13
Domain age31.2 years
Nameservers
  • elliott.ns.cloudflare.com
  • hera.ns.cloudflare.com

Source: RDAP (public registry data).

Next step

The free audit tool shows the health score, all five dimension scores and the P0/P1 issues to fix first. No signup required.

Data sources and status

Site healthCrawl audit + Core Web Vitals (measured)
Measured
AI agent readinessPlain HTTP audit (robots.txt, llms.txt, Markdown negotiation, .well-known)
Measured
Traffic estimateDataForSEO Labs bulk traffic estimation (third-party estimate)
Third-party estimate
Top keywordsDataForSEO Labs ranked_keywords (third-party estimate)
Third-party estimate
BacklinksDataForSEO Backlinks summary (third-party estimate)
Third-party estimate
Registration (WHOIS)Public RDAP registry data
Registry data

Scores and estimates in this report come from the sources listed above, measured when this snapshot was generated. Keyword, traffic and backlink figures are third-party estimates and may differ from your own analytics. Missing measurements are shown as no data, never as zero. Snapshot cached for 30 days.