Skip to content
Good for Bots

Free AI crawler checker

Check if AI crawlers can read your site

See your site's crawler access and machine-readable content. Get a score out of 100, the findings behind it and fix prompts for your coding agent.

Free, no account. Our bot reads your robots.txt before anything else.

Real reports

How it works

Scan it, fix it, show it off

  1. 01

    Scan

    Type your address. GoodForBotsBot fetches what an AI crawler fetches: robots.txt, llms.txt, your sitemap and the raw HTML, in the open.

  2. 02

    Fix

    The fixes worth the most come with a prompt for Claude Code, Cursor or Codex, and Pro has one for every fix. Each states the standard and the result; your agent fits it to your stack.

  3. 03

    Show it

    Embed the live badge. Once a scan finds it on your site, your listing’s backlink turns dofollow, on the free plan.

Pro · monitoring

Your score changes when your site does.

A deploy can break robots.txt or remove llms.txt. A later scan can reveal the problem. Pro automatically rescans claimed listings every week, with 30 manual rescans per 30 days, at least 1 hour apart, keeps every scan on a public chart, and emails you when automatic scans detect a score drop or bot access change.

See what Pro adds

Score history

Illustrative example

Example measurements, using the same interactive history as a Pro report.

Selected measurement

55/100

UTC

SCORE / 1001 Aug 2026, 10:00: 45/1008 Aug 2026, 10:00: 55/10015 Aug 2026, 10:00: 55/10022 Aug 2026, 10:00: 50/10029 Aug 2026, 10:00: 55/1001 Aug29 Aug

Hover anywhere along the chart to inspect the nearest measurement. Click or tap to pin it; click it again or press Escape to release. Arrow keys move between scans.

  • Scored scan
  • Capability change

What changed

50/100 → 55/100+5 points

22 Aug 2026, 10:00 → 29 Aug 2026, 10:00 UTC

  • AI crawler rules

    +5 points

    Before

    fail · 0 points · v1

    robots.txt returned HTTP 404, so it names no AI crawler.

    Stored findings
    {
  "httpStatus": 404
}

    After

    pass · +5 points · v1

    robots.txt returned HTTP 200 with rules for six AI crawlers.

    Stored findings
    {
  "httpStatus": 200
}

Check contributions: +5 points. Rounding and score limits: 0 points.

Measurements and changes (5)
Published scan measurements, newest first. Dates are in UTC.
Date (UTC)ScoreChanges
55/100+5 points · 1 changed checks
50/100-5 points · 1 changed checks
55/1000 points · 1 changed checks

Agent capabilities changed

55/100+10 points · 1 changed checks
45/100First retained measurement

Pricing

The scan is free. Pro pays once.

Every plan gets the same score, point for point. You pay for the tools around the number, never for the number.

Full pricing and FAQ

Free

For every site, for good.

$0forever

Dofollow backlinkOnce a scan finds your badge

  • The full scan, and the same score on every plan
  • A public report page, kept for good
  • The live badge to embed
  • Automatic scans every month once claimed, plus 5 on-demand rescans per 30 days
  • Prompts for the 3 fixes worth the most
Check my score

Pro

For the owner who wants it fixed, and kept fixed.

$9once, per listing

Dofollow backlinkFrom your listing, badge or not

  • Everything in Free, and the same score
  • Automatic scans every week, plus 30 on-demand rescans per 30 days
  • An email when the score drops or bots lose access
  • Your score history on a public chart
  • A ready-made llms.txt and robots.txt, drafted for your site
  • Every fix, each with a prompt
  • Gold corners on your listing across the directory
Get Pro for $9

A dofollow backlink is one search engines count toward the site it points to; a nofollow link asks them not to.

The score is never for sale.

Pro adds monitoring and fix tools; Featured buys a home page slot. Payment never changes your score or hides a finding. Removing a listing is free on every plan.

The badge

Show your score. Earn a dofollow backlink.

The badge shows your latest published score. Add it to your homepage; once a scan detects its link, your Free listing earns a dofollow backlink. Image caches can delay score updates.

How the badge works
Illustrative Good for Bots badge
<a href="https://goodforbots.com/r/example.com"><img src="https://goodforbots.com/badge/example.com.svg" alt="Good for Bots score for example.com" width="200" height="54"></a>

Illustrative badge · your report has your own code

The directory

Fresh from the directory

Real sites, published findings, one rubric for everyone.

Explore the directory
  1. Raindance AI

    raindanceai.pro

  2. Growth Bounties

    growthbounties.com

  3. XONER4

    xoner4.github.io

  4. CheapHoster

    cheaphoster.net

  5. סלייט

    slate.co.il

  6. theviatlas.com

    theviatlas.com

See your site the way an AI crawler does.

Free, no account. Our bot reads your robots.txt before anything else.

FAQ

Frequently asked questions

Is the scan free?

Yes. The scan, the score, the public report and the live badge are free, with no account required. Manual rescans require a claimed listing and are limited by plan.

Does paying change my score?

No. Every plan gets the same score, point for point. Money buys tools and placement, never points, a better band or a hidden report.

Is Pro a subscription?

No. Pro is a one-time payment of $9 per listing. There is nothing to renew.

Will a good score get my site cited by ChatGPT?

A good score does not guarantee a citation. It reflects the access and content signals our crawler found. An assistant's choice of sources also depends on the question and the material it retrieves.

What does the scan check?

Two halves of 50 points. The readable base covers what a model needs to read the site: semantic HTML, working links, schema.org, a sitemap and robots.txt. The agent layer covers what the site offers language models on purpose: llms.txt, llms-full.txt, Markdown on request, AI crawler rules, content signals and link headers. Every check links the specification it is graded against. See how the score is calculated.

What is llms.txt?

A Markdown file at the root of a site that tells language models what the site is and links its most useful pages. It counts in the agent layer, next to llms-full.txt and Markdown versions. Our llms.txt check explains what we look for. How to write llms.txt includes an example and publishing instructions.

How often is my site rescanned?

Claimed Free sites are automatically rescanned every month; claimed Pro sites every week. Verified owners get 5 manual rescans per 30 days, at least 24 hours apart on Free, and 30 manual rescans per 30 days, at least 1 hour apart on Pro. Unclaimed listings are rescanned every 90 days. A finished manual scan resets the next automatic scan.

Does your bot respect robots.txt?

Always. GoodForBotsBot announces itself on every request and reads robots.txt first. If you block it, your report says opted out instead of showing a score. Read how to allow, slow down or stop our crawler.

Can I remove my site from the directory?

Yes, for free and without conditions, on any plan. Cancelling a subscription and removing a listing are separate, and neither costs anything.

What does Featured buy?

One of 3 slots at the top of this page and a dofollow backlink from it, for $20 a month. It buys no point of the score.

More questions about scans, the bot, claiming and removal? Read the full FAQ