Skip to content
Good for Bots

Good for Bots

goodforbots.com

Evaluates website readability for AI crawlers and language models with a scoring rubric

Click badge to copy

Changed your site? Run a new scan.

Claim to rescan

Claiming is free. Verify ownership to request a rescan after deploying your changes.

Unclaimed listings are checked automatically every 90 days.

Good for Bots report

Good for Bots scores 100 of 100: the whole readable base, the whole agent layer, no penalties.

Earned

The whole readable base above the line, the whole agent layer below it.

100
Penalties0
How scoring works · current methodology →

Through a bot’s eyes

“Good for Bots is an evaluation service and public directory that tests websites for AI crawler readability and provides a score out of 100 along with fix recommendations.”

Simulated from the response GoodForBotsBot received on , not a live answer from any AI assistant.

What it can read, and what stays hidden →

What a bot can read

A language model reading the provided text learns that Good for Bots evaluates websites for AI crawler accessibility and assigns a score out of 100. The text details the specific features of the free plan, a Pro plan priced at nine dollars per listing, and a Featured homepage slot priced at twenty dollars a month. It provides extensive information on what the scanner checks, including robots.txt, llms.txt, sitemaps, and server-rendered HTML. The provided llms.txt content lists specific documentation links, tools, guides, and blog posts available on the site, while the JSON-LD blocks and Markdown twin mirror the homepage content and structured pricing offerings.

What is Good for Bots?

Good for Bots is a website evaluation service and public directory that measures how accessible and readable websites are to AI crawlers and language models. txt, sitemaps, and raw HTML content.

Read more →

The platform is designed for website owners and developers who want to test, monitor, and improve their site architecture for AI agents. It offers a free tier with basic scans, a Pro tier for weekly monitoring and fix prompts, and paid homepage placement slots.

3 prompts, 0 points

For Claude Code, Cursor or Codex. The score moves after the next scan.

+1 capabilitybadge capabilities from 1 to 2

Publish an auth.md for agents

No /auth.md published.

Read prompt

+1 capabilitybadge capabilities from 2 to 3

List an MCP server card in the AI Catalog

No AI Catalog published, so no MCP server card can be discovered.

Read prompt

+1 capabilitybadge capabilities from 3 to 4

Publish an A2A Agent Card

No A2A Agent Card at /.well-known/agent-card.json, and none listed in an AI Catalog.

Read prompt

Pro

6 more prompts in Pro

Pro shows a prompt for every fix and drafts your llms.txt and robots.txt. It never changes the score.

$9 once, per listingSee Pro

Deployed your fixes? Rescan to update your score →

Select a check to see what we found and how it is graded.

Readable base

50 / 50

Passes.

30 of 30 points.

/llms.txt is well formed: 25 links across 5 sections.

Passes.

10 of 10 points.

robots.txt is valid, with 1 user-agent group.

Passes.

10 of 10 points.

Sitemap declared in robots.txt, listing 24 URLs.

Agent layer

50 / 50

Passes.

4.4 of 4.4 points.

/llms.txt is descriptive: a summary plus descriptions on 100% of links.

Passes.

4.4 of 4.4 points.

/llms-full.txt serves the site's content as markdown (at least 64 KB).

Passes.

5.9 of 5.9 points.

All 4 pages read pass. The homepage serves markdown on `Accept: text/markdown`.

Passes.

5.9 of 5.9 points.

States a position on 6 AI crawlers, across 2 purposes (search, user-fetch).

Passes.

4.4 of 4.4 points.

Declares AI usage preferences via Content-Signal (robots.txt): ai-input, search.

Passes.

5.9 of 5.9 points.

All 4 pages read pass. The homepage describes itself to machines as WebPage, Service, Offer in valid schema.org JSON-LD.

Passes.

3.7 of 3.7 points.

All 4 pages read pass. The homepage marks its content root, its heading outline and its landmarks.

Passes.

4.4 of 4.4 points.

54 of 54 assessed homepage navigation links expose usable destinations.

Passes.

2.9 of 2.9 points.

99 of 99 assessed homepage links and buttons have a nonempty accessible name.

Passes.

2.9 of 2.9 points.

2 of 2 assessed homepage form fields meet the static naming and field-semantics checks.

Passes.

2.9 of 2.9 points.

125 of 125 assessed homepage controls and role declarations meet the static role, state and relationship checks.

Penalties

− 0

Passes.

Penalty: 0 of 15 points.

Our crawler reaches the page without being challenged.

Passes.

Penalty: 0 of 20 points.

Nothing on the homepage tells a crawler to skip it or to withhold its snippet.

Passes.

Penalty: 0 of 25 points.

The captured homepage HTML contains 1348 content words; completeness is not assessed.

Passes.

Penalty: 0 of 25 points.

robots.txt allows every known search and user-fetch crawler to reach the homepage.

Passes.

Penalty: 0 of 10 points.

The homepage is served over HTTPS and returns HTTP 200.

Passes.

Penalty: 0 of 3 points.

The homepage provides both a non-empty title and meta description.

Passes.

Penalty: 0 of 3 points.

The homepage is reached in 0 redirects.

Passes.

Penalty: 0 of 3 points.

The homepage reached a plain crawler in 266 ms.

Agent capabilities

1 of 10 · no points

Each one found adds +1 to the badge.

Passes.

+1 on the badge.

Publishes an API catalog describing 1 API.

Not applicable.

Adds +1 to the badge when found.

No /auth.md published.

Not applicable.

Adds +1 to the badge when found.

No AI Catalog published, so no MCP server card can be discovered.

Not applicable.

Adds +1 to the badge when found.

No A2A Agent Card at /.well-known/agent-card.json, and none listed in an AI Catalog.

Not applicable.

Adds +1 to the badge when found.

No usable Agent Skills index was found at either well-known path or in the AI Catalog.

Not applicable.

Adds +1 to the badge when found.

No WebMCP declarations were found in the collected HTML or inline scripts. External scripts were not inspected.

Not applicable.

Adds +1 to the badge when found.

No Web Bot Auth key directory at /.well-known/http-message-signatures-directory.

Not applicable.

Adds +1 to the badge when found.

No HTTP 402 payment challenge on the homepage or robots.txt, and no manifest at /.well-known/x402.

Not applicable.

Adds +1 to the badge when found.

No ACP discovery declaration established at /.well-known/acp.json.

Not applicable.

Adds +1 to the badge when found.

No UCP discovery declaration established at /.well-known/ucp.

Access & usage policy

Who can read this page, and for what purpose?

GoodForBotsBot received HTTP 200 via a direct request. No indexing restriction was observed in the supported homepage directives.

Sampled URL: https://goodforbots.com/

Declared crawling rules

No matching refusal for this URL was found for the listed identities.

Sources and scope: declared crawling rules
  • Declared allow · Scan admission

    • GoodForBotsBot/1.0 (+https://goodforbots.com/bot)

    The recorded robots admission decision allowed our crawler to proceed.

    GoodForBotsBot admission along the homepage request chain

    https://goodforbots.com/

    robots.txt is present and valid

  • Declared allow · robots.txt

    • goodforbotsbot (Site diagnostics)
    • * (Default robots group)
    • oai-searchbot (ai-search)
    • claude-searchbot (ai-search)
    • perplexitybot (ai-search)
    • mistralai-index (ai-search)
    • kimi-searchbot (ai-search)
    • amzn-searchbot (ai-search)
    • meta-webindexer (ai-search)
    • exasearchbot (ai-search)
    • aiwebindex (ai-search)
    • duckassistbot (ai-search)
    • shapbot (ai-search)
    • yandexadditional (ai-search)
    • yandexadditionalbot (ai-search)
    • gptbot (ai-training)
    • claudebot (ai-training)
    • mistralai-training (ai-training)
    • kimibot (ai-training)
    • ai2bot (Unknown)
    • applebot-extended (ai-training)
    • webzio-extended (ai-training)
    • chatgpt-user (user-fetch)
    • claude-user (user-fetch)
    • perplexity-user (user-fetch)
    • mistralai-user (user-fetch)
    • kimi-user (user-fetch)
    • amzn-user (user-fetch)
    • diffbot-user (user-fetch)
    • firecrawlagent (extraction)
    • webzio (extraction)
    • meta-externalfetcher (user-fetch, agent)
    • google-extended (ai-training, grounding)
    • meta-externalagent (ai-training, product-improvement)
    • amazonbot (ai-training, product-improvement)
    • ccbot (open-dataset, ai-training)
    • googlebot (search)
    • bingbot (search)

    No matching refusal for this URL in the applicable robots group. This is a declaration, not an access test.

    Acquisition of https://goodforbots.com/

    https://goodforbots.com/robots.txt

    User-agent: *
    User-agent: oai-searchbot
    User-agent: chatgpt-user
    User-agent: claude-searchbot
    User-agent: claude-user
    User-agent: perplexitybot
    User-agent: perplexity-user
    allow: /

    robots.txt is present and validStates a position on AI crawlersAllows search and user-fetch crawlers

Observed access

GoodForBotsBot received HTTP 200 via a direct request.

Sources and scope: observed access
Coverage and interpretation
  • Crawler coverage includes the registered identities and up to 50 user-agent entries from robots.txt. Source excerpts and detail groups are bounded; omissions are labelled.
  • Observed access describes GoodForBotsBot only. Other crawler entries describe declared rules, not tests of those operators' access.
  • Coverage is the sampled homepage response and collected robots.txt files. No indexing or citation is guaranteed. Usage preferences are declarations, not a legal determination of permission.
  • This explanation adds no points or penalties. Any score effects belong to the linked checks.
  • AIPREF and Content Signals keep their own definitions. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process.

In its category

1st of 24 in Developer Tools & APIs

Whole category →
  1. 1Good for Bots · this reportgoodforbots.com
  2. 2Chrome Goldminechromegoldmine.com
  3. 3Modeinspectmodeinspect.com

Category average 56. The percentile appears once the catalogue holds a few hundred sites.

Scanned

Site profile

Login
Detected
A sign-in or sign-up link
API
Detected
An API catalog
Commerce
Not established

It decides which conditional checks apply. “Not established” means no proof in what we read, not proof of absence.

Scan details

Every scan is kept. Pro draws the history as a chart →

Scanned
30 Sept 2026
Rubric
0.7.0
Requests
25
Fetched
1.1 MB
Took
16.3 s
Homepage
266 ms · direct
Pages read
4
robots.txt
allowed
Which pages the scan read

The homepage and up to three pages from the sitemap and homepage links. Structured data, page structure, Markdown negotiation and typed links check each page read and take the median page; other checks read the homepage.

  • Homepagealways read
  • /guides/llms-txtarticle · linked from the homepage · from the sitemap · read
  • /pricingpricing · linked from the homepage · from the sitemap · read
  • /blogcollection · linked from the homepage · from the sitemap · read

More like Good for Bots:Developer Tools & APIsAI & Machine LearningWeb DevelopmentFreemium

Same category

modeinspect.com

AI design tool that runs in your codebase for canvas and code workflows

Same category

chromegoldmine.com

Database of expired Chrome extensions with proven demand and rebuild plans

Same category

notifysound.com

Free customizable notification sounds with an AI editor and MCP server integration

Same category

Free browser-local theme builder and exporter for the Codex Desktop app

Same category

emailyy.online

Free browser-based email tools for signatures, subject lines, HTML previews, and header analysis

Same category

imagetostl.online

Turn PNG and JPG images into 3D printable STL files in your browser