# Good for Bots > A directory of websites evaluated for accessibility to language models and AI agents. Good for Bots reports a technical AI visibility score from 0 to 100. A score does not guarantee a citation. Payment never changes a score, and removing a listing is free and unconditional. The crawler respects robots.txt refusals without publishing a score. The links below lead directly to Markdown. Cite the canonical page URL identified in each document. Prices and scanner criteria are read from the live service; reports describe the rules and evidence recorded at scan time. For a published website, read `/r/{host}.md` or request `/r/{host}` with `Accept: text/markdown`. A report lookup does not start a scan. Reports include the findings and fixes available under the listing's current plan. Directory categories have Markdown at `/directory/category/{slug}.md`; search, filters, order and page parameters carry over. ## Public pages - [Home](https://goodforbots.com/index.html.md): Check a website, read an example report and explore recent directory entries. - [Directory](https://goodforbots.com/directory.md): Find published reports by host, category, platform and capability; search, filter, sort and page through results. - [Tools](https://goodforbots.com/tools.md): Free checkers for AI crawler access, llms.txt and robots.txt, with the guide behind each file. - [Standards and scoring](https://goodforbots.com/standards.md): Current checks, weights, score bands, source specifications and detection limits. - [Our bot](https://goodforbots.com/bot.md): Crawler identity, request limits, robots.txt controls and how to allow access. - [Public API](https://goodforbots.com/api.md): Read directory entries, taxonomy, plans and published reports; includes requests, response handling and OpenAPI discovery. - [Pricing](https://goodforbots.com/pricing.md): Free, Pro and Featured, with current database prices, included features and upgrade instructions. - [Badge](https://goodforbots.com/badge.md): Install a report's live badge, understand its score bands and verify the return link. - [FAQ](https://goodforbots.com/faq.md): Answers about scans, scores, rescans, claiming, removal, paid plans, refunds and privacy. - [About us](https://goodforbots.com/about.md): The project's purpose, scoring commitments, founder and operating business. ## Free tools - [llms.txt checker](https://goodforbots.com/tools/llms-txt-checker.md): Check your llms.txt for free: can AI crawlers fetch it, does it follow the llms.txt format, are its links described, and is there an llms-full.txt? - [robots.txt checker](https://goodforbots.com/tools/robots-txt-checker.md): See which AI crawlers your robots.txt allows or blocks, grouped as AI search, user fetches and training, and whether it states AI usage preferences. Free. ## Practical guides - [How to write a useful llms.txt](https://goodforbots.com/guides/llms-txt.md): Write an llms.txt that tells AI agents what your site covers: a complete tested example, the format explained, publishing checks and fixes for common mistakes. - [How to write robots.txt rules for AI crawlers](https://goodforbots.com/guides/robots-txt-ai-crawlers.md): Write robots.txt rules that treat AI training, search and user-triggered crawlers separately, with tested examples, the current token list and common fixes. - [How to serve content AI crawlers can read without JavaScript](https://goodforbots.com/guides/server-rendered-html.md): Which AI crawlers run JavaScript, how to fix empty app shells in Next.js, Nuxt, SvelteKit or Vite, and how to test the raw HTML response yourself. - [How to serve Markdown to AI agents with content negotiation](https://goodforbots.com/guides/markdown-negotiation.md): Return Markdown from the same URL when an AI agent sends Accept: text/markdown, with tested responses, Vary and CDN caching, and nginx and Next.js setups. ## Blog posts - [llms.txt adoption statistics: why the studies disagree](https://goodforbots.com/blog/llms-txt-adoption-statistics.md): Published llms.txt adoption figures run from under 0.005% to 57%. What each study counted, why they disagree, and which figure to quote for which sites. - [Which AI crawlers to block in robots.txt, and which to keep](https://goodforbots.com/blog/which-ai-crawlers-to-block.md): Blocking GPTBot or ClaudeBot refuses model training and leaves AI search alone. Blocking OAI-SearchBot or Claude-User keeps you out of their answers. ## Optional - [Full documentation bundle](https://goodforbots.com/llms-full.txt): Full text of product documentation, policies, published guides and blog posts in one response; excludes individual website reports and directory listings. - [Blog index](https://goodforbots.com/blog.md): Published articles about web standards for crawlers and agents, with dates and categories. - [Guides index](https://goodforbots.com/guides.md): Every practical guide with its category, review date and search description; a category query narrows the list. - [Featured placements](https://goodforbots.com/featured.md): Current promoted websites, price, availability and booking; payment does not affect scores. - [Remove my listing](https://goodforbots.com/remove.md): Request free removal without an account or a reason; an administrator reviews requests. - [Contact](https://goodforbots.com/contact.md): Support for reports, listings, bugs, billing and feedback. - [Terms of service](https://goodforbots.com/terms.md): Rules for scans, reports, accounts, badges, paid plans, refunds and complaints. - [Privacy policy](https://goodforbots.com/privacy.md): Personal data, cookies, providers, retention and privacy rights.