# Good for Bots report: pasteguard\-exp2\.netlify\.app Website: https://pasteguard\-exp2\.netlify\.app Report: https://goodforbots.com/r/pasteguard-exp2.netlify.app Scan: cmusm327v02ug01o0sbsfxln0 Scanned at: 2026-10-03T16:34:02.681Z Status: completed Rubric: 0\.9\.0 Score: 23/100 (Poor) Name: PasteGuard ## Access & usage policy GoodForBotsBot received HTTP 200 via a direct request\. No indexing restriction was observed in the supported homepage directives\. Sampled URL: https://pasteguard\-exp2\.netlify\.app/ Crawler identities: - goodforbotsbot: Good for Bots, Site diagnostics. - \*: Unspecified, Default robots group. - oai\-searchbot: OpenAI, ai\-search. - claude\-searchbot: Anthropic, ai\-search. - perplexitybot: Perplexity, ai\-search. - mistralai\-index: Mistral, ai\-search. - kimi\-searchbot: Moonshot AI, ai\-search. - amzn\-searchbot: Amazon, ai\-search. - meta\-webindexer: Meta, ai\-search. - exasearchbot: Exa, ai\-search. - aiwebindex: Lyrenth, ai\-search. - duckassistbot: DuckDuckGo, ai\-search. - shapbot: Parallel, ai\-search. - yandexadditional: Yandex, ai\-search. - yandexadditionalbot: Yandex, ai\-search. - gptbot: OpenAI, ai\-training. - claudebot: Anthropic, ai\-training. - mistralai\-training: Mistral, ai\-training. - kimibot: Moonshot AI, ai\-training. - ai2bot: Unspecified, Unknown. - applebot\-extended: Apple, ai\-training. - webzio\-extended: Webz\.io, ai\-training. - chatgpt\-user: OpenAI, user\-fetch. - claude\-user: Anthropic, user\-fetch. - perplexity\-user: Perplexity, user\-fetch. - mistralai\-user: Mistral, user\-fetch. - kimi\-user: Moonshot AI, user\-fetch. - amzn\-user: Amazon, user\-fetch. - diffbot\-user: Diffbot, user\-fetch. - firecrawlagent: Firecrawl, extraction. - webzio: Webz\.io, extraction. - meta\-externalfetcher: Meta, user\-fetch, agent. - google\-extended: Google, ai\-training, grounding. - meta\-externalagent: Meta, ai\-training, product\-improvement. - amazonbot: Amazon, ai\-training, product\-improvement. - ccbot: Common Crawl, open\-dataset, ai\-training. - googlebot: Google, search. - bingbot: Microsoft, search. ### Declared crawling rules Other crawlers' declared access could not be established\. - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): The recorded robots admission decision allowed our crawler to proceed\. Source: Scan admission; URL: https://pasteguard\-exp2\.netlify\.app/; scope: GoodForBotsBot admission along the homepage request chain; state: allowed. [Related check: robots\-txt](https://goodforbots.com/standards?rubric=0.9.0#robots-txt) - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: A complete, successful robots\.txt was not available for this origin; no other crawler's rules are inferred\. Source: robots\.txt; URL: https://pasteguard\-exp2\.netlify\.app/robots\.txt; scope: Acquisition of https://pasteguard\-exp2\.netlify\.app/; state: unknown. [Related check: robots\-txt](https://goodforbots.com/standards?rubric=0.9.0#robots-txt) [Related check: ai\-crawler\-rules](https://goodforbots.com/standards?rubric=0.9.0#ai-crawler-rules) [Related check: ai\-crawler\-access](https://goodforbots.com/standards?rubric=0.9.0#ai-crawler-access) ### Observed access GoodForBotsBot received HTTP 200 via a direct request\. - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): Our request received HTTP 200\. A status alone does not identify a WAF\. Source: Direct request; URL: https://pasteguard\-exp2\.netlify\.app; scope: Our recorded direct transport attempt; intermediate attempt URLs are not retained; state: observed. ```text HTTP 200 ``` [Related check: homepage\-availability](https://goodforbots.com/standards?rubric=0.9.0#homepage-availability) - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): GoodForBotsBot received HTTP 200 via a direct request\. Source: Final homepage response; URL: https://pasteguard\-exp2\.netlify\.app/; scope: homepage response; state: observed. ```text HTTP 200 Transport: direct ``` [Related check: homepage\-availability](https://goodforbots.com/standards?rubric=0.9.0#homepage-availability) [Related check: waf\-challenge](https://goodforbots.com/standards?rubric=0.9.0#waf-challenge) ### Indexing directives No indexing restriction was observed in the supported homepage directives\. - Scope unresolved: No indexing restriction was observed in the supported homepage directives\. Source: Homepage directives; URL: https://pasteguard\-exp2\.netlify\.app/; scope: homepage response; state: not-observed. [Related check: indexing\-blocks](https://goodforbots.com/standards?rubric=0.9.0#indexing-blocks) ### Search snippets No snippet restriction was observed in the supported homepage directives\. - Scope unresolved: No snippet restriction was observed in the supported homepage directives\. Source: Homepage directives; URL: https://pasteguard\-exp2\.netlify\.app/; scope: homepage response; state: not-observed. [Related check: indexing\-blocks](https://goodforbots.com/standards?rubric=0.9.0#indexing-blocks) ### Search usage The available evidence does not establish a preference for this use\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://pasteguard\-exp2\.netlify\.app/; scope: Purpose: search; applicable robots group/path and this response's header; state: unknown. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) ### AI input and use The available evidence does not establish a preference for this use\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://pasteguard\-exp2\.netlify\.app/; scope: Purpose: ai\-use; applicable robots group/path and this response's header; state: unknown. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) ### AI training The available evidence does not establish a preference for this use\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://pasteguard\-exp2\.netlify\.app/; scope: Purpose: train\-ai; applicable robots group/path and this response's header; state: unknown. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) - Crawler coverage includes the registered identities and up to 50 user\-agent entries from robots\.txt\. Source excerpts and detail groups are bounded; omissions are labelled\. - Observed access describes GoodForBotsBot only\. Other crawler entries describe declared rules, not tests of those operators' access\. - Coverage is the sampled homepage response and collected robots\.txt files\. No indexing or citation is guaranteed\. Usage preferences are declarations, not a legal determination of permission\. - This explanation adds no points or penalties\. Any score effects belong to the linked checks\. - AIPREF and Content Signals keep their own definitions\. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process\. Client\-side secret and PII scanner for text before pasting into AI chatbots ## About this site PasteGuard is a client\-side text scanning tool designed to detect API keys, bearer tokens, private keys, and common personally identifiable information before users paste text into artificial intelligence chat interfaces\. It is built for individuals who use AI chatbots and want to prevent the accidental leakage of sensitive data\. The application runs entirely within the user's web browser, ensuring that all scanning happens locally without uploading text or collecting analytics\. It offers features such as live scanning as you type, sample text testing, copy redaction, and offline functionality once loaded\. ## Through a bot's eyes Written from the response GoodForBotsBot received in scan cmusm327v02ug01o0sbsfxln0 (2026-10-03T16:34:02.681Z), before any JavaScript ran. ### What a bot can read A language model reading the provided homepage and llms\.txt files learns that PasteGuard is a free, in\-browser security tool for detecting secrets and personal data before sending text to AI tools like ChatGPT, Claude, or Copilot\. The text covers its core functions, including local browser execution, offline support, sample testing, and redaction capabilities\. The llms\.txt file adds specific usage steps, a link to the open source GitHub repository, and explicit agent notes clarifying that the site is a human\-facing tool rather than an API service\. Pricing is explicitly stated as free with no account required, and contact or support details are absent beyond the repository link\. > PasteGuard is a free, client\-side text scanner that runs in the browser to detect API keys, private keys, and PII before you paste into AI chatbots\. Simulated from the response GoodForBotsBot received, not a live answer from any AI assistant. Category: Developer Tools & APIs Tags: Security & Privacy, Developers, Open Source Hosting: netlify ## Site profile Login: not established. API: not established. Commerce: not established. Not established means the scan found no proof, not that the site lacks it. The profile decides which conditional checks apply. Robots verdict: allowed ## Scan statistics ```json { "pagesScanned": 1, "requestCount": 18, "bytesFetched": 134240, "durationMs": 12522 } ``` ## Pages read The homepage and up to three content pages chosen from the sitemaps and homepage links. Structured data, page structure, Markdown negotiation and typed links check every page read and take the median page; other checks read the homepage. - Homepage: https://pasteguard\-exp2\.netlify\.app - No other eligible page was found in the sitemaps or the homepage links. ## Score breakdown Readable base: 17.35; agent layer: 5.63; penalties: 0. Final points are rounded and cannot fall below zero. [How scoring works · current methodology](https://goodforbots.com/standards?rubric=0.9.0#scoring) ```json { "block1Raw": 17, "block1Max": 49, "block2Raw": 4.5, "block2Max": 40, "coverage": 1, "cappedAt": null } ``` ## Detected capabilities control\-names, form\-semantics, control\-semantics ## Checks ### llms\.txt is present and well formed ID: llms-txt; version: 2; kind: achievement; status: warn. Contribution: 5.625; maximum magnitude: 11.25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-txt&version=2#llms-txt) /llms\.txt has a title but lists no links to follow\. ```json { "links": 0, "title": "PasteGuard", "errors": [], "reason": "no-links", "sections": 3, "charLength": 899, "hasSummary": true, "sectionsWithLinks": 0 } ``` ### robots\.txt is present and valid ID: robots-txt; version: 2; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 4.081632653061225. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=robots-txt&version=2#robots-txt) No robots\.txt at /robots\.txt \(HTTP 404\)\. ```json { "reason": "missing", "status": 404 } ``` ### Sitemap is present and parses ID: sitemap; version: 4; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 10.204081632653061. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=sitemap&version=4#sitemap) No sitemap was found\. ```json { "reason": "missing", "urlCount": 0, "documents": [ { "url": "https://pasteguard-exp2.netlify.app/sitemap.xml", "kind": "missing", "urls": 0, "cause": "not-found", "error": "HTTP 404", "valid": false, "children": 0, "compressed": false }, { "url": "https://pasteguard-exp2.netlify.app/sitemap-index.xml", "kind": "missing", "urls": 0, "cause": "not-found", "error": "HTTP 404", "valid": false, "children": 0, "compressed": false }, { "url": "https://pasteguard-exp2.netlify.app/sitemap_index.xml", "kind": "missing", "urls": 0, "cause": "not-found", "error": "HTTP 404", "valid": false, "children": 0, "compressed": false } ], "declaredInRobots": false } ``` ### llms\.txt is descriptive, not a bare link list ID: llms-txt-quality; version: 2; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 7.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-txt-quality&version=2#llms-txt-quality) /llms\.txt lists no links, so there is nothing to describe\. ```json { "links": 0, "reason": "no-links", "charLength": 899, "hasDetails": true, "hasSummary": true, "describedLinks": 0, "descriptionRatio": 0, "unconventionalSeparators": 0 } ``` ### Serves markdown at its own URL ID: llms-full-txt; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 12.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-full-txt&version=3#llms-full-txt) No /llms\-full\.txt and no markdown versions linked from llms\.txt\. ```json { "reason": "none", "llmsFullTxt": { "status": 404, "usable": false, "rejected": null, "truncated": false, "byteLength": 0 }, "markdownLinksInLlmsTxt": 0, "servesMarkdownOnRequest": false } ``` ### Serves markdown when asked for it ID: markdown-negotiation; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 10. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=markdown-negotiation&version=3#markdown-negotiation) Asking the homepage for markdown still returns text/html\. ```json { "vary": "Accept-Encoding", "pages": [ { "url": "https://pasteguard-exp2.netlify.app/", "reason": "not-markdown", "status": "fail", "summary": "Asking the homepage for markdown still returns text/html.", "homepage": true } ], "reason": "not-markdown", "charset": "UTF-8", "variant": null, "bodyLength": 36856, "contentType": "text/html; charset=UTF-8", "variesOnAccept": false } ``` ### States a position on AI crawlers ID: ai-crawler-rules; version: 5; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ai-crawler-rules&version=5#ai-crawler-rules) No robots\.txt, so no rules for AI crawlers either\. ### Declares AI usage preferences ID: content-signals; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 2.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=content-signals&version=3#content-signals) No usage declaration found in robots\.txt or the final successful homepage response header\. ```json { "carriers": [], "contentUsage": [], "vocabularies": [], "contentSignal": [], "contentUsageHeader": null, "recognisedUsageCategories": [], "recognisedSignalCategories": [] } ``` ### Describes itself to machines with schema\.org JSON\-LD ID: schema-org; version: 4; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 10.204081632653061. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=schema-org&version=4#schema-org) The homepage publishes no structured data at all: no JSON\-LD, no microdata, no RDFa\. ```json { "nodes": 0, "pages": [ { "url": "https://pasteguard-exp2.netlify.app/", "reason": "none", "status": "fail", "summary": "The homepage publishes no structured data at all: no JSON-LD, no microdata, no RDFa.", "homepage": true } ], "types": [], "blocks": 0, "reason": "none", "contexts": [], "rdfaTypes": [], "truncated": false, "validBlocks": 0, "brokenBlocks": [], "unknownTypes": [], "pagesExamined": 1, "skippedBlocks": 0, "topLevelNodes": 0, "microdataTypes": [], "missingProperties": [], "unnamedTopLevelTypes": [] } ``` ### Content is marked up so a reader can find it ID: semantic-html; version: 4; kind: achievement; status: warn. Contribution: 6.122448979591837; maximum magnitude: 12.244897959183675. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=semantic-html&version=4#semantic-html) The homepage is partly structured: No <main> element and nothing carrying role="main"\. ```json { "gaps": [ "No
element and nothing carrying role=\"main\"." ], "pages": [ { "url": "https://pasteguard-exp2.netlify.app/", "reason": "partly-structured", "status": "warn", "summary": "The homepage is partly structured: No
element and nothing carrying role=\"main\".", "homepage": true } ], "roots": [], "reason": "partly-structured", "h1Count": 1, "headings": [ { "text": "PasteGuard", "empty": false, "level": 1 }, { "text": "Findings", "empty": false, "level": 2 } ], "bodyWords": 151, "landmarks": [ { "role": "banner", "named": false, "source": "native", "element": "header" }, { "role": "contentinfo", "named": false, "source": "native", "element": "footer" } ], "textRatio": 0.0282, "truncated": false, "articleCount": 0, "contentWords": 105, "headingCount": 2, "headingSkips": [], "requirements": { "landmarks": true, "contentRoot": false, "headingOutline": true }, "landmarkRoles": [ "banner", "contentinfo" ], "hiddenMainCount": 0, "textComposition": { "words": { "main": 0, "other": 69, "footer": 38, "header": 8, "navigation": 0 }, "shares": { "main": 0, "other": 0.6, "footer": 0.33043478260869563, "header": 0.06956521739130435, "navigation": 0 }, "version": 1, "truncated": false, "totalWords": 115, "analysisLimited": false, "mainRegionCount": 0, "wordsBeforeMain": null }, "emptyHeadingCount": 0, "misnestedMainCount": 0 } ``` ### Navigation links expose usable destinations ID: crawlable-navigation; version: 2; kind: achievement; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=crawlable-navigation&version=2#crawlable-navigation) No applicable navigation links were observed in the homepage HTML\. ```json { "good": 0, "page": "homepage", "total": 0, "reason": "not-observed", "limited": false, "examples": [], "truncated": false, "skippedContactLinks": 0, "brokenLabelReferences": 0 } ``` ### Links and buttons have accessible names ID: control-names; version: 1; kind: achievement; status: pass. Contribution: 5.1020408163265305; maximum magnitude: 5.1020408163265305. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=control-names&version=1#control-names) 16 of 16 assessed homepage links and buttons have a nonempty accessible name\. ```json { "good": 16, "page": "homepage", "total": 16, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false, "skippedContactLinks": 0, "brokenLabelReferences": 0 } ``` ### Form fields have names and recognizable semantics ID: form-semantics; version: 1; kind: achievement; status: pass. Contribution: 3.0612244897959187; maximum magnitude: 3.0612244897959187. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=form-semantics&version=1#form-semantics) 1 of 1 assessed homepage form fields meet the static naming and field\-semantics checks\. ```json { "good": 1, "page": "homepage", "total": 1, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false, "nativeForms": 0, "submitControls": 0, "inputTypeFallbacks": 0, "formsWithoutSubmitControl": 0 } ``` ### Controls expose roles, states and relationships ID: control-semantics; version: 1; kind: achievement; status: pass. Contribution: 3.0612244897959187; maximum magnitude: 3.0612244897959187. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=control-semantics&version=1#control-semantics) 18 of 18 assessed homepage controls and role declarations meet the static role, state and relationship checks\. ```json { "good": 18, "page": "homepage", "total": 18, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false } ``` ### Advertises machine\-readable resources with typed links ID: link-headers; version: 4; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 1.25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=link-headers&version=4#link-headers) The homepage carries no typed links, in either a Link header or the markup\. ```json { "pages": [ { "url": "https://pasteguard-exp2.netlify.app/", "reason": "no-links", "status": "fail", "summary": "The homepage carries no typed links, in either a Link header or the markup.", "homepage": true } ], "reason": "no-links", "sources": [], "totalLinks": 0, "markdownAlternates": [], "meaningfulRelations": [] } ``` ### Each page declares one usable canonical URL ID: canonical-url; version: 1; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 2.0408163265306123. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=canonical-url&version=1#canonical-url) The homepage declares no canonical URL, in a Link header or a <link> element\. ```json { "pages": [ { "url": "https://pasteguard-exp2.netlify.app/", "reason": "none", "status": "fail", "summary": "The homepage declares no canonical URL, in a Link header or a element.", "homepage": true } ], "reason": "none", "readings": [ { "url": "https://pasteguard-exp2.netlify.app/", "truncated": false, "declarations": [], "invalidDeclarations": 0 } ], "truncated": false, "declarations": [], "invalidDeclarations": 0 } ``` ### Section links reach an element on the page ID: section-links; version: 1; kind: achievement; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=section-links&version=1#section-links) No section links were found on the pages read\. ```json { "reason": "not-observed" } ``` ### Serves our crawler without a challenge ID: waf-challenge; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 15. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=waf-challenge&version=2#waf-challenge) Our crawler reaches the page without being challenged\. ```json { "status": 200 } ``` ### The homepage does not block indexing or snippets ID: indexing-blocks; version: 5; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 20. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=indexing-blocks&version=5#indexing-blocks) Nothing on the homepage tells a crawler to skip it or to withhold its snippet\. ```json { "blocking": [], "finalUrl": "https://pasteguard-exp2.netlify.app/", "redirects": 0, "directives": [], "ignoredScopes": [], "trainingOptOut": [], "snippetBlocking": [] } ``` ### Serves its content without JavaScript ID: javascript-required; version: 4; kind: penalty; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=javascript-required&version=4#javascript-required) The homepage contains text or potentially meaningful elements; JavaScript dependence is not established\. ```json { "reason": "not-established", "bodyWords": 151, "truncated": false, "scriptCount": 2, "contentWords": 105, "markupLength": 36856, "passWordThreshold": 120, "hasNoscriptFallback": false, "nontextElementCount": 25 } ``` ### Allows search and user\-fetch crawlers ID: ai-crawler-access; version: 5; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ai-crawler-access&version=5#ai-crawler-access) No applicable robots\.txt rules block search or user\-fetch crawlers from the homepage\. ```json { "path": "/", "capped": false, "blocked": [], "blockedCount": 0, "penaltyPoints": 0 } ``` ### Serves the homepage over HTTPS with HTTP 200 ID: homepage-availability; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 10. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=homepage-availability&version=2#homepage-availability) The homepage is served over HTTPS and returns HTTP 200\. ```json { "error": null, "secure": true, "status": 200, "finalUrl": "https://pasteguard-exp2.netlify.app/", "requestedUrl": "https://pasteguard-exp2.netlify.app" } ``` ### Provides a title and meta description ID: page-metadata; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=page-metadata&version=2#page-metadata) The homepage provides both a non\-empty title and meta description\. ```json { "title": "PasteGuard — Check before you paste into an AI", "titleCount": 1, "description": "PasteGuard — check text for secrets and PII before pasting into an AI chat. Fully client-side.", "descriptionCount": 1 } ``` ### Reaches the homepage within two redirects ID: redirect-chain; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=redirect-chain&version=2#redirect-chain) The homepage is reached in 0 redirects\. ```json { "finalUrl": "https://pasteguard-exp2.netlify.app/", "redirects": 0, "threshold": 2, "requestedUrl": "https://pasteguard-exp2.netlify.app" } ``` ### Returns the homepage within three seconds ID: response-time; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=response-time&version=2#response-time) The homepage reached a plain crawler in 321 ms\. ```json { "durationMs": 321, "thresholdMs": 3000, "directAttempts": 1 } ``` ### Publishes an API catalog ID: api-catalog; version: 4; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=api-catalog&version=4#api-catalog) No API catalog published\. ```json { "wellKnown": { "status": 404, "problem": "absent", "profile": null, "contentType": null }, "advertisedVia": [] } ``` ### Publishes an auth\.md for agents ID: auth-md; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=auth-md&version=2#auth-md) No /auth\.md published\. ```json { "error": null, "reason": "absent", "status": 404, "contentType": "text/html" } ``` ### Lists an MCP server card in its AI Catalog ID: mcp-server-card; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=mcp-server-card&version=3#mcp-server-card) No AI Catalog published, so no MCP server card can be discovered\. ```json { "reason": "absent", "catalog": { "status": 404, "entries": 0, "problem": "absent", "contentType": null, "specVersion": null, "malformedEntries": 0 } } ``` ### Publishes an A2A Agent Card ID: a2a-agent-card; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=a2a-agent-card&version=3#a2a-agent-card) No A2A Agent Card at /\.well\-known/agent\-card\.json, and none listed in an AI Catalog\. ```json { "cards": [ { "via": "well-known", "name": null, "error": null, "notes": [], "shape": null, "skills": 0, "source": "https://pasteguard-exp2.netlify.app/.well-known/agent-card.json", "status": 404, "usable": false, "problem": "absent", "version": null, "bindings": [], "identifier": null, "interfaces": [] } ], "reason": "absent", "catalog": { "status": 404, "entries": 0, "problem": "absent" }, "wellKnown": { "status": 404, "problem": "absent", "contentType": "text/html; charset=utf-8" } } ``` ### Publishes an Agent Skills index ID: agent-skills-index; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=agent-skills-index&version=3#agent-skills-index) No usable Agent Skills index was found at either well\-known path or in the AI Catalog\. ```json { "reason": "absent", "catalog": { "status": 404, "problem": "absent", "individualSkills": 0 }, "indexes": [ { "via": "well-known", "error": null, "notes": [], "total": 0, "format": null, "issues": [], "schema": null, "source": "https://pasteguard-exp2.netlify.app/.well-known/agent-skills/index.json", "status": 404, "usable": 0, "entries": [], "problem": "absent", "rejected": 0, "identifier": null }, { "via": "well-known", "error": null, "notes": [], "total": 0, "format": null, "issues": [], "schema": null, "source": "https://pasteguard-exp2.netlify.app/.well-known/skills/index.json", "status": 404, "usable": 0, "entries": [], "problem": "absent", "rejected": 0, "identifier": null } ], "artifactVerification": "not-performed" } ``` ### Declares WebMCP tools for browser agents ID: webmcp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=webmcp&version=1#webmcp) No WebMCP declarations were found in the collected HTML or inline scripts\. External scripts were not inspected\. ```json { "pages": [ { "key": "homepage", "url": "https://pasteguard-exp2.netlify.app/", "secure": true, "usable": 0, "truncated": false, "references": 0, "parseErrors": 0, "declarations": 0 } ], "reason": "absent", "detection": "static", "pageCount": 1, "references": [], "parseErrors": 0, "usableCount": 0, "declarations": [], "referenceCount": 0, "declarationCount": 0, "runtimeVerification": "not-performed" } ``` ### Publishes a Web Bot Auth key directory ID: web-bot-auth; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=web-bot-auth&version=2#web-bot-auth) No Web Bot Auth key directory at /\.well\-known/http\-message\-signatures\-directory\. ```json { "keys": { "total": 0, "sample": [], "usable": 0, "testKeys": 0, "evaluated": 0, "privateMaterial": 0 }, "notes": [ "media-type", "unsigned" ], "shape": null, "reason": "absent", "signature": { "total": 0, "status": "absent", "ignored": 0, "coverage": null, "malformed": false, "signatures": [] }, "wellKnown": { "status": 404, "problem": "absent", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/http-message-signatures-directory", "redirects": 0, "contentType": null }, "extraMembers": [], "signatureAgent": "https://pasteguard-exp2.netlify.app" } ``` ### Accepts agent payments with x402 or MPP ID: x402-mpp; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=x402-mpp&version=2#x402-mpp) No HTTP 402 payment challenge on the homepage or robots\.txt, and no manifest at /\.well\-known/x402\. ```json { "reason": "absent", "manifest": { "kind": null, "notes": [], "shape": null, "status": 404, "problem": "absent", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/x402", "resources": { "total": 0, "sample": [], "skipped": {}, "eligible": 0, "examined": 0 }, "contentType": null }, "protocols": [], "responses": [], "verification": null, "paymentVerification": "not-performed" } ``` ### Publishes ACP discovery metadata ID: acp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=acp&version=1#acp) No ACP discovery declaration established at /\.well\-known/acp\.json\. ```json { "api": false, "key": "well-known-acp", "issues": [], "marked": false, "reason": "absent", "status": 404, "usable": false, "problem": "absent", "version": null, "commerce": false, "services": [], "transports": [], "capabilities": [], "transactionVerification": "not-performed" } ``` ### Publishes UCP discovery metadata ID: ucp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ucp&version=1#ucp) No UCP discovery declaration established at /\.well\-known/ucp\. ```json { "api": false, "key": "well-known-ucp", "issues": [], "marked": false, "reason": "absent", "status": 404, "usable": false, "problem": "absent", "version": null, "commerce": false, "services": [], "transports": [], "capabilities": [], "transactionVerification": "not-performed" } ``` ## Observations ### robots ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 596, "key": "robots", "url": "https://pasteguard-exp2.netlify.app/robots.txt", "finalUrl": "https://pasteguard-exp2.netlify.app/robots.txt", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 596, "rung": "direct", "reason": null } ] } ``` ### homepage ```json { "status": 200, "contentType": "text/html; charset=UTF-8", "bodyHash": "8bfc7551ff403178f6a57df255224d7c19a697c835f4493631fc88b16cedf75a", "error": null, "durationMs": 321, "key": "homepage", "url": "https://pasteguard-exp2.netlify.app", "finalUrl": "https://pasteguard-exp2.netlify.app/", "rung": "direct", "redirects": 0, "byteLength": 36978, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=UTF-8", "bodyHash": "d9da336ac8c0a2d9df885e2a5527409d191665ad717f68cfacf127aea124d555", "error": null, "durationMs": 321, "rung": "direct", "reason": null } ] } ``` ### llms\-txt ```json { "status": 200, "contentType": "text/plain; charset=UTF-8", "bodyHash": "cb74859461265045f662e2ad6dece556da91b835ae277d5c04c895f9ee6590cc", "error": null, "durationMs": 262, "key": "llms-txt", "url": "https://pasteguard-exp2.netlify.app/llms.txt", "finalUrl": "https://pasteguard-exp2.netlify.app/llms.txt", "rung": "direct", "redirects": 0, "byteLength": 899, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/plain; charset=UTF-8", "bodyHash": "cb74859461265045f662e2ad6dece556da91b835ae277d5c04c895f9ee6590cc", "error": null, "durationMs": 262, "rung": "direct", "reason": null } ] } ``` ### llms\-full\-txt ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 122, "key": "llms-full-txt", "url": "https://pasteguard-exp2.netlify.app/llms-full.txt", "finalUrl": "https://pasteguard-exp2.netlify.app/llms-full.txt", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 122, "rung": "direct", "reason": null } ] } ``` ### markdown\-negotiation ```json { "status": 200, "contentType": "text/html; charset=UTF-8", "bodyHash": "8bfc7551ff403178f6a57df255224d7c19a697c835f4493631fc88b16cedf75a", "error": null, "durationMs": 20, "key": "markdown-negotiation", "url": "https://pasteguard-exp2.netlify.app", "finalUrl": "https://pasteguard-exp2.netlify.app/", "rung": "direct", "redirects": 0, "byteLength": 36978, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=UTF-8", "bodyHash": "d9da336ac8c0a2d9df885e2a5527409d191665ad717f68cfacf127aea124d555", "error": null, "durationMs": 20, "rung": "direct", "reason": null } ] } ``` ### sitemap:https://pasteguard\-exp2\.netlify\.app/sitemap\.xml ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 204, "key": "sitemap:https://pasteguard-exp2.netlify.app/sitemap.xml", "url": "https://pasteguard-exp2.netlify.app/sitemap.xml", "finalUrl": "https://pasteguard-exp2.netlify.app/sitemap.xml", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 204, "rung": "direct", "reason": null } ] } ``` ### sitemap:https://pasteguard\-exp2\.netlify\.app/sitemap\-index\.xml ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 121, "key": "sitemap:https://pasteguard-exp2.netlify.app/sitemap-index.xml", "url": "https://pasteguard-exp2.netlify.app/sitemap-index.xml", "finalUrl": "https://pasteguard-exp2.netlify.app/sitemap-index.xml", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 121, "rung": "direct", "reason": null } ] } ``` ### sitemap:https://pasteguard\-exp2\.netlify\.app/sitemap\_index\.xml ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 120, "key": "sitemap:https://pasteguard-exp2.netlify.app/sitemap_index.xml", "url": "https://pasteguard-exp2.netlify.app/sitemap_index.xml", "finalUrl": "https://pasteguard-exp2.netlify.app/sitemap_index.xml", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 120, "rung": "direct", "reason": null } ] } ``` ### well\-known\-api\-catalog ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 117, "key": "well-known-api-catalog", "url": "https://pasteguard-exp2.netlify.app/.well-known/api-catalog", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/api-catalog", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 117, "rung": "direct", "reason": null } ] } ``` ### well\-known\-ai\-catalog ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 116, "key": "well-known-ai-catalog", "url": "https://pasteguard-exp2.netlify.app/.well-known/ai-catalog.json", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/ai-catalog.json", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 116, "rung": "direct", "reason": null } ] } ``` ### well\-known\-agent\-card ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 119, "key": "well-known-agent-card", "url": "https://pasteguard-exp2.netlify.app/.well-known/agent-card.json", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/agent-card.json", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 119, "rung": "direct", "reason": null } ] } ``` ### well\-known\-agent\-skills ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 119, "key": "well-known-agent-skills", "url": "https://pasteguard-exp2.netlify.app/.well-known/agent-skills/index.json", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/agent-skills/index.json", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 119, "rung": "direct", "reason": null } ] } ``` ### well\-known\-skills ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 354, "key": "well-known-skills", "url": "https://pasteguard-exp2.netlify.app/.well-known/skills/index.json", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/skills/index.json", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 354, "rung": "direct", "reason": null } ] } ``` ### well\-known\-http\-message\-signatures\-directory ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 333, "key": "well-known-http-message-signatures-directory", "url": "https://pasteguard-exp2.netlify.app/.well-known/http-message-signatures-directory", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/http-message-signatures-directory", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 333, "rung": "direct", "reason": null } ] } ``` ### well\-known\-x402 ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 122, "key": "well-known-x402", "url": "https://pasteguard-exp2.netlify.app/.well-known/x402", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/x402", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 122, "rung": "direct", "reason": null } ] } ``` ### well\-known\-acp ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 120, "key": "well-known-acp", "url": "https://pasteguard-exp2.netlify.app/.well-known/acp.json", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/acp.json", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 120, "rung": "direct", "reason": null } ] } ``` ### well\-known\-ucp ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 156, "key": "well-known-ucp", "url": "https://pasteguard-exp2.netlify.app/.well-known/ucp", "finalUrl": "https://pasteguard-exp2.netlify.app/.well-known/ucp", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 156, "rung": "direct", "reason": null } ] } ``` ### auth\-md ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 157, "key": "auth-md", "url": "https://pasteguard-exp2.netlify.app/auth.md", "finalUrl": "https://pasteguard-exp2.netlify.app/auth.md", "rung": "direct", "redirects": 0, "byteLength": 3959, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "a3c972ea1185410760e71b43b0fbd0845c613b3add12942a1d10e3d2f938f214", "error": null, "durationMs": 157, "rung": "direct", "reason": null } ] } ``` ## Fixes Showing 3 of 22 fixes. ### Serve Markdown at its own URL Recoverable contribution: 12.5 points. Score with this fix and the ones above it: 35/100. No /llms\-full\.txt and no markdown versions linked from llms\.txt\. ````text My website pasteguard-exp2.netlify.app scored 23/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: serve the content as markdown at its own URLs. The check it fails is "Serves markdown at its own URL", worth 12.5 points. What the scanner saw: No /llms-full.txt and no markdown versions linked from llms.txt. A model that can only reach this site's content through HTML pays to parse markup and loses structure doing it: navigation, cookie banners and script tags arrive alongside the prose, and headings, tables and code blocks come out flattened. Markdown at its own address removes HTML from the path entirely: what is fetched is the content and nothing else. Two routes satisfy this, and it is worth being clear about which one the specification asks for. llmstxt.org asks for a markdown version of each page **at the same URL as the original**, either with `.md` appended (`page.html.md`) or with the extension replaced (`page.md`). `llms-full.txt`, the single bundle holding everything, does not appear in the specification at all. It is a community convention that grew up around it and is now widespread. Both are accepted here. The per-page form is the one the document asks for. Either of these passes: - **The bundle.** `/llms-full.txt`, one document, real markdown rather than HTML, carrying the site's actual content rather than a placeholder. - **Per-page mirrors.** A markdown twin for each page at `page.md` or `page.html.md`, **and linked from `/llms.txt`**. That second half is load-bearing: mirrors are counted from the links in the index, so twins that nothing points at are invisible to this scan and, more to the point, to anything crawling the site. For the mirror route, the index carries them as ordinary link lines: ```markdown ## Docs - [Quickstart](/docs/quickstart.md): create an account and take a first payment - [Concepts](/docs/concepts.md): customers, subscriptions, invoices and proration - [Webhooks](/docs/webhooks.md): events, signature verification, retry schedule ``` Both `/docs/quickstart` and `/docs/quickstart.md` have to answer 200: the HTML for people, the markdown for everything else. Serving markdown through content negotiation does **not** satisfy this, and that is deliberate rather than an oversight. A negotiated response only exists for a client that knows to send `Accept: text/markdown`, and most crawlers send no preference at all. A `.md` address sits in the open: it is found by ordinary crawling, it can be linked to, and it can be cited. If this site already negotiates markdown, the report says so in these words: *"Markdown is served on request, but not at any URL a crawler would find on its own"*. That is a different check passing on its own terms, not a contradiction. Four things about how this is measured. The bundle is judged by size, by being markdown rather than a page or JSON, and by not merely repeating `llms.txt`; its content is never sampled beyond that, so a couple of kilobytes of boilerplate would pass. Do not take that as permission, since the point of the file is the content in it. `.mdx` counts as markdown although the specification names only `.md`, because excluding it would punish a large part of the documentation ecosystem for its toolchain. The number of mirrors we want before calling it a convention on this site is our judgement, not the specification's. And the mirror URLs listed in the index are counted, never fetched, so a list of `.md` addresses that 404 passes this check and helps nobody at all. The whole report, as markdown, is at https://goodforbots.com/r/pasteguard-exp2.netlify.app.md?scan=cmusm327v02ug01o0sbsfxln0. Read it first: this prompt covers one finding, and the report has everything the scan saw. When you are done, summarise what you changed and how to check it against a running instance. Do not try to run the Good for Bots scan yourself: it only sees what is already deployed, it is rate-limited, and re-running it is the site owner's call once the change ships. ```` ### Publish a sitemap that parses Recoverable contribution: 10.2 points. Score with this fix and the ones above it: 46/100. No sitemap was found\. ````text My website pasteguard-exp2.netlify.app scored 23/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: publish a sitemap a crawler can find. The check it fails is "Sitemap is present and parses", worth 10.2 points. What the scanner saw: No sitemap was found. A sitemap is how a reader learns what exists on a site without inferring it from whatever the navigation links to. That matters more to an agent fetching a handful of pages than to a search engine crawling continuously: the search engine will find the rest eventually, and the agent will not come back. Follow the sitemaps.org protocol 0.9, a de facto standard published jointly by the major search engines rather than an RFC. The `Sitemap:` line that points at it is defined by that same protocol; RFC 9309 mentions sitemaps only as an example of a record outside the robots protocol that a crawler MAY interpret, and requires only that reading it does not interfere with the real directives or terminate a group. The sitemap must: - live at `/sitemap.xml`, `/sitemap-index.xml` or `/sitemap_index.xml`, or at any URL named by a `Sitemap:` line in `robots.txt`, and answer 200; - be a `` in which every `` carries a ``, or a `` in which every `` carries a `` pointing at a document that itself resolves; - declare the namespace `http://www.sitemaps.org/schemas/sitemap/0.9`, which the protocol requires; - give every `` a full absolute URL, with XML entities escaped; - stay under 50,000 URLs and 50 MB uncompressed, splitting into an index above that; - list only URLs at or beneath its own path. A sitemap at `/catalog/sitemap.xml` may list `/catalog/…` and may not list `/images/…`. A plain-text sitemap is equally valid under the protocol and passes here too: UTF-8, one complete absolute URL per line, nothing else in the file (no headers, no comments, no blank decoration). A minimal, valid example: ```xml https://pasteguard-exp2.netlify.app/ 2026-09-01 https://pasteguard-exp2.netlify.app/docs/quickstart ``` Two things get this wrong. **An index whose children lead nowhere.** A `` that resolves to shards which 404, or which are themselves empty, is a chain ending in nothing. It parses, it looks correct in a browser, and it lists no pages. Fetch two or three of the child URLs directly before assuming the chain holds. **An HTML page at `/sitemap.xml`.** Either a styled sitemap viewer, or the application's catch-all route answering a path it does not recognise. What comes back is a document no sitemap parser can read, and it is worse than nothing there at all, because the address now looks occupied. A gzipped sitemap is fine: the protocol permits gzip for sitemaps, indexes and text sitemaps alike, and this scan decompresses it and reads it like any other. The 50 MB limit applies to the file once uncompressed, and a `.gz` that will not decompress is as unreadable as broken XML. Two limits of this scan are worth knowing. An index is followed one level deep and at most five children, keeping 200 URLs per document, so a heavily sharded sitemap is sampled rather than walked. And the namespace is not validated here, so a `` in the wrong namespace parses for us and may not for anyone else; treat a pass as evidence that the file is reachable and readable, not as proof of validity. Declaring the sitemap in `robots.txt` is not required to pass: a sitemap at one of the conventional locations is found without it. It is one line, it is recorded on the report, and it is the only way a crawler finds a sitemap that lives anywhere else, so it is worth writing; but nothing here depends on it. The whole report, as markdown, is at https://goodforbots.com/r/pasteguard-exp2.netlify.app.md?scan=cmusm327v02ug01o0sbsfxln0. Read it first: this prompt covers one finding, and the report has everything the scan saw. When you are done, summarise what you changed and how to check it against a running instance. Do not try to run the Good for Bots scan yourself: it only sees what is already deployed, it is rate-limited, and re-running it is the site owner's call once the change ships. ```` ### Describe the site with schema\.org JSON\-LD Recoverable contribution: 10.2 points. Score with this fix and the ones above it: 56/100. The homepage publishes no structured data at all: no JSON\-LD, no microdata, no RDFa\. ````text My website pasteguard-exp2.netlify.app scored 23/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: describe the pages with schema.org JSON-LD. The check it fails is "Describes itself to machines with schema.org JSON-LD", worth 10.2 points. What the scanner saw: The homepage publishes no structured data at all: no JSON-LD, no microdata, no RDFa. The pages identified as having no structured data need markup added through their templates. Review the other public page types for the same gap. Use the homepage example below where it fits, and describe each content page with types that match its visible content. A passing homepage does not need its markup replaced. Review structured data across the site's public page types, including those outside the reported sample. Add or repair it in the templates that generate each type, using that page's content. Verify a page from each template and keep existing valid markup. Structured data gives a reader explicit names, types and relationships for the entities the page describes. Put a ` ``` The addresses in that example are this site's. The names are not. Replace `Example Corp` with the organisation's real name, which is the one thing here that cannot be filled in from the outside. Work out how to generate this in whatever stack this project uses, from the same data that renders the page, so the two cannot drift apart. Two mistakes account for most broken structured data in the wild. Avoid both: 1. **Do not let the template escape the JSON.** A templating engine that escapes variables by default will turn every `"` into `"`, and the block will look perfectly correct in the page source while no consumer on earth can parse it, because HTML entities inside a `