# Good for Bots report: startupideasdb\.com Website: https://startupideasdb\.com Report: https://goodforbots.com/r/startupideasdb.com Scan: cmushctbh00q901o0i55u59p1 Scanned at: 2026-10-03T14:21:58.098Z Status: completed Rubric: 0\.9\.0 Score: 41/100 (Poor) Name: StartupIdeasDB ## Access & usage policy GoodForBotsBot received HTTP 200 via a direct request\. No indexing restriction was observed in the supported homepage directives\. Sampled URL: https://startupideasdb\.com/ Crawler identities: - goodforbotsbot: Good for Bots, Site diagnostics. - \*: Unspecified, Default robots group. - oai\-searchbot: OpenAI, ai\-search. - claude\-searchbot: Anthropic, ai\-search. - perplexitybot: Perplexity, ai\-search. - mistralai\-index: Mistral, ai\-search. - kimi\-searchbot: Moonshot AI, ai\-search. - amzn\-searchbot: Amazon, ai\-search. - meta\-webindexer: Meta, ai\-search. - exasearchbot: Exa, ai\-search. - aiwebindex: Lyrenth, ai\-search. - duckassistbot: DuckDuckGo, ai\-search. - shapbot: Parallel, ai\-search. - yandexadditional: Yandex, ai\-search. - yandexadditionalbot: Yandex, ai\-search. - gptbot: OpenAI, ai\-training. - claudebot: Anthropic, ai\-training. - mistralai\-training: Mistral, ai\-training. - kimibot: Moonshot AI, ai\-training. - ai2bot: Unspecified, Unknown. - applebot\-extended: Apple, ai\-training. - webzio\-extended: Webz\.io, ai\-training. - chatgpt\-user: OpenAI, user\-fetch. - claude\-user: Anthropic, user\-fetch. - perplexity\-user: Perplexity, user\-fetch. - mistralai\-user: Mistral, user\-fetch. - kimi\-user: Moonshot AI, user\-fetch. - amzn\-user: Amazon, user\-fetch. - diffbot\-user: Diffbot, user\-fetch. - firecrawlagent: Firecrawl, extraction. - webzio: Webz\.io, extraction. - meta\-externalfetcher: Meta, user\-fetch, agent. - google\-extended: Google, ai\-training, grounding. - meta\-externalagent: Meta, ai\-training, product\-improvement. - amazonbot: Amazon, ai\-training, product\-improvement. - ccbot: Common Crawl, open\-dataset, ai\-training. - googlebot: Google, search. - bingbot: Microsoft, search. ### Declared crawling rules No matching refusal for this URL was found for the listed identities\. - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): The recorded robots admission decision allowed our crawler to proceed\. Source: Scan admission; URL: https://startupideasdb\.com/; scope: GoodForBotsBot admission along the homepage request chain; state: allowed. [Related check: robots\-txt](https://goodforbots.com/standards?rubric=0.9.0#robots-txt) - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No matching refusal for this URL in the applicable robots group\. This is a declaration, not an access test\. Source: robots\.txt; URL: https://startupideasdb\.com/robots\.txt; scope: Acquisition of https://startupideasdb\.com/; state: allowed. ```text User-agent: * allow: / ``` [Related check: robots\-txt](https://goodforbots.com/standards?rubric=0.9.0#robots-txt) [Related check: ai\-crawler\-rules](https://goodforbots.com/standards?rubric=0.9.0#ai-crawler-rules) [Related check: ai\-crawler\-access](https://goodforbots.com/standards?rubric=0.9.0#ai-crawler-access) ### Observed access GoodForBotsBot received HTTP 200 via a direct request\. - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): Our request received HTTP 200\. A status alone does not identify a WAF\. Source: Direct request; URL: https://startupideasdb\.com; scope: Our recorded direct transport attempt; intermediate attempt URLs are not retained; state: observed. ```text HTTP 200 ``` [Related check: homepage\-availability](https://goodforbots.com/standards?rubric=0.9.0#homepage-availability) - GoodForBotsBot/1\.0 \(\+https://goodforbots\.com/bot\): GoodForBotsBot received HTTP 200 via a direct request\. Source: Final homepage response; URL: https://startupideasdb\.com/; scope: homepage response; state: observed. ```text HTTP 200 Transport: direct ``` [Related check: homepage\-availability](https://goodforbots.com/standards?rubric=0.9.0#homepage-availability) [Related check: waf\-challenge](https://goodforbots.com/standards?rubric=0.9.0#waf-challenge) ### Indexing directives No indexing restriction was observed in the supported homepage directives\. - Scope unresolved: No indexing restriction was observed in the supported homepage directives\. Source: Homepage directives; URL: https://startupideasdb\.com/; scope: homepage response; state: not-observed. [Related check: indexing\-blocks](https://goodforbots.com/standards?rubric=0.9.0#indexing-blocks) ### Search snippets Scoped instructions were recorded; see their values and recipient support below\. - googlebot: This declares a snippet instruction for the named recipients\. The value is not a claim about citation by every AI operator\. Source: Meta robots; URL: https://startupideasdb\.com/; scope: This response only; state: observed. ```text max-snippet: -1 ``` [Related check: indexing\-blocks](https://goodforbots.com/standards?rubric=0.9.0#indexing-blocks) ### Search usage No applicable preference for this use was established\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://startupideasdb\.com/; scope: Purpose: search; applicable robots group/path and this response's header; state: unstated. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) ### AI input and use No applicable preference for this use was established\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://startupideasdb\.com/; scope: Purpose: ai\-use; applicable robots group/path and this response's header; state: unstated. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) ### AI training No applicable preference for this use was established\. - goodforbotsbot, \*, oai\-searchbot, claude\-searchbot, perplexitybot, mistralai\-index, kimi\-searchbot, amzn\-searchbot, meta\-webindexer, exasearchbot, aiwebindex, duckassistbot, shapbot, yandexadditional, yandexadditionalbot, gptbot, claudebot, mistralai\-training, kimibot, ai2bot, applebot\-extended, webzio\-extended, chatgpt\-user, claude\-user, perplexity\-user, mistralai\-user, kimi\-user, amzn\-user, diffbot\-user, firecrawlagent, webzio, meta\-externalfetcher, google\-extended, meta\-externalagent, amazonbot, ccbot, googlebot, bingbot: No applicable AIPREF preference was established for this purpose\. Source: AIPREF Content\-Usage; URL: https://startupideasdb\.com/; scope: Purpose: train\-ai; applicable robots group/path and this response's header; state: unstated. [Related check: content\-signals](https://goodforbots.com/standards?rubric=0.9.0#content-signals) - Crawler coverage includes the registered identities and up to 50 user\-agent entries from robots\.txt\. Source excerpts and detail groups are bounded; omissions are labelled\. - Observed access describes GoodForBotsBot only\. Other crawler entries describe declared rules, not tests of those operators' access\. - Coverage is the sampled homepage response and collected robots\.txt files\. No indexing or citation is guaranteed\. Usage preferences are declarations, not a legal determination of permission\. - This explanation adds no points or penalties\. Any score effects belong to the linked checks\. - AIPREF and Content Signals keep their own definitions\. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process\. AI\-powered startup research platform with validated market opportunities and business blueprints ## About this site StartupIdeasDB is an AI\-powered startup research platform designed for aspiring entrepreneurs, first\-time founders, and business students\. It offers a database of over 12,000 validated business ideas and real\-world problem statements gathered from sources such as Reddit, Product Hunt, Hacker News, Upwork, and user reviews on app stores\. The platform provides AI opportunity scores, market size estimates, target audience analysis, revenue models, execution roadmaps, and case studies of successful startups\. Additionally, it features tools for generating business whitepapers, technical guides, and landing pages to help users research, validate, and launch products\. ## Through a bot's eyes Written from the response GoodForBotsBot received in scan cmushctbh00q901o0i55u59p1 (2026-10-03T14:21:58.098Z), before any JavaScript ran. ### What a bot can read A language model reading this input learns that StartupIdeasDB is a research platform offering 12,000 plus validated startup ideas derived from online communities and review sites\. The text outlines specific features, including problem statement databases, pain point collections, an AI builder for whitepapers and technical guides, landing page creation tools, beginner journals, and unicorn case studies\. The homepage markdown provides user testimonials, platform metrics, and core feature descriptions\. The provided llms\.txt file expands significantly on this by detailing specific data sources such as subreddits, target user segments, a comprehensive list of guide topics on business formation and legal structures across multiple countries, pricing plan locations, technical stack details, and AI usage guidelines including attribution rules and restrictions\. ### What stays hidden The input does not state the exact pricing numbers for the Beginner and Pro plans, only providing a URL link to the pricing page\. It also lacks specific instructions on how to access the database API, as the text notes no public API is currently available and requires direct email contact for partnerships\. > StartupIdeasDB is an AI\-powered startup research platform providing over 12,000 validated business ideas, market opportunity scores, execution roadmaps, and problem statements sourced from various online platforms\. Simulated from the response GoodForBotsBot received, not a live answer from any AI assistant. Category: AI Products & Agents Tags: Product Management, AI & Machine Learning, Startups Platforms: nextjs Hosting: cloudflare ## Site profile Login: detected (login\-navigation). API: not established. Commerce: not established. Not established means the scan found no proof, not that the site lacks it. The profile decides which conditional checks apply. Robots verdict: allowed ## Scan statistics ```json { "pagesScanned": 4, "requestCount": 22, "bytesFetched": 1532994, "durationMs": 14001 } ``` ## Pages read The homepage and up to three content pages chosen from the sitemaps and homepage links. Structured data, page structure, Markdown negotiation and typed links check every page read and take the median page; other checks read the homepage. - Homepage: https://startupideasdb\.com - https://startupideasdb\.com/blog/ai\-agent\-ideas: article; sitemap; read. - https://startupideasdb\.com/pricing: pricing; homepage link, sitemap; read. - https://startupideasdb\.com/blog: collection; homepage link, sitemap; read. ## Score breakdown Readable base: 35.71; agent layer: 5.63; penalties: 0. Final points are rounded and cannot fall below zero. [How scoring works · current methodology](https://goodforbots.com/standards?rubric=0.9.0#scoring) ```json { "block1Raw": 40, "block1Max": 56, "block2Raw": 4.5, "block2Max": 40, "coverage": 1, "cappedAt": null } ``` ## Detected capabilities robots\-txt, sitemap, crawlable\-navigation, control\-names, control\-semantics, canonical\-url ## Checks ### llms\.txt is present and well formed ID: llms-txt; version: 2; kind: achievement; status: warn. Contribution: 5.625; maximum magnitude: 11.25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-txt&version=2#llms-txt) /llms\.txt has a title but lists no links to follow\. ```json { "links": 0, "title": "StartupIdeasDB - AI-Powered Startup Ideas Database", "errors": [], "reason": "no-links", "sections": 16, "charLength": 7815, "hasSummary": false, "sectionsWithLinks": 0 } ``` ### robots\.txt is present and valid ID: robots-txt; version: 2; kind: achievement; status: pass. Contribution: 3.5714285714285716; maximum magnitude: 3.5714285714285716. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=robots-txt&version=2#robots-txt) robots\.txt is valid, with 1 user\-agent group\. ```json { "errors": [], "groups": 1, "sitemaps": 1, "directives": 16 } ``` ### Sitemap is present and parses ID: sitemap; version: 4; kind: achievement; status: pass. Contribution: 8.928571428571429; maximum magnitude: 8.928571428571429. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=sitemap&version=4#sitemap) Sitemap declared in robots\.txt, listing at least 200 URLs\. ```json { "urlCount": 200, "documents": [ { "url": "https://startupideasdb.com/sitemap.xml", "kind": "urlset", "urls": 200, "error": null, "valid": true, "children": 0, "compressed": false } ], "declaredInRobots": true } ``` ### llms\.txt is descriptive, not a bare link list ID: llms-txt-quality; version: 2; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 7.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-txt-quality&version=2#llms-txt-quality) /llms\.txt lists no links, so there is nothing to describe\. ```json { "links": 0, "reason": "no-links", "charLength": 7815, "hasDetails": false, "hasSummary": false, "describedLinks": 0, "descriptionRatio": 0, "unconventionalSeparators": 0 } ``` ### Serves markdown at its own URL ID: llms-full-txt; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 12.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=llms-full-txt&version=3#llms-full-txt) No /llms\-full\.txt and no markdown versions linked from llms\.txt\. ```json { "reason": "none", "llmsFullTxt": { "status": 404, "usable": false, "rejected": null, "truncated": false, "byteLength": 0 }, "markdownLinksInLlmsTxt": 0, "servesMarkdownOnRequest": false } ``` ### Serves markdown when asked for it ID: markdown-negotiation; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 10. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=markdown-negotiation&version=3#markdown-negotiation) None of the 4 pages read pass\. Asking the homepage for markdown still returns text/html\. ```json { "vary": null, "pages": [ { "url": "https://startupideasdb.com/", "reason": "not-markdown", "status": "fail", "summary": "Asking the homepage for markdown still returns text/html.", "homepage": true }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "reason": "not-markdown", "status": "fail", "summary": "Asking the page at /blog/ai-agent-ideas for markdown still returns text/html.", "homepage": false }, { "url": "https://startupideasdb.com/pricing", "reason": "not-markdown", "status": "fail", "summary": "Asking the page at /pricing for markdown still returns text/html.", "homepage": false }, { "url": "https://startupideasdb.com/blog", "reason": "not-markdown", "status": "fail", "summary": "Asking the page at /blog for markdown still returns text/html.", "homepage": false } ], "reason": "not-markdown", "charset": "utf-8", "variant": null, "bodyLength": 107165, "contentType": "text/html; charset=utf-8", "variesOnAccept": false } ``` ### States a position on AI crawlers ID: ai-crawler-rules; version: 5; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ai-crawler-rules&version=5#ai-crawler-rules) robots\.txt names no AI crawlers, so every operator has to guess\. ```json { "allowed": [], "blocked": [], "purposes": [], "crawlersNamed": 0, "wildcardBlocksEverything": false } ``` ### Declares AI usage preferences ID: content-signals; version: 3; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 2.5. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=content-signals&version=3#content-signals) No usage declaration found in robots\.txt or the final successful homepage response header\. ```json { "carriers": [], "contentUsage": [], "vocabularies": [], "contentSignal": [], "contentUsageHeader": null, "recognisedUsageCategories": [], "recognisedSignalCategories": [] } ``` ### Describes itself to machines with schema\.org JSON\-LD ID: schema-org; version: 4; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 8.928571428571429. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=schema-org&version=4#schema-org) 2 of 4 pages read pass\. The homepage publishes no structured data at all: no JSON\-LD, no microdata, no RDFa\. ```json { "nodes": 128, "pages": [ { "url": "https://startupideasdb.com/", "reason": "none", "status": "fail", "summary": "The homepage publishes no structured data at all: no JSON-LD, no microdata, no RDFa.", "homepage": true }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "reason": "ok", "status": "pass", "summary": "The page at /blog/ai-agent-ideas describes itself to machines as BlogPosting, WebPage, Person in valid schema.org JSON-LD.", "homepage": false }, { "url": "https://startupideasdb.com/pricing", "reason": "none", "status": "fail", "summary": "The page at /pricing publishes no structured data at all: no JSON-LD, no microdata, no RDFa.", "homepage": false }, { "url": "https://startupideasdb.com/blog", "reason": "ok", "status": "pass", "summary": "The page at /blog describes itself to machines as Blog, Organization, ImageObject in valid schema.org JSON-LD.", "homepage": false } ], "types": [ "BlogPosting", "WebPage", "Person", "Organization", "ImageObject", "BreadcrumbList", "ListItem", "FAQPage", "Question", "Answer", "Blog" ], "blocks": 5, "reason": "none", "contexts": [ "https://schema.org" ], "rdfaTypes": [], "truncated": false, "validBlocks": 5, "brokenBlocks": [], "unknownTypes": [], "pagesExamined": 4, "skippedBlocks": 0, "topLevelNodes": 5, "microdataTypes": [], "missingProperties": [], "unnamedTopLevelTypes": [ "BreadcrumbList", "FAQPage" ] } ``` ### Content is marked up so a reader can find it ID: semantic-html; version: 4; kind: achievement; status: warn. Contribution: 5.357142857142858; maximum magnitude: 10.714285714285715. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=semantic-html&version=4#semantic-html) None of the 4 pages read pass fully; 4 partly\. The homepage is partly structured: The outline jumps from h1 to h3, which the standard forbids\. ```json { "gaps": [ "The outline jumps from h1 to h3, which the standard forbids." ], "pages": [ { "url": "https://startupideasdb.com/", "reason": "partly-structured", "status": "warn", "summary": "The homepage is partly structured: The outline jumps from h1 to h3, which the standard forbids.", "homepage": true }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "reason": "partly-structured", "status": "warn", "summary": "The page at /blog/ai-agent-ideas is partly structured: No
element and nothing carrying role=\"main\".", "homepage": false }, { "url": "https://startupideasdb.com/pricing", "reason": "partly-structured", "status": "warn", "summary": "The page at /pricing is partly structured: No

, so nothing says what the page is about.", "homepage": false }, { "url": "https://startupideasdb.com/blog", "reason": "partly-structured", "status": "warn", "summary": "The page at /blog is partly structured: No
element and nothing carrying role=\"main\".", "homepage": false } ], "roots": [ { "words": 1226, "source": "element", "hierarchicallyCorrect": true } ], "reason": "partly-structured", "h1Count": 1, "headings": [ { "text": "Discover Real Problems!Launch Your NextSuccessful Product!", "empty": false, "level": 1 }, { "text": "We Analyse Problem Statements From", "empty": false, "level": 3 }, { "text": "Yes, The Struggle is Real", "empty": false, "level": 2 }, { "text": "Stop Building in the Dark", "empty": false, "level": 2 }, { "text": "Validated Market Demand", "empty": false, "level": 3 }, { "text": "Skip the Guesswork", "empty": false, "level": 3 }, { "text": "Fast-Track to Market", "empty": false, "level": 3 }, { "text": "Build with Confidence", "empty": false, "level": 3 }, { "text": "Everything You Need to Succeed", "empty": false, "level": 2 }, { "text": "Problem Statements Database", "empty": false, "level": 3 }, { "text": "Pain Points Database", "empty": false, "level": 3 }, { "text": "BuilderAI", "empty": false, "level": 3 }, { "text": "Startup Launchpad", "empty": false, "level": 3 }, { "text": "Beginner's Journal", "empty": false, "level": 3 }, { "text": "Unicorn Case Studies", "empty": false, "level": 3 }, { "text": "Real Founders, Real Results", "empty": false, "level": 2 }, { "text": "StartupIdeasDB", "empty": false, "level": 2 }, { "text": "Browse Startup Ideas", "empty": false, "level": 3 }, { "text": "By Audience", "empty": false, "level": 4 }, { "text": "By Location", "empty": false, "level": 4 }, { "text": "By Source", "empty": false, "level": 4 }, { "text": "By Industry", "empty": false, "level": 4 }, { "text": "By Topic", "empty": false, "level": 4 }, { "text": "Trending", "empty": false, "level": 4 }, { "text": "Startup Resources", "empty": false, "level": 3 }, { "text": "Startup Q&A", "empty": false, "level": 4 }, { "text": "Glossary", "empty": false, "level": 4 }, { "text": "Guides", "empty": false, "level": 4 } ], "bodyWords": 1226, "landmarks": [ { "role": "navigation", "named": false, "source": "native", "element": "nav" }, { "role": "region", "named": true, "source": "native", "element": "section" } ], "textRatio": 0.0757, "truncated": false, "articleCount": 0, "contentWords": 1214, "headingCount": 28, "headingSkips": [ { "to": 3, "from": 1 } ], "requirements": { "landmarks": true, "contentRoot": true, "headingOutline": false }, "landmarkRoles": [ "navigation", "region" ], "hiddenMainCount": 0, "textComposition": { "words": { "main": 1214, "other": 0, "footer": 0, "header": 0, "navigation": 12 }, "shares": { "main": 0.9902120717781403, "other": 0, "footer": 0, "header": 0, "navigation": 0.009787928221859706 }, "version": 1, "truncated": false, "totalWords": 1226, "analysisLimited": false, "mainRegionCount": 1, "wordsBeforeMain": 12 }, "emptyHeadingCount": 0, "misnestedMainCount": 0 } ``` ### Navigation links expose usable destinations ID: crawlable-navigation; version: 2; kind: achievement; status: pass. Contribution: 8.928571428571429; maximum magnitude: 8.928571428571429. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=crawlable-navigation&version=2#crawlable-navigation) 6 of 6 assessed homepage navigation links expose usable destinations\. ```json { "good": 6, "page": "homepage", "total": 6, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false, "skippedContactLinks": 0, "brokenLabelReferences": 0 } ``` ### Links and buttons have accessible names ID: control-names; version: 1; kind: achievement; status: pass. Contribution: 4.464285714285714; maximum magnitude: 4.464285714285714. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=control-names&version=1#control-names) 74 of 74 assessed homepage links and buttons have a nonempty accessible name\. ```json { "good": 74, "page": "homepage", "total": 74, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false, "skippedContactLinks": 0, "brokenLabelReferences": 0 } ``` ### Form fields have names and recognizable semantics ID: form-semantics; version: 1; kind: achievement; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=form-semantics&version=1#form-semantics) No applicable form fields were observed in the homepage HTML\. ```json { "good": 0, "page": "homepage", "total": 0, "reason": "not-observed", "limited": false, "examples": [], "truncated": false, "nativeForms": 0, "submitControls": 0, "inputTypeFallbacks": 0, "formsWithoutSubmitControl": 0 } ``` ### Controls expose roles, states and relationships ID: control-semantics; version: 1; kind: achievement; status: pass. Contribution: 2.678571428571429; maximum magnitude: 2.678571428571429. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=control-semantics&version=1#control-semantics) 74 of 74 assessed homepage controls and role declarations meet the static role, state and relationship checks\. ```json { "good": 74, "page": "homepage", "total": 74, "reason": "observed-gaps", "limited": false, "examples": [], "truncated": false } ``` ### Advertises machine\-readable resources with typed links ID: link-headers; version: 4; kind: achievement; status: fail. Contribution: 0; maximum magnitude: 1.25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=link-headers&version=4#link-headers) None of the 4 pages read pass\. The homepage's links are all ordinary page furniture; none point an agent anywhere\. ```json { "pages": [ { "url": "https://startupideasdb.com/", "reason": "ambient-only", "status": "fail", "summary": "The homepage's links are all ordinary page furniture; none point an agent anywhere.", "homepage": true }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "reason": "ambient-only", "status": "fail", "summary": "The page at /blog/ai-agent-ideas's links are all ordinary page furniture; none point an agent anywhere.", "homepage": false }, { "url": "https://startupideasdb.com/pricing", "reason": "ambient-only", "status": "fail", "summary": "The page at /pricing's links are all ordinary page furniture; none point an agent anywhere.", "homepage": false }, { "url": "https://startupideasdb.com/blog", "reason": "ambient-only", "status": "fail", "summary": "The page at /blog's links are all ordinary page furniture; none point an agent anywhere.", "homepage": false } ], "reason": "ambient-only", "sources": [], "totalLinks": 48, "ambientOnly": [ "preload", "stylesheet", "preconnect", "dns-prefetch", "icon", "apple-touch-icon", "shortcut", "author", "manifest", "canonical" ], "markdownAlternates": [], "meaningfulRelations": [] } ``` ### Each page declares one usable canonical URL ID: canonical-url; version: 1; kind: achievement; status: pass. Contribution: 1.7857142857142858; maximum magnitude: 1.7857142857142858. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=canonical-url&version=1#canonical-url) All 4 pages read pass\. The homepage declares itself as its canonical URL\. ```json { "pages": [ { "url": "https://startupideasdb.com/", "reason": "declared", "status": "pass", "summary": "The homepage declares itself as its canonical URL.", "homepage": true }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "reason": "declared", "status": "pass", "summary": "The page at /blog/ai-agent-ideas declares itself as its canonical URL.", "homepage": false }, { "url": "https://startupideasdb.com/pricing", "reason": "declared", "status": "pass", "summary": "The page at /pricing declares itself as its canonical URL.", "homepage": false }, { "url": "https://startupideasdb.com/blog", "reason": "declared", "status": "pass", "summary": "The page at /blog declares itself as its canonical URL.", "homepage": false } ], "reason": "declared", "target": "https://startupideasdb.com/", "readings": [ { "url": "https://startupideasdb.com/", "target": "https://startupideasdb.com/", "relative": false, "crossHost": false, "truncated": false, "duplicates": 0, "declarations": [ { "url": "https://startupideasdb.com/", "href": "https://startupideasdb.com", "source": "head" } ], "selfReference": true, "invalidDeclarations": 0 }, { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "target": "https://startupideasdb.com/blog/ai-agent-ideas", "relative": false, "crossHost": false, "truncated": false, "duplicates": 0, "declarations": [ { "url": "https://startupideasdb.com/blog/ai-agent-ideas", "href": "https://startupideasdb.com/blog/ai-agent-ideas", "source": "head" } ], "selfReference": true, "invalidDeclarations": 0 }, { "url": "https://startupideasdb.com/pricing", "target": "https://startupideasdb.com/pricing", "relative": false, "crossHost": false, "truncated": false, "duplicates": 0, "declarations": [ { "url": "https://startupideasdb.com/pricing", "href": "https://startupideasdb.com/pricing", "source": "head" } ], "selfReference": true, "invalidDeclarations": 0 }, { "url": "https://startupideasdb.com/blog", "target": "https://startupideasdb.com/blog", "relative": false, "crossHost": false, "truncated": false, "duplicates": 0, "declarations": [ { "url": "https://startupideasdb.com/blog", "href": "https://startupideasdb.com/blog", "source": "head" } ], "selfReference": true, "invalidDeclarations": 0 } ], "relative": false, "crossHost": false, "truncated": false, "duplicates": 0, "declarations": [ { "url": "https://startupideasdb.com/", "href": "https://startupideasdb.com", "source": "head" } ], "selfReference": true, "invalidDeclarations": 0 } ``` ### Section links reach an element on the page ID: section-links; version: 1; kind: achievement; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=section-links&version=1#section-links) No section links were found on the pages read\. ```json { "reason": "not-observed" } ``` ### Serves our crawler without a challenge ID: waf-challenge; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 15. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=waf-challenge&version=2#waf-challenge) Our crawler reaches the page without being challenged\. ```json { "status": 200 } ``` ### The homepage does not block indexing or snippets ID: indexing-blocks; version: 5; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 20. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=indexing-blocks&version=5#indexing-blocks) Nothing on the homepage tells a crawler to skip it or to withhold its snippet\. ```json { "blocking": [], "finalUrl": "https://startupideasdb.com/", "redirects": 0, "directives": [ { "name": "index", "value": null, "inHead": true, "source": "html", "userAgent": "*" }, { "name": "follow", "value": null, "inHead": true, "source": "html", "userAgent": "*" }, { "name": "index", "value": null, "inHead": true, "source": "html", "userAgent": "googlebot" }, { "name": "follow", "value": null, "inHead": true, "source": "html", "userAgent": "googlebot" }, { "name": "max-video-preview", "value": "-1", "inHead": true, "source": "html", "userAgent": "googlebot" }, { "name": "max-image-preview", "value": "large", "inHead": true, "source": "html", "userAgent": "googlebot" }, { "name": "max-snippet", "value": "-1", "inHead": true, "source": "html", "userAgent": "googlebot" } ], "ignoredScopes": [], "trainingOptOut": [], "snippetBlocking": [] } ``` ### Serves its content without JavaScript ID: javascript-required; version: 4; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=javascript-required&version=4#javascript-required) The captured homepage HTML contains 1214 content words; completeness is not assessed\. ```json { "reason": "text-observed", "bodyWords": 1226, "truncated": false, "scriptCount": 28, "contentWords": 1214, "markupLength": 107165, "passWordThreshold": 120, "hasNoscriptFallback": false, "nontextElementCount": 134 } ``` ### Allows search and user\-fetch crawlers ID: ai-crawler-access; version: 5; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 25. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ai-crawler-access&version=5#ai-crawler-access) robots\.txt allows every known search and user\-fetch crawler to reach the homepage\. ```json { "path": "/", "capped": false, "blocked": [], "blockedCount": 0, "penaltyPoints": 0 } ``` ### Serves the homepage over HTTPS with HTTP 200 ID: homepage-availability; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 10. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=homepage-availability&version=2#homepage-availability) The homepage is served over HTTPS and returns HTTP 200\. ```json { "error": null, "secure": true, "status": 200, "finalUrl": "https://startupideasdb.com/", "requestedUrl": "https://startupideasdb.com" } ``` ### Provides a title and meta description ID: page-metadata; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=page-metadata&version=2#page-metadata) The homepage provides both a non\-empty title and meta description\. ```json { "title": "StartupIdeasDB — 12,000+ Validated Startup Ideas with AI Opportunity Scores", "titleCount": 1, "description": "Skip the brainstorming. Browse 12,000+ startup ideas validated from real Reddit, Hacker News, Upwork, App Store and Product Hunt complaints. Each idea has an AI opportunity score, market size, competition rating, and a 2,000-word execution roadmap.", "descriptionCount": 1 } ``` ### Reaches the homepage within two redirects ID: redirect-chain; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=redirect-chain&version=2#redirect-chain) The homepage is reached in 0 redirects\. ```json { "finalUrl": "https://startupideasdb.com/", "redirects": 0, "threshold": 2, "requestedUrl": "https://startupideasdb.com" } ``` ### Returns the homepage within three seconds ID: response-time; version: 2; kind: penalty; status: pass. Contribution: 0; maximum magnitude: 3. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=response-time&version=2#response-time) The homepage reached a plain crawler in 40 ms\. ```json { "durationMs": 40, "thresholdMs": 3000, "directAttempts": 1 } ``` ### Publishes an API catalog ID: api-catalog; version: 4; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=api-catalog&version=4#api-catalog) No API catalog published\. ```json { "wellKnown": { "status": 404, "problem": "absent", "profile": null, "contentType": null }, "advertisedVia": [] } ``` ### Publishes an auth\.md for agents ID: auth-md; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=auth-md&version=2#auth-md) No /auth\.md published\. ```json { "error": null, "reason": "absent", "status": 404, "contentType": "text/html" } ``` ### Lists an MCP server card in its AI Catalog ID: mcp-server-card; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=mcp-server-card&version=3#mcp-server-card) No AI Catalog published, so no MCP server card can be discovered\. ```json { "reason": "absent", "catalog": { "status": 404, "entries": 0, "problem": "absent", "contentType": null, "specVersion": null, "malformedEntries": 0 } } ``` ### Publishes an A2A Agent Card ID: a2a-agent-card; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=a2a-agent-card&version=3#a2a-agent-card) No A2A Agent Card at /\.well\-known/agent\-card\.json, and none listed in an AI Catalog\. ```json { "cards": [ { "via": "well-known", "name": null, "error": null, "notes": [], "shape": null, "skills": 0, "source": "https://startupideasdb.com/.well-known/agent-card.json", "status": 404, "usable": false, "problem": "absent", "version": null, "bindings": [], "identifier": null, "interfaces": [] } ], "reason": "absent", "catalog": { "status": 404, "entries": 0, "problem": "absent" }, "wellKnown": { "status": 404, "problem": "absent", "contentType": "text/html; charset=utf-8" } } ``` ### Publishes an Agent Skills index ID: agent-skills-index; version: 3; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=agent-skills-index&version=3#agent-skills-index) No usable Agent Skills index was found at either well\-known path or in the AI Catalog\. ```json { "reason": "absent", "catalog": { "status": 404, "problem": "absent", "individualSkills": 0 }, "indexes": [ { "via": "well-known", "error": null, "notes": [], "total": 0, "format": null, "issues": [], "schema": null, "source": "https://startupideasdb.com/.well-known/agent-skills/index.json", "status": 404, "usable": 0, "entries": [], "problem": "absent", "rejected": 0, "identifier": null }, { "via": "well-known", "error": null, "notes": [], "total": 0, "format": null, "issues": [], "schema": null, "source": "https://startupideasdb.com/.well-known/skills/index.json", "status": 404, "usable": 0, "entries": [], "problem": "absent", "rejected": 0, "identifier": null } ], "artifactVerification": "not-performed" } ``` ### Declares WebMCP tools for browser agents ID: webmcp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=webmcp&version=1#webmcp) No WebMCP declarations were found in the collected HTML or inline scripts\. External scripts were not inspected\. ```json { "pages": [ { "key": "homepage", "url": "https://startupideasdb.com/", "secure": true, "usable": 0, "truncated": false, "references": 0, "parseErrors": 0, "declarations": 0 }, { "key": "page:https://startupideasdb.com/blog/ai-agent-ideas", "url": "https://startupideasdb.com/blog/ai-agent-ideas", "secure": true, "usable": 0, "truncated": false, "references": 0, "parseErrors": 0, "declarations": 0 }, { "key": "page:https://startupideasdb.com/pricing", "url": "https://startupideasdb.com/pricing", "secure": true, "usable": 0, "truncated": false, "references": 0, "parseErrors": 0, "declarations": 0 }, { "key": "page:https://startupideasdb.com/blog", "url": "https://startupideasdb.com/blog", "secure": true, "usable": 0, "truncated": false, "references": 0, "parseErrors": 0, "declarations": 0 } ], "reason": "absent", "detection": "static", "pageCount": 4, "references": [], "parseErrors": 0, "usableCount": 0, "declarations": [], "referenceCount": 0, "declarationCount": 0, "runtimeVerification": "not-performed" } ``` ### Publishes a Web Bot Auth key directory ID: web-bot-auth; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=web-bot-auth&version=2#web-bot-auth) No Web Bot Auth key directory at /\.well\-known/http\-message\-signatures\-directory\. ```json { "keys": { "total": 0, "sample": [], "usable": 0, "testKeys": 0, "evaluated": 0, "privateMaterial": 0 }, "notes": [ "media-type", "unsigned" ], "shape": null, "reason": "absent", "signature": { "total": 0, "status": "absent", "ignored": 0, "coverage": null, "malformed": false, "signatures": [] }, "wellKnown": { "status": 404, "problem": "absent", "finalUrl": "https://startupideasdb.com/.well-known/http-message-signatures-directory", "redirects": 0, "contentType": null }, "extraMembers": [], "signatureAgent": "https://startupideasdb.com" } ``` ### Accepts agent payments with x402 or MPP ID: x402-mpp; version: 2; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=x402-mpp&version=2#x402-mpp) No HTTP 402 payment challenge on the homepage or robots\.txt, and no manifest at /\.well\-known/x402\. ```json { "reason": "absent", "manifest": { "kind": null, "notes": [], "shape": null, "status": 404, "problem": "absent", "finalUrl": "https://startupideasdb.com/.well-known/x402", "resources": { "total": 0, "sample": [], "skipped": {}, "eligible": 0, "examined": 0 }, "contentType": null }, "protocols": [], "responses": [], "verification": null, "paymentVerification": "not-performed" } ``` ### Publishes ACP discovery metadata ID: acp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=acp&version=1#acp) No ACP discovery declaration established at /\.well\-known/acp\.json\. ```json { "api": false, "key": "well-known-acp", "issues": [], "marked": false, "reason": "absent", "status": 404, "usable": false, "problem": "absent", "version": null, "commerce": false, "services": [], "transports": [], "capabilities": [], "transactionVerification": "not-performed" } ``` ### Publishes UCP discovery metadata ID: ucp; version: 1; kind: capability; status: na. Contribution: 0; maximum magnitude: 0. [Current methodology](https://goodforbots.com/standards?rubric=0.9.0&check=ucp&version=1#ucp) No UCP discovery declaration established at /\.well\-known/ucp\. ```json { "api": false, "key": "well-known-ucp", "issues": [], "marked": false, "reason": "absent", "status": 404, "usable": false, "problem": "absent", "version": null, "commerce": false, "services": [], "transports": [], "capabilities": [], "transactionVerification": "not-performed" } ``` ## Observations ### robots ```json { "status": 200, "contentType": "text/plain", "bodyHash": "2969e65449c0ba22d5b8b03f2d0f5de9c5f88483a77e35381961e692551d2b22", "error": null, "durationMs": 806, "key": "robots", "url": "https://startupideasdb.com/robots.txt", "finalUrl": "https://startupideasdb.com/robots.txt", "rung": "direct", "redirects": 0, "byteLength": 358, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/plain", "bodyHash": "2969e65449c0ba22d5b8b03f2d0f5de9c5f88483a77e35381961e692551d2b22", "error": null, "durationMs": 806, "rung": "direct", "reason": null } ] } ``` ### homepage ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "3afad4bd1d2136c2bb5acd7dcd8e72f843292928e46ef196f0d2139a63da0dff", "error": null, "durationMs": 40, "key": "homepage", "url": "https://startupideasdb.com", "finalUrl": "https://startupideasdb.com/", "rung": "direct", "redirects": 0, "byteLength": 107210, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "4a63220a3ef8d7b806e41dc6b98f39f3ad6f5fc0a8feac2a8b77edd7ea9e3e0a", "error": null, "durationMs": 40, "rung": "direct", "reason": null } ] } ``` ### llms\-txt ```json { "status": 200, "contentType": "text/plain", "bodyHash": "9568a16e1850cb0cad8cf5cf02a2c07e467bf8ff30e48d596dc18f7a1a7c1c21", "error": null, "durationMs": 39, "key": "llms-txt", "url": "https://startupideasdb.com/llms.txt", "finalUrl": "https://startupideasdb.com/llms.txt", "rung": "direct", "redirects": 0, "byteLength": 7835, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/plain", "bodyHash": "9568a16e1850cb0cad8cf5cf02a2c07e467bf8ff30e48d596dc18f7a1a7c1c21", "error": null, "durationMs": 39, "rung": "direct", "reason": null } ] } ``` ### llms\-full\-txt ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "991fa350a21e22ceb1d0ac4adf4155a16f9e8bba57de1d5cccc1f24348418cc3", "error": null, "durationMs": 198, "key": "llms-full-txt", "url": "https://startupideasdb.com/llms-full.txt", "finalUrl": "https://startupideasdb.com/llms-full.txt", "rung": "direct", "redirects": 0, "byteLength": 29944, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "559e30ded5344fcd0e94a7bd44bf75cc5e79a5281c6a3b0b39041f2ad77c8f96", "error": null, "durationMs": 198, "rung": "direct", "reason": null } ] } ``` ### markdown\-negotiation ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "3afad4bd1d2136c2bb5acd7dcd8e72f843292928e46ef196f0d2139a63da0dff", "error": null, "durationMs": 42, "key": "markdown-negotiation", "url": "https://startupideasdb.com", "finalUrl": "https://startupideasdb.com/", "rung": "direct", "redirects": 0, "byteLength": 107210, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "4a63220a3ef8d7b806e41dc6b98f39f3ad6f5fc0a8feac2a8b77edd7ea9e3e0a", "error": null, "durationMs": 42, "rung": "direct", "reason": null } ] } ``` ### sitemap:https://startupideasdb\.com/sitemap\.xml ```json { "status": 200, "contentType": "application/xml", "bodyHash": "3f72ddef0b642e70a74e0f4fb55f2426480a93d7a886d8af27827682264bbcc7", "error": null, "durationMs": 501, "key": "sitemap:https://startupideasdb.com/sitemap.xml", "url": "https://startupideasdb.com/sitemap.xml", "finalUrl": "https://startupideasdb.com/sitemap.xml", "rung": "direct", "redirects": 0, "byteLength": 34298, "truncated": false, "attempts": [ { "status": 200, "contentType": "application/xml", "bodyHash": "848907eede81f4a9248f906217a6a602e74c4f3a3ec205b99ffc535b9616bcdd", "error": null, "durationMs": 501, "rung": "direct", "reason": null } ] } ``` ### well\-known\-api\-catalog ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "b3e2a95d0d7e961d6255d63835820149263de34809dcee57822acbab1e35b0d3", "error": null, "durationMs": 71, "key": "well-known-api-catalog", "url": "https://startupideasdb.com/.well-known/api-catalog", "finalUrl": "https://startupideasdb.com/.well-known/api-catalog", "rung": "direct", "redirects": 0, "byteLength": 29971, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "707c229413420496af7f1037bacc636c86d7a2730b41f0507cc9a7dc533d3d08", "error": null, "durationMs": 71, "rung": "direct", "reason": null } ] } ``` ### well\-known\-ai\-catalog ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "bb133654e7e64897a9e317454961c7382e5581e37f78492f8219eeffb340593c", "error": null, "durationMs": 72, "key": "well-known-ai-catalog", "url": "https://startupideasdb.com/.well-known/ai-catalog.json", "finalUrl": "https://startupideasdb.com/.well-known/ai-catalog.json", "rung": "direct", "redirects": 0, "byteLength": 29975, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "cd508ebb2b3dbfa1da5acecac5e86e64ab4fd6648a0ddd0de13266d075a8afff", "error": null, "durationMs": 72, "rung": "direct", "reason": null } ] } ``` ### well\-known\-agent\-card ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "fcff380f67a4a1d46a6632b82f81e3d64c4eb7c1da15b96c437d150f925384e5", "error": null, "durationMs": 97, "key": "well-known-agent-card", "url": "https://startupideasdb.com/.well-known/agent-card.json", "finalUrl": "https://startupideasdb.com/.well-known/agent-card.json", "rung": "direct", "redirects": 0, "byteLength": 29975, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "278c05e2ff4b3f0cf0997a75a3983bf4fc66c905d964580d1f8fc05a5f6f60b3", "error": null, "durationMs": 97, "rung": "direct", "reason": null } ] } ``` ### well\-known\-agent\-skills ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "2a1adc492753bd76126ae4c8cfd14e58a33c33840c8396e2299e6f19709f3b78", "error": null, "durationMs": 63, "key": "well-known-agent-skills", "url": "https://startupideasdb.com/.well-known/agent-skills/index.json", "finalUrl": "https://startupideasdb.com/.well-known/agent-skills/index.json", "rung": "direct", "redirects": 0, "byteLength": 29987, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "ba087b5d0950394cba5e154b5fdeb2bdfd410de51e6d933ff25f806b681f554c", "error": null, "durationMs": 63, "rung": "direct", "reason": null } ] } ``` ### well\-known\-skills ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "67699db67b497df3407f92f2de1b0cbbeb81740ccca471c17f76475eea050cd4", "error": null, "durationMs": 55, "key": "well-known-skills", "url": "https://startupideasdb.com/.well-known/skills/index.json", "finalUrl": "https://startupideasdb.com/.well-known/skills/index.json", "rung": "direct", "redirects": 0, "byteLength": 29981, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "98120d47292a12ec84b5c81c48e44bb973b194bddaf3f757f08c16b95dca5965", "error": null, "durationMs": 55, "rung": "direct", "reason": null } ] } ``` ### well\-known\-http\-message\-signatures\-directory ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "22bcf96041b082d43b94a67b7b6133ffe8a944f5d4e20a1b8dc2f20077775e1f", "error": null, "durationMs": 61, "key": "well-known-http-message-signatures-directory", "url": "https://startupideasdb.com/.well-known/http-message-signatures-directory", "finalUrl": "https://startupideasdb.com/.well-known/http-message-signatures-directory", "rung": "direct", "redirects": 0, "byteLength": 29993, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "d00bc1c89b04351e40f860618263cb88760d89a65a2ce0d315ceb2e31fcce6e4", "error": null, "durationMs": 61, "rung": "direct", "reason": null } ] } ``` ### well\-known\-x402 ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "8e0272a8449866255bbeec63c0f8d9885f0f91cca3f743627a8fcada3ad5cc64", "error": null, "durationMs": 55, "key": "well-known-x402", "url": "https://startupideasdb.com/.well-known/x402", "finalUrl": "https://startupideasdb.com/.well-known/x402", "rung": "direct", "redirects": 0, "byteLength": 29964, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "d5cc7ef045e2b60144b6dfe30df8867d3b7bcf15fbbd0deb817d470ade6530ce", "error": null, "durationMs": 55, "rung": "direct", "reason": null } ] } ``` ### well\-known\-acp ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "89bda173122bf86628ea0d5a68cfad2779e27ad874a4fd8e2a594a74c3c53c6e", "error": null, "durationMs": 61, "key": "well-known-acp", "url": "https://startupideasdb.com/.well-known/acp.json", "finalUrl": "https://startupideasdb.com/.well-known/acp.json", "rung": "direct", "redirects": 0, "byteLength": 29968, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "3129d9041fcc738161c10e4590e6d4ce7de328a9b908bcdf566c90828cd59354", "error": null, "durationMs": 61, "rung": "direct", "reason": null } ] } ``` ### well\-known\-ucp ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "7c004e851d3dc0be38c433301968ce245004a1db78b417475e3a67d952ba7fd6", "error": null, "durationMs": 63, "key": "well-known-ucp", "url": "https://startupideasdb.com/.well-known/ucp", "finalUrl": "https://startupideasdb.com/.well-known/ucp", "rung": "direct", "redirects": 0, "byteLength": 29963, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "8f524a250f9b8aac0b164c618f5a60dabcfeec7f1ed6b01c48602a1484f15719", "error": null, "durationMs": 63, "rung": "direct", "reason": null } ] } ``` ### auth\-md ```json { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "39213dc6454c488410e39d24ec4bd8bd588c33fac977492c666561ab4044981e", "error": null, "durationMs": 55, "key": "auth-md", "url": "https://startupideasdb.com/auth.md", "finalUrl": "https://startupideasdb.com/auth.md", "rung": "direct", "redirects": 0, "byteLength": 29938, "truncated": false, "attempts": [ { "status": 404, "contentType": "text/html; charset=utf-8", "bodyHash": "b0b4bbc0d462017e8397c0433cc9af40e007db3fb599a979d20c65124f22ed6e", "error": null, "durationMs": 55, "rung": "direct", "reason": null } ] } ``` ### page:https://startupideasdb\.com/blog/ai\-agent\-ideas ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "2c2e6a4654d1404fa9dff2282eca061d556d6f34eb553cbc615064e55857155b", "error": null, "durationMs": 152, "key": "page:https://startupideasdb.com/blog/ai-agent-ideas", "url": "https://startupideasdb.com/blog/ai-agent-ideas", "finalUrl": "https://startupideasdb.com/blog/ai-agent-ideas", "rung": "direct", "redirects": 0, "byteLength": 117899, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "2d436c7363e98231ff00ba93aa9c63005c257aee9e48feda4983e69f6cffbc42", "error": null, "durationMs": 152, "rung": "direct", "reason": null } ] } ``` ### page:https://startupideasdb\.com/pricing ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "ea5f303d16b548ab468ccc8dd248534853bc081fc2f024ad6f613e8faa56a2b6", "error": null, "durationMs": 39, "key": "page:https://startupideasdb.com/pricing", "url": "https://startupideasdb.com/pricing", "finalUrl": "https://startupideasdb.com/pricing", "rung": "direct", "redirects": 0, "byteLength": 68656, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "7df19425d6f3f323c05a55af8ce9c5114ebda66106843bca42be39276bea91ca", "error": null, "durationMs": 39, "rung": "direct", "reason": null } ] } ``` ### page:https://startupideasdb\.com/blog ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "5555d5b3f3887c824a095c4c0c09f21578004c47c4c08820ee215daafac864a5", "error": null, "durationMs": 47, "key": "page:https://startupideasdb.com/blog", "url": "https://startupideasdb.com/blog", "finalUrl": "https://startupideasdb.com/blog", "rung": "direct", "redirects": 0, "byteLength": 286657, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "61d262075cdc5902ac82add061b72bdc11735554d46e0dcd1c888a7bb48be83b", "error": null, "durationMs": 47, "rung": "direct", "reason": null } ] } ``` ### page\-markdown:https://startupideasdb\.com/blog/ai\-agent\-ideas ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "2c2e6a4654d1404fa9dff2282eca061d556d6f34eb553cbc615064e55857155b", "error": null, "durationMs": 37, "key": "page-markdown:https://startupideasdb.com/blog/ai-agent-ideas", "url": "https://startupideasdb.com/blog/ai-agent-ideas", "finalUrl": "https://startupideasdb.com/blog/ai-agent-ideas", "rung": "direct", "redirects": 0, "byteLength": 117899, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "2d436c7363e98231ff00ba93aa9c63005c257aee9e48feda4983e69f6cffbc42", "error": null, "durationMs": 37, "rung": "direct", "reason": null } ] } ``` ### page\-markdown:https://startupideasdb\.com/pricing ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "ea5f303d16b548ab468ccc8dd248534853bc081fc2f024ad6f613e8faa56a2b6", "error": null, "durationMs": 61, "key": "page-markdown:https://startupideasdb.com/pricing", "url": "https://startupideasdb.com/pricing", "finalUrl": "https://startupideasdb.com/pricing", "rung": "direct", "redirects": 0, "byteLength": 68656, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "7df19425d6f3f323c05a55af8ce9c5114ebda66106843bca42be39276bea91ca", "error": null, "durationMs": 61, "rung": "direct", "reason": null } ] } ``` ### page\-markdown:https://startupideasdb\.com/blog ```json { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "5555d5b3f3887c824a095c4c0c09f21578004c47c4c08820ee215daafac864a5", "error": null, "durationMs": 43, "key": "page-markdown:https://startupideasdb.com/blog", "url": "https://startupideasdb.com/blog", "finalUrl": "https://startupideasdb.com/blog", "rung": "direct", "redirects": 0, "byteLength": 286657, "truncated": false, "attempts": [ { "status": 200, "contentType": "text/html; charset=utf-8", "bodyHash": "61d262075cdc5902ac82add061b72bdc11735554d46e0dcd1c888a7bb48be83b", "error": null, "durationMs": 43, "rung": "direct", "reason": null } ] } ``` ## Fixes Showing 3 of 19 fixes. ### Serve Markdown at its own URL Recoverable contribution: 12.5 points. Score with this fix and the ones above it: 54/100. No /llms\-full\.txt and no markdown versions linked from llms\.txt\. ````text My website startupideasdb.com scored 41/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: serve the content as markdown at its own URLs. The check it fails is "Serves markdown at its own URL", worth 12.5 points. What the scanner saw: No /llms-full.txt and no markdown versions linked from llms.txt. A model that can only reach this site's content through HTML pays to parse markup and loses structure doing it: navigation, cookie banners and script tags arrive alongside the prose, and headings, tables and code blocks come out flattened. Markdown at its own address removes HTML from the path entirely: what is fetched is the content and nothing else. Two routes satisfy this, and it is worth being clear about which one the specification asks for. llmstxt.org asks for a markdown version of each page **at the same URL as the original**, either with `.md` appended (`page.html.md`) or with the extension replaced (`page.md`). `llms-full.txt`, the single bundle holding everything, does not appear in the specification at all. It is a community convention that grew up around it and is now widespread. Both are accepted here. The per-page form is the one the document asks for. Either of these passes: - **The bundle.** `/llms-full.txt`, one document, real markdown rather than HTML, carrying the site's actual content rather than a placeholder. - **Per-page mirrors.** A markdown twin for each page at `page.md` or `page.html.md`, **and linked from `/llms.txt`**. That second half is load-bearing: mirrors are counted from the links in the index, so twins that nothing points at are invisible to this scan and, more to the point, to anything crawling the site. For the mirror route, the index carries them as ordinary link lines: ```markdown ## Docs - [Quickstart](/docs/quickstart.md): create an account and take a first payment - [Concepts](/docs/concepts.md): customers, subscriptions, invoices and proration - [Webhooks](/docs/webhooks.md): events, signature verification, retry schedule ``` Both `/docs/quickstart` and `/docs/quickstart.md` have to answer 200: the HTML for people, the markdown for everything else. Serving markdown through content negotiation does **not** satisfy this, and that is deliberate rather than an oversight. A negotiated response only exists for a client that knows to send `Accept: text/markdown`, and most crawlers send no preference at all. A `.md` address sits in the open: it is found by ordinary crawling, it can be linked to, and it can be cited. If this site already negotiates markdown, the report says so in these words: *"Markdown is served on request, but not at any URL a crawler would find on its own"*. That is a different check passing on its own terms, not a contradiction. Four things about how this is measured. The bundle is judged by size, by being markdown rather than a page or JSON, and by not merely repeating `llms.txt`; its content is never sampled beyond that, so a couple of kilobytes of boilerplate would pass. Do not take that as permission, since the point of the file is the content in it. `.mdx` counts as markdown although the specification names only `.md`, because excluding it would punish a large part of the documentation ecosystem for its toolchain. The number of mirrors we want before calling it a convention on this site is our judgement, not the specification's. And the mirror URLs listed in the index are counted, never fetched, so a list of `.md` addresses that 404 passes this check and helps nobody at all. The whole report, as markdown, is at https://goodforbots.com/r/startupideasdb.com.md?scan=cmushctbh00q901o0i55u59p1. Read it first: this prompt covers one finding, and the report has everything the scan saw. When you are done, summarise what you changed and how to check it against a running instance. Do not try to run the Good for Bots scan yourself: it only sees what is already deployed, it is rate-limited, and re-running it is the site owner's call once the change ships. ```` ### Serve Markdown when asked for it Recoverable contribution: 10 points. Score with this fix and the ones above it: 64/100. None of the 4 pages read pass\. Asking the homepage for markdown still returns text/html\. ```text My website startupideasdb.com scored 41/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: serve markdown through content negotiation on all public HTML routes. The check it fails is "Serves markdown when asked for it", worth 10 points. What the scanner saw: None of the 4 pages read pass. Asking the homepage for markdown still returns text/html. The scan checked a sample of 4 pages. It does not establish which other pages have the same issues. Use the findings below to locate the responsible templates, components or configuration, and apply the fix wherever the same issue occurs. Pages in the sample with findings: - https://startupideasdb.com/: Asking the homepage for markdown still returns text/html. - https://startupideasdb.com/blog/ai-agent-ideas: Asking the page at /blog/ai-agent-ideas for markdown still returns text/html. - https://startupideasdb.com/pricing: Asking the page at /pricing for markdown still returns text/html. - https://startupideasdb.com/blog: Asking the page at /blog for markdown still returns text/html. Implement content negotiation across all public HTML routes, including page types outside the scan's sample. Put it in the shared response handling or the handlers for each page type, so new pages receive it too. Agents need the content of any page they follow, including pages the report did not name. When a request arrives with `text/markdown` in its `Accept` header, the same URL that serves HTML to a browser should return a markdown rendering of that page's content. Requests without that header must keep getting the HTML exactly as they do now. The response must: - set `Content-Type: text/markdown; charset=utf-8`; - include `Accept` in the `Vary` header, so shared caches never serve the markdown to a browser or the HTML to an agent (RFC 9110 says a server SHOULD send `Vary` whenever the representation depends on a request header); - contain real markdown, not HTML with a different header on it; - drop `ETag` and `Last-Modified` for the converted response, since a conditional request cannot be honoured against a body generated on the fly. Work out how to do this in whatever stack this project uses. If the site is behind Cloudflare on a paid plan, the "Markdown for Agents" zone setting does all of the above and is the least invasive option. Otherwise implement it in the framework: middleware inspecting the `Accept` header, a route handler that returns the markdown source, or whatever fits the architecture here. Strip navigation, headers, footers and cookie banners from the markdown. The point is the content, without the page furniture around it. Verify HTML and Markdown responses for each public page type, including URLs outside the reported sample. Check that each Markdown response contains that page's content and that ordinary browser requests still receive HTML. The whole report, as markdown, is at https://goodforbots.com/r/startupideasdb.com.md?scan=cmushctbh00q901o0i55u59p1. Read it first: this prompt covers one finding, and the report has everything the scan saw. When you are done, summarise what you changed and how to check it against a running instance. Do not try to run the Good for Bots scan yourself: it only sees what is already deployed, it is rate-limited, and re-running it is the site owner's call once the change ships. ``` ### Describe the site with schema\.org JSON\-LD Recoverable contribution: 8.93 points. Score with this fix and the ones above it: 73/100. 2 of 4 pages read pass\. The homepage publishes no structured data at all: no JSON\-LD, no microdata, no RDFa\. ````text My website startupideasdb.com scored 41/100 on Good for Bots (Poor). Good for Bots measures one thing: whether a language model can read a site and cite it. I need you to: describe the pages with schema.org JSON-LD. The check it fails is "Describes itself to machines with schema.org JSON-LD", worth 8.93 points. What the scanner saw: 2 of 4 pages read pass. The homepage publishes no structured data at all: no JSON-LD, no microdata, no RDFa. The scan checked a sample of 4 pages. It does not establish which other pages have the same issues. Use the findings below to locate the responsible templates, components or configuration, and apply the fix wherever the same issue occurs. Pages in the sample with findings: - https://startupideasdb.com/: The homepage publishes no structured data at all: no JSON-LD, no microdata, no RDFa. - https://startupideasdb.com/pricing: The page at /pricing publishes no structured data at all: no JSON-LD, no microdata, no RDFa. The pages identified as having no structured data need markup added through their templates. Review the other public page types for the same gap. Use the homepage example below where it fits, and describe each content page with types that match its visible content. A passing homepage does not need its markup replaced. Review structured data across the site's public page types, including those outside the reported sample. Add or repair it in the templates that generate each type, using that page's content. Verify a page from each template and keep existing valid markup. Structured data gives a reader explicit names, types and relationships for the entities the page describes. Put a ` ``` The addresses in that example are this site's. The names are not. Replace `Example Corp` with the organisation's real name, which is the one thing here that cannot be filled in from the outside. Work out how to generate this in whatever stack this project uses, from the same data that renders the page, so the two cannot drift apart. Two mistakes account for most broken structured data in the wild. Avoid both: 1. **Do not let the template escape the JSON.** A templating engine that escapes variables by default will turn every `"` into `"`, and the block will look perfectly correct in the page source while no consumer on earth can parse it, because HTML entities inside a `