Skip to content
Good for Bots

Directory of direct-to-consumer brands with shipping, returns and pricing details

Good for Bots: Fair, 63 of 100Get this badge →

On your homepage, it turns this report’s link to dtcify.com dofollow.

Scanned
Tags
RetailB2C

What is DTCify?

DTCify is a directory of direct-to-consumer brands, presented as a curated listing of independent brands, ecommerce tools and the stories behind them. According to its llms.txt and meta description, each brand profile summarizes facts collected from the brand's official public pages, including what it sells, price range, shipping, returns, warranty, subscriptions, customer support and where to buy. The site is aimed at founders, marketers and online shoppers. It offers a browsable category list, and brand owners can submit a brand or claim an existing listing. The meta description states that the directory holds more than 3,000 brands.

Through a bot’s eyes

“DTCify is a curated directory of direct-to-consumer brands, with profiles summarizing shipping, returns, pricing and customer support details collected from brands' official public pages.”

Simulated from the response GoodForBotsBot received on , not a live answer from any AI assistant.

What it can read, and what stays hidden →

What a bot can read

A model reading this homepage learns that DTCify is a directory organized by category. The page lists brand names under headings such as Apparel & Accessories, Beauty & Personal Care, Home & Garden, Food & Beverage, Health & Wellness, Electronics & Smart Home, Sports & Outdoors and Baby & Kids, each linked to a category page. The body text contains calls to action for browsing categories and collections and for submitting or claiming a brand. The homepage text does not itself state prices, shipping or return terms for any brand; those topics appear only in the meta description as a general description of the profiles. The llms.txt file adds a section map, describes the profile fields in more detail and links About, Terms, Privacy and sitemap pages. The JSON-LD adds a WebSite and Organization record with the site description, a contact email and two social profile links. The homepage text is truncated, so the listing shown is partial.

What stays hidden

A model reading only this input cannot tell which individual brands have which shipping, return or price terms, because no brand profile was read. It cannot tell how brands are selected for the 3,000-plus listings, whether brands pay for listings or features, or who runs the company beyond the listed email and social links.

Good for Bots report

DTCify scores 63 of 100: 40 of the 50 base points, 23 of the 50 agent-layer points, no penalties.

Earned

40 of the 50 base points above the line, 23 of the 50 agent-layer points below it.

63

Still open

Behind the checks below, with prompts in Pro.

6
Penalties0
How scoring works · current methodology →

For the owner of dtcify.com

3 prompts, 31 points

They are in the owner view, ready to paste into Claude Code, Cursor or Codex, beside the badge and rescans.

Open the owner view →

Select a check to see what we found and how it is graded.

Readable base

40.4 / 50

Passes.

3.3 of 3.3 points.

robots.txt is valid, with 34 user-agent groups.

Passes.

8.3 of 8.3 points.

Sitemap declared in robots.txt, listing at least 200 URLs.

Fails.

0 of 8.3 points.

1 of 4 pages read pass. The page at /category publishes no structured data at all: no JSON-LD, no microdata, no RDFa.

Passes.

10 of 10 points.

All 4 pages read pass. The homepage marks its content root, its heading outline and its landmarks.

Passes.

8.3 of 8.3 points.

16 of 16 assessed homepage navigation links expose usable destinations.

Passes.

4.2 of 4.2 points.

583 of 583 assessed homepage links and buttons have a nonempty accessible name.

Passes.

2.5 of 2.5 points.

1 of 1 assessed homepage form fields meet the static naming and field-semantics checks.

Half passes.

1.3 of 2.5 points.

595 of 596 assessed homepage controls and role declarations meet the static role, state and relationship checks.

Prompt in Pro →
Passes.

1.7 of 1.7 points.

All 4 pages read pass. The homepage declares itself as its canonical URL.

Agent layer

22.5 / 50

Passes.

11.3 of 11.3 points.

/llms.txt is well formed: 9 links across 2 sections.

Half passes.

3.8 of 7.5 points.

/llms.txt is partly descriptive: only 56% of links carry a description.

Prompt in Pro →
Fails.

0 of 12.5 points.

No /llms-full.txt and no markdown versions linked from llms.txt.

Fails.

0 of 10 points.

None of the 4 pages read pass. Asking the homepage for markdown still returns text/html.

Passes.

5 of 5 points.

States a position on 15 AI crawlers, across 3 purposes (training, search, user-fetch).

Passes.

2.5 of 2.5 points.

Declares AI usage preferences via Content-Signal (robots.txt): ai-train, search.

Penalties

− 0

Passes.

Penalty: 0 of 15 points.

Our crawler reaches the page without being challenged.

Passes.

Penalty: 0 of 20 points.

Nothing on the homepage tells a crawler to skip it or to withhold its snippet.

Passes.

Penalty: 0 of 25 points.

The captured homepage HTML contains 774 content words; completeness is not assessed.

Passes.

Penalty: 0 of 25 points.

robots.txt allows every known search and user-fetch crawler to reach the homepage.

Passes.

Penalty: 0 of 10 points.

The homepage is served over HTTPS and returns HTTP 200.

Passes.

Penalty: 0 of 3 points.

The homepage provides both a non-empty title and meta description.

Passes.

Penalty: 0 of 3 points.

The homepage is reached in 0 redirects.

Passes.

Penalty: 0 of 3 points.

The homepage reached a plain crawler in 1313 ms.

Agent capabilities

0 of 11 · no points

Each one found adds +1 to the badge.

Not applicable.

Adds +1 to the badge when found.

No API catalog published.

Not applicable.

Adds +1 to the badge when found.

/auth.md returns an HTML page rather than a markdown document.

Not applicable.

Adds +1 to the badge when found.

No AI Catalog published, so no MCP server card can be discovered.

Not applicable.

Adds +1 to the badge when found.

No A2A Agent Card at /.well-known/agent-card.json, and none listed in an AI Catalog.

Not applicable.

Adds +1 to the badge when found.

No usable Agent Skills index was found at either well-known path or in the AI Catalog.

Not applicable.

Adds +1 to the badge when found.

No WebMCP declarations were found in the collected HTML or inline scripts. External scripts were not inspected.

Not applicable.

Adds +1 to the badge when found.

No Web Bot Auth key directory at /.well-known/http-message-signatures-directory.

Not applicable.

Adds +1 to the badge when found.

No HTTP 402 payment challenge on the homepage or robots.txt, and no manifest at /.well-known/x402.

Not applicable.

Adds +1 to the badge when found.

No ACP discovery declaration established at /.well-known/acp.json.

Not applicable.

Adds +1 to the badge when found.

No UCP discovery declaration established at /.well-known/ucp.

Not applicable.

Adds +1 to the badge when found.

No public AMP discovery declaration established. Private or hidden agents may not advertise one to our crawler.

Site profile

Login
Detected
A sign-in button in the page header
API
Not established
Commerce
Not established

It decides which conditional checks apply. “Not established” means no proof in what we read, not proof of absence.

Access & usage policy

Who can read this page, and for what purpose?

GoodForBotsBot received HTTP 200 via a direct request. No indexing restriction was observed in the supported homepage directives.

Sampled URL: https://dtcify.com/

Measured, our crawler
HTTP 200
GoodForBotsBot received HTTP 200 via a direct request.
Search and user-fetch crawlers refused
0 of 20
robots.txt refuses none of them.
Training crawlers refused
5
MistralAI-Training, KimiBot, Meta-ExternalAgent and 2 more. Refusing training never changes the score.

Crawlers and what robots.txt declares for them

Rules for the sampled URL, read the way RFC 9309 reads them. These are declarations, not access tests.

Crawlers and what robots.txt declares for them on the sampled URL
CrawlerPurposeDeclared accessScore effectRule that applies
Our crawler, measured
GoodForBotsBotGood for BotsSite diagnosticsFetchedHTTP 200, directNot scoredrobots.txt admitted our crawler
Search and AI answers
OAI-SearchBotOpenAIAI searchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
Claude-SearchBotAnthropicAI searchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
PerplexityBotPerplexityAI searchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
GooglebotGoogleSearchAllowedNot scoredNot named; User-agent: * applies
DiffbotDiffbotSearchRefusedNot scoredUser-agent: diffbot Disallow: /
, all allowed
Fetches a person asked for
ChatGPT-UserOpenAIUser fetchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
Claude-UserAnthropicUser fetchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
Perplexity-UserPerplexityUser fetchAllowedNoneUser-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: /
, all allowed
Model training, never scored
GPTBotOpenAIAI trainingAllowedNoneUser-agent: gptbot User-agent: oai-searchbot User-agent: chatgpt-user User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Disallow: / Allow: /
ClaudeBotAnthropicAI trainingAllowedNoneUser-agent: claudebot User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Disallow: / Allow: /
MistralAI-TrainingMistralAI trainingRefusedNone: training opt-outs are neutralUser-agent: mistralai-training Disallow: /
KimiBotMoonshot AIAI trainingRefusedNone: training opt-outs are neutralUser-agent: kimibot Disallow: /
Applebot-ExtendedAppleAI trainingAllowedNoneUser-agent: applebot-extended User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended Disallow: / Allow: /
Google-ExtendedGoogleAI training, GroundingAllowedNoneUser-agent: google-extended User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: applebot-extended Disallow: / Allow: /
Meta-ExternalAgentMetaAI training, Product improvementRefusedNone: training opt-outs are neutralUser-agent: meta-externalagent Disallow: /
AmazonbotAmazonAI training, Product improvementRefusedNone: training opt-outs are neutralUser-agent: amazonbot Disallow: /
CCBotCommon CrawlOpen dataset, AI trainingRefusedNone: training opt-outs are neutralUser-agent: ccbot Disallow: /
, all allowed
Agents, extraction and others
bytespiderUnspecifiedNot establishedRefusedNot scoredUser-agent: bytespider Disallow: /
omgiliUnspecifiedNot establishedRefusedNot scoredUser-agent: omgili Disallow: /
anthropic-aiUnspecifiedNot establishedRefusedNot scoredUser-agent: anthropic-ai Disallow: /
claude-webUnspecifiedNot establishedRefusedNot scoredUser-agent: claude-web Disallow: /
cohere-aiUnspecifiedNot establishedRefusedNot scoredUser-agent: cohere-ai Disallow: /
googleotherUnspecifiedNot establishedRefusedNot scoredUser-agent: googleother Disallow: /
baiduspiderUnspecifiedNot establishedRefusedNot scoredUser-agent: baiduspider Disallow: /
petalbotUnspecifiedNot establishedRefusedNot scoredUser-agent: petalbot Disallow: /
awariosmartbotUnspecifiedNot establishedRefusedNot scoredUser-agent: awariosmartbot User-agent: awariorssbot Disallow: /
awariorssbotUnspecifiedNot establishedRefusedNot scoredUser-agent: awariosmartbot User-agent: awariorssbot Disallow: /
Google-CloudVertexBotGoogleExtractionRefusedNot scoredUser-agent: google-cloudvertexbot Disallow: /
qualifiedbotUnspecifiedNot establishedRefusedNot scoredUser-agent: qualifiedbot Disallow: /
cotoyogiUnspecifiedNot establishedRefusedNot scoredUser-agent: cotoyogi Disallow: /
icc-crawlerUnspecifiedNot establishedRefusedNot scoredUser-agent: icc-crawler Disallow: /
atlassian-botUnspecifiedNot establishedRefusedNot scoredUser-agent: atlassian-bot Disallow: /
fishbotUnspecifiedNot establishedRefusedNot scoredUser-agent: fishbot Disallow: /
borderxbotUnspecifiedNot establishedRefusedNot scoredUser-agent: borderxbot Disallow: /
navubotUnspecifiedNot establishedRefusedNot scoredUser-agent: navubot Disallow: /
semrushbot-swaUnspecifiedNot establishedRefusedNot scoredUser-agent: semrushbot-swa Disallow: /
wardbotUnspecifiedNot establishedRefusedNot scoredUser-agent: wardbot Disallow: /
magpie-crawlerUnspecifiedNot establishedRefusedNot scoredUser-agent: magpie-crawler Disallow: /
citibotsitecrawlerUnspecifiedNot establishedRefusedNot scoredUser-agent: citibotsitecrawler Disallow: /
, all allowed

The robots.txt groups behind this table

User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: /

User-agent: gptbot
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Disallow: /
Allow: /

User-agent: claudebot
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Disallow: /
Allow: /

User-agent: mistralai-training
Disallow: /

User-agent: kimibot
Disallow: /

User-agent: applebot-extended
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
Disallow: /
Allow: /

User-agent: google-extended
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: applebot-extended
Disallow: /
Allow: /

User-agent: meta-externalagent
Disallow: /

User-agent: amazonbot
Disallow: /

User-agent: ccbot
Disallow: /

User-agent: bytespider
Disallow: /

User-agent: diffbot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: claude-web
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: googleother
Disallow: /

User-agent: baiduspider
Disallow: /

User-agent: petalbot
Disallow: /

User-agent: awariosmartbot
User-agent: awariorssbot
Disallow: /

User-agent: google-cloudvertexbot
Disallow: /

User-agent: qualifiedbot
Disallow: /

User-agent: cotoyogi
Disallow: /

User-agent: icc-crawler
Disallow: /

User-agent: atlassian-bot
Disallow: /

User-agent: fishbot
Disallow: /

User-agent: borderxbot
Disallow: /

User-agent: navubot
Disallow: /

User-agent: semrushbot-swa
Disallow: /

User-agent: wardbot
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-agent: citibotsitecrawler
Disallow: /

User-agent: *
Allow: /
Allow: /

https://dtcify.com/robots.txt

How to read this table

Each row says what robots.txt asks of that crawler. It does not show whether the crawler obeys, or how a firewall treats it. We measured only our own request.

Refusing search or user-fetch crawlers costs points under AI crawler access. Refusing training crawlers costs nothing.

Indexing directives, Content-Signal and AIPREF preferences are in the tabs below.

Observed access

GoodForBotsBot received HTTP 200 via a direct request.

Sources and scope: observed access
  • Declared allow · Scan admission

    • GoodForBotsBot/1.0 (+https://goodforbots.com/bot)

    The recorded robots admission decision allowed our crawler to proceed.

    GoodForBotsBot admission along the homepage request chain

    https://dtcify.com/

    robots.txt is present and valid

  • Observed · Direct request

    • GoodForBotsBot/1.0 (+https://goodforbots.com/bot)

    Our request received HTTP 200. A status alone does not identify a WAF.

    Our recorded direct transport attempt; intermediate attempt URLs are not retained

    https://dtcify.com

    HTTP 200

    Serves the homepage over HTTPS with HTTP 200

  • Observed · Final homepage response

    • GoodForBotsBot/1.0 (+https://goodforbots.com/bot)

    GoodForBotsBot received HTTP 200 via a direct request.

    homepage response

    https://dtcify.com/

    HTTP 200
    Transport: direct

    Serves the homepage over HTTPS with HTTP 200Serves our crawler without a challenge

Coverage and interpretation
  • Crawler coverage includes the registered identities and up to 50 user-agent entries from robots.txt. Source excerpts and detail groups are bounded; omissions are labelled.
  • Observed access describes GoodForBotsBot only. Other crawler entries describe declared rules, not tests of those operators' access.
  • Coverage is the sampled homepage response and collected robots.txt files. No indexing or citation is guaranteed. Usage preferences are declarations, not a legal determination of permission.
  • This explanation adds no points or penalties. Any score effects belong to the linked checks.
  • AIPREF and Content Signals keep their own definitions. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process.

In its category

23rd of 47 in Directories & Aggregators

  1. 1Brivoybrivoy.com
  2. 2IndieLaunchindielaunch.dev
  3. 23DTCify · this reportdtcify.com

The prompts in the owner view would take DTCify to 94, 4th in its category.

To the prompts →

Category average 62. The percentile appears once the catalogue holds a few hundred sites.

Scan details

Every scan is kept. Pro draws the history as a chart →

Scanned
11 Nov 2026
Rubric
0.9.0
Requests
23
Fetched
3 MB
Took
22.8 s
Homepage
1.3 s · direct
Pages read
4
robots.txt
allowed
Which pages the scan read

The homepage and up to three pages from the sitemap and homepage links. Structured data, page structure, Markdown negotiation and typed links check each page read and take the median page; other checks read the homepage.

  • Homepagealways read
  • /categorycollection · linked from the homepage · from the sitemap · read
  • /pricingpricing · linked from the homepage · from the sitemap · read
  • /aboutabout · linked from the homepage · from the sitemap · read

Do you run dtcify.com? Open the owner view → Removing the listing is free. Remove →