
DTCify
dtcify.comDirectory of direct-to-consumer brands with shipping, returns and pricing details
- Scanned
- Category
- Directories & Aggregators
- Markdown
- Read this report
What is DTCify?
DTCify is a directory of direct-to-consumer brands, presented as a curated listing of independent brands, ecommerce tools and the stories behind them. According to its llms.txt and meta description, each brand profile summarizes facts collected from the brand's official public pages, including what it sells, price range, shipping, returns, warranty, subscriptions, customer support and where to buy. The site is aimed at founders, marketers and online shoppers. It offers a browsable category list, and brand owners can submit a brand or claim an existing listing. The meta description states that the directory holds more than 3,000 brands.
Through a bot’s eyes
“DTCify is a curated directory of direct-to-consumer brands, with profiles summarizing shipping, returns, pricing and customer support details collected from brands' official public pages.”
Simulated from the response GoodForBotsBot received on , not a live answer from any AI assistant.
What it can read, and what stays hidden →Show less ↑
What a bot can read
A model reading this homepage learns that DTCify is a directory organized by category. The page lists brand names under headings such as Apparel & Accessories, Beauty & Personal Care, Home & Garden, Food & Beverage, Health & Wellness, Electronics & Smart Home, Sports & Outdoors and Baby & Kids, each linked to a category page. The body text contains calls to action for browsing categories and collections and for submitting or claiming a brand. The homepage text does not itself state prices, shipping or return terms for any brand; those topics appear only in the meta description as a general description of the profiles. The llms.txt file adds a section map, describes the profile fields in more detail and links About, Terms, Privacy and sitemap pages. The JSON-LD adds a WebSite and Organization record with the site description, a contact email and two social profile links. The homepage text is truncated, so the listing shown is partial.
What stays hidden
A model reading only this input cannot tell which individual brands have which shipping, return or price terms, because no brand profile was read. It cannot tell how brands are selected for the 3,000-plus listings, whether brands pay for listings or features, or who runs the company beyond the listed email and social links.
Good for Bots report
DTCify scores 63 of 100: 40 of the 50 base points, 23 of the 50 agent-layer points, no penalties.
robots.txt is present and valid. robots.txt is valid, with 34 user-agent groups.
Sitemap is present and parses. Sitemap declared in robots.txt, listing at least 200 URLs.
Content is marked up so a reader can find it. All 4 pages read pass. The homepage marks its content root, its heading outline and its landmarks.
Navigation links expose usable destinations. 16 of 16 assessed homepage navigation links expose usable destinations.
Links and buttons have accessible names. 583 of 583 assessed homepage links and buttons have a nonempty accessible name.
Form fields have names and recognizable semantics. 1 of 1 assessed homepage form fields meet the static naming and field-semantics checks.
Controls expose roles, states and relationships. 595 of 596 assessed homepage controls and role declarations meet the static role, state and relationship checks. +1.3 with its prompt in Pro.
Each page declares one usable canonical URL. All 4 pages read pass. The homepage declares itself as its canonical URL.
Section links reach an element on the page. Both pages read pass. The homepage has 11 section links, and every one reaches an element on the page.
Describes itself to machines with schema.org JSON-LD. 1 of 4 pages read pass. The page at /category publishes no structured data at all: no JSON-LD, no microdata, no RDFa. +8.3 with its prompt.
llms.txt is present and well formed. /llms.txt is well formed: 9 links across 2 sections.
llms.txt is descriptive, not a bare link list. /llms.txt is partly descriptive: only 56% of links carry a description. +3.8 with its prompt in Pro.
States a position on AI crawlers. States a position on 15 AI crawlers, across 3 purposes (training, search, user-fetch).
Declares AI usage preferences. Declares AI usage preferences via Content-Signal (robots.txt): ai-train, search.
Serves markdown at its own URL. No /llms-full.txt and no markdown versions linked from llms.txt. +12.5 with its prompt.
Serves markdown when asked for it. None of the 4 pages read pass. Asking the homepage for markdown still returns text/html. +10 with its prompt.
Advertises machine-readable resources with typed links. None of the 4 pages read pass. The homepage's links are all ordinary page furniture; none point an agent anywhere. +1.3 with its prompt in Pro.
Earned
40 of the 50 base points above the line, 23 of the 50 agent-layer points below it.
3 prompts away
Still open
Behind the checks below, with prompts in Pro.
For the owner of dtcify.com
3 prompts, 31 points
They are in the owner view, ready to paste into Claude Code, Cursor or Codex, beside the badge and rescans.
All 36 checks
Evidence for each, in Markdown →Select a check to see what we found and how it is graded.
Readable base
40.4 / 50
3.3 of 3.3 points.
robots.txt is valid, with 34 user-agent groups.
8.3 of 8.3 points.
Sitemap declared in robots.txt, listing at least 200 URLs.
0 of 8.3 points.
1 of 4 pages read pass. The page at /category publishes no structured data at all: no JSON-LD, no microdata, no RDFa.
10 of 10 points.
All 4 pages read pass. The homepage marks its content root, its heading outline and its landmarks.
4.2 of 4.2 points.
583 of 583 assessed homepage links and buttons have a nonempty accessible name.
2.5 of 2.5 points.
1 of 1 assessed homepage form fields meet the static naming and field-semantics checks.
1.3 of 2.5 points.
595 of 596 assessed homepage controls and role declarations meet the static role, state and relationship checks.
1.7 of 1.7 points.
All 4 pages read pass. The homepage declares itself as its canonical URL.
0.8 of 0.8 points.
Both pages read pass. The homepage has 11 section links, and every one reaches an element on the page.
Agent layer
22.5 / 50
11.3 of 11.3 points.
/llms.txt is well formed: 9 links across 2 sections.
3.8 of 7.5 points.
/llms.txt is partly descriptive: only 56% of links carry a description.
0 of 12.5 points.
No /llms-full.txt and no markdown versions linked from llms.txt.
0 of 10 points.
None of the 4 pages read pass. Asking the homepage for markdown still returns text/html.
5 of 5 points.
States a position on 15 AI crawlers, across 3 purposes (training, search, user-fetch).
2.5 of 2.5 points.
Declares AI usage preferences via Content-Signal (robots.txt): ai-train, search.
0 of 1.3 points.
None of the 4 pages read pass. The homepage's links are all ordinary page furniture; none point an agent anywhere.
Penalties
− 0
Penalty: 0 of 15 points.
Our crawler reaches the page without being challenged.
Penalty: 0 of 20 points.
Nothing on the homepage tells a crawler to skip it or to withhold its snippet.
Penalty: 0 of 25 points.
The captured homepage HTML contains 774 content words; completeness is not assessed.
Penalty: 0 of 25 points.
robots.txt allows every known search and user-fetch crawler to reach the homepage.
Penalty: 0 of 10 points.
The homepage is served over HTTPS and returns HTTP 200.
Penalty: 0 of 3 points.
The homepage provides both a non-empty title and meta description.
Penalty: 0 of 3 points.
The homepage is reached in 0 redirects.
Penalty: 0 of 3 points.
The homepage reached a plain crawler in 1313 ms.
Agent capabilities
0 of 11 · no points
Each one found adds +1 to the badge.
Adds +1 to the badge when found.
No API catalog published.
Adds +1 to the badge when found.
/auth.md returns an HTML page rather than a markdown document.
Adds +1 to the badge when found.
No AI Catalog published, so no MCP server card can be discovered.
Adds +1 to the badge when found.
No A2A Agent Card at /.well-known/agent-card.json, and none listed in an AI Catalog.
Adds +1 to the badge when found.
No usable Agent Skills index was found at either well-known path or in the AI Catalog.
Adds +1 to the badge when found.
No WebMCP declarations were found in the collected HTML or inline scripts. External scripts were not inspected.
Adds +1 to the badge when found.
No Web Bot Auth key directory at /.well-known/http-message-signatures-directory.
Adds +1 to the badge when found.
No HTTP 402 payment challenge on the homepage or robots.txt, and no manifest at /.well-known/x402.
Adds +1 to the badge when found.
No ACP discovery declaration established at /.well-known/acp.json.
Adds +1 to the badge when found.
No UCP discovery declaration established at /.well-known/ucp.
Adds +1 to the badge when found.
No public AMP discovery declaration established. Private or hidden agents may not advertise one to our crawler.
Site profile
- Login
- Detected
- A sign-in button in the page header
- API
- Not established
- Commerce
- Not established
It decides which conditional checks apply. “Not established” means no proof in what we read, not proof of absence.
Access & usage policy
Who can read this page, and for what purpose?
GoodForBotsBot received HTTP 200 via a direct request. No indexing restriction was observed in the supported homepage directives.
Sampled URL: https://dtcify.com/
- Measured, our crawler
- HTTP 200
- GoodForBotsBot received HTTP 200 via a direct request.
- Search and user-fetch crawlers refused
- 0 of 20
- robots.txt refuses none of them.
- Training crawlers refused
- 5
- MistralAI-Training, KimiBot, Meta-ExternalAgent and 2 more. Refusing training never changes the score.
Crawlers and what robots.txt declares for them
Rules for the sampled URL, read the way RFC 9309 reads them. These are declarations, not access tests.
| Crawler | Purpose | Declared access | Score effect | Rule that applies |
|---|---|---|---|---|
| Our crawler, measured | ||||
| GoodForBotsBotGood for Bots | Site diagnostics | FetchedHTTP 200, direct | Not scored | robots.txt admitted our crawler |
| Search and AI answers | ||||
| OAI-SearchBotOpenAI | AI search | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| Claude-SearchBotAnthropic | AI search | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| PerplexityBotPerplexity | AI search | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| MistralAI-IndexMistral | AI search | Allowed | None | Not named; User-agent: * applies |
| Kimi-SearchBotMoonshot AI | AI search | Allowed | None | Not named; User-agent: * applies |
| Amzn-SearchBotAmazon | AI search | Allowed | None | Not named; User-agent: * applies |
| Meta-WebIndexerMeta | AI search | Allowed | None | Not named; User-agent: * applies |
| ExaSearchBotExa | AI search | Allowed | None | Not named; User-agent: * applies |
| AIWebIndexLyrenth | AI search | Allowed | None | Not named; User-agent: * applies |
| DuckAssistBotDuckDuckGo | AI search | Allowed | None | Not named; User-agent: * applies |
| ShapBotParallel | AI search | Allowed | None | Not named; User-agent: * applies |
| YandexAdditionalYandex | AI search | Allowed | None | Not named; User-agent: * applies |
| GooglebotGoogle | Search | Allowed | Not scored | Not named; User-agent: * applies |
| BingbotMicrosoft | Search | Allowed | Not scored | Not named; User-agent: * applies |
| DiffbotDiffbot | Search | Refused | Not scored | User-agent: diffbot
Disallow: / |
| , all allowed | ||||
| Fetches a person asked for | ||||
| ChatGPT-UserOpenAI | User fetch | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| Claude-UserAnthropic | User fetch | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| Perplexity-UserPerplexity | User fetch | Allowed | None | User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Allow: / |
| MistralAI-UserMistral | User fetch | Allowed | None | Not named; User-agent: * applies |
| Kimi-UserMoonshot AI | User fetch | Allowed | None | Not named; User-agent: * applies |
| Amzn-UserAmazon | User fetch | Allowed | None | Not named; User-agent: * applies |
| Diffbot-UserDiffbot | User fetch | Allowed | None | Not named; User-agent: * applies |
| Meta-ExternalFetcherMeta | User fetch, Agent | Allowed | None | Not named; User-agent: * applies |
| , all allowed | ||||
| Model training, never scored | ||||
| GPTBotOpenAI | AI training | Allowed | None | User-agent: gptbot
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Disallow: /
Allow: / |
| ClaudeBotAnthropic | AI training | Allowed | None | User-agent: claudebot
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
User-agent: applebot-extended
Disallow: /
Allow: / |
| MistralAI-TrainingMistral | AI training | Refused | None: training opt-outs are neutral | User-agent: mistralai-training
Disallow: / |
| KimiBotMoonshot AI | AI training | Refused | None: training opt-outs are neutral | User-agent: kimibot
Disallow: / |
| AI2BotAi2 | AI training | Allowed | None | Not named; User-agent: * applies |
| Applebot-ExtendedApple | AI training | Allowed | None | User-agent: applebot-extended
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: google-extended
Disallow: /
Allow: / |
| Webzio-extendedWebz.io | AI training | Allowed | None | Not named; User-agent: * applies |
| Google-ExtendedGoogle | AI training, Grounding | Allowed | None | User-agent: google-extended
User-agent: oai-searchbot
User-agent: chatgpt-user
User-agent: gptbot
User-agent: claudebot
User-agent: claude-user
User-agent: claude-searchbot
User-agent: perplexitybot
User-agent: perplexity-user
User-agent: applebot-extended
Disallow: /
Allow: / |
| Meta-ExternalAgentMeta | AI training, Product improvement | Refused | None: training opt-outs are neutral | User-agent: meta-externalagent
Disallow: / |
| AmazonbotAmazon | AI training, Product improvement | Refused | None: training opt-outs are neutral | User-agent: amazonbot
Disallow: / |
| CCBotCommon Crawl | Open dataset, AI training | Refused | None: training opt-outs are neutral | User-agent: ccbot
Disallow: / |
| , all allowed | ||||
| Agents, extraction and others | ||||
| FirecrawlAgentFirecrawl | Extraction | Allowed | Not scored | Not named; User-agent: * applies |
| WebzioWebz.io | Extraction | Allowed | Not scored | Not named; User-agent: * applies |
| bytespiderUnspecified | Not established | Refused | Not scored | User-agent: bytespider
Disallow: / |
| omgiliUnspecified | Not established | Refused | Not scored | User-agent: omgili
Disallow: / |
| anthropic-aiUnspecified | Not established | Refused | Not scored | User-agent: anthropic-ai
Disallow: / |
| claude-webUnspecified | Not established | Refused | Not scored | User-agent: claude-web
Disallow: / |
| cohere-aiUnspecified | Not established | Refused | Not scored | User-agent: cohere-ai
Disallow: / |
| googleotherUnspecified | Not established | Refused | Not scored | User-agent: googleother
Disallow: / |
| baiduspiderUnspecified | Not established | Refused | Not scored | User-agent: baiduspider
Disallow: / |
| petalbotUnspecified | Not established | Refused | Not scored | User-agent: petalbot
Disallow: / |
| awariosmartbotUnspecified | Not established | Refused | Not scored | User-agent: awariosmartbot
User-agent: awariorssbot
Disallow: / |
| awariorssbotUnspecified | Not established | Refused | Not scored | User-agent: awariosmartbot
User-agent: awariorssbot
Disallow: / |
| Google-CloudVertexBotGoogle | Extraction | Refused | Not scored | User-agent: google-cloudvertexbot
Disallow: / |
| qualifiedbotUnspecified | Not established | Refused | Not scored | User-agent: qualifiedbot
Disallow: / |
| cotoyogiUnspecified | Not established | Refused | Not scored | User-agent: cotoyogi
Disallow: / |
| icc-crawlerUnspecified | Not established | Refused | Not scored | User-agent: icc-crawler
Disallow: / |
| atlassian-botUnspecified | Not established | Refused | Not scored | User-agent: atlassian-bot
Disallow: / |
| fishbotUnspecified | Not established | Refused | Not scored | User-agent: fishbot
Disallow: / |
| borderxbotUnspecified | Not established | Refused | Not scored | User-agent: borderxbot
Disallow: / |
| navubotUnspecified | Not established | Refused | Not scored | User-agent: navubot
Disallow: / |
| semrushbot-swaUnspecified | Not established | Refused | Not scored | User-agent: semrushbot-swa
Disallow: / |
| wardbotUnspecified | Not established | Refused | Not scored | User-agent: wardbot
Disallow: / |
| magpie-crawlerUnspecified | Not established | Refused | Not scored | User-agent: magpie-crawler
Disallow: / |
| citibotsitecrawlerUnspecified | Not established | Refused | Not scored | User-agent: citibotsitecrawler
Disallow: / |
| , all allowed | ||||
The robots.txt groups behind this table
User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Allow: / User-agent: gptbot User-agent: oai-searchbot User-agent: chatgpt-user User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Disallow: / Allow: / User-agent: claudebot User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended User-agent: applebot-extended Disallow: / Allow: / User-agent: mistralai-training Disallow: / User-agent: kimibot Disallow: / User-agent: applebot-extended User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: google-extended Disallow: / Allow: / User-agent: google-extended User-agent: oai-searchbot User-agent: chatgpt-user User-agent: gptbot User-agent: claudebot User-agent: claude-user User-agent: claude-searchbot User-agent: perplexitybot User-agent: perplexity-user User-agent: applebot-extended Disallow: / Allow: / User-agent: meta-externalagent Disallow: / User-agent: amazonbot Disallow: / User-agent: ccbot Disallow: / User-agent: bytespider Disallow: / User-agent: diffbot Disallow: / User-agent: omgili Disallow: / User-agent: anthropic-ai Disallow: / User-agent: claude-web Disallow: / User-agent: cohere-ai Disallow: / User-agent: googleother Disallow: / User-agent: baiduspider Disallow: / User-agent: petalbot Disallow: / User-agent: awariosmartbot User-agent: awariorssbot Disallow: / User-agent: google-cloudvertexbot Disallow: / User-agent: qualifiedbot Disallow: / User-agent: cotoyogi Disallow: / User-agent: icc-crawler Disallow: / User-agent: atlassian-bot Disallow: / User-agent: fishbot Disallow: / User-agent: borderxbot Disallow: / User-agent: navubot Disallow: / User-agent: semrushbot-swa Disallow: / User-agent: wardbot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: citibotsitecrawler Disallow: / User-agent: * Allow: / Allow: /
https://dtcify.com/robots.txt
How to read this table
Each row says what robots.txt asks of that crawler. It does not show whether the crawler obeys, or how a firewall treats it. We measured only our own request.
Refusing search or user-fetch crawlers costs points under AI crawler access. Refusing training crawlers costs nothing.
Indexing directives, Content-Signal and AIPREF preferences are in the tabs below.
Observed access
GoodForBotsBot received HTTP 200 via a direct request.
Sources and scope: observed access
Declared allow · Scan admission
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
The recorded robots admission decision allowed our crawler to proceed.
GoodForBotsBot admission along the homepage request chain
https://dtcify.com/
Observed · Direct request
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
Our request received HTTP 200. A status alone does not identify a WAF.
Our recorded direct transport attempt; intermediate attempt URLs are not retained
https://dtcify.com
HTTP 200
Observed · Final homepage response
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
GoodForBotsBot received HTTP 200 via a direct request.
homepage response
https://dtcify.com/
HTTP 200 Transport: direct
Serves the homepage over HTTPS with HTTP 200Serves our crawler without a challenge
Indexing directives
No indexing restriction was observed in the supported homepage directives.
Sources and scope: indexing directives
Not observed · Homepage directives
No indexing restriction was observed in the supported homepage directives.
homepage response
https://dtcify.com/
Search snippets
No snippet restriction was observed in the supported homepage directives.
Sources and scope: search snippets
Not observed · Homepage directives
No snippet restriction was observed in the supported homepage directives.
homepage response
https://dtcify.com/
Search usage
A preference allowing this use applies to at least one listed identity.
Sources and scope: search usage
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: search; applicable robots group/path and this response's header
https://dtcify.com/
Declared allow · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: search; applicable crawler group for https://dtcify.com/
https://dtcify.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
AI input and use
No applicable preference for this use was established.
Sources and scope: ai input and use
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: ai-use; applicable robots group/path and this response's header
https://dtcify.com/
Unstated · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: ai-use; applicable crawler group for https://dtcify.com/
https://dtcify.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
AI training
A preference against this use applies to at least one listed identity.
Sources and scope: ai training
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: train-ai; applicable robots group/path and this response's header
https://dtcify.com/
Declared restriction · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: train-ai; applicable crawler group for https://dtcify.com/
https://dtcify.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
Coverage and interpretation
- Crawler coverage includes the registered identities and up to 50 user-agent entries from robots.txt. Source excerpts and detail groups are bounded; omissions are labelled.
- Observed access describes GoodForBotsBot only. Other crawler entries describe declared rules, not tests of those operators' access.
- Coverage is the sampled homepage response and collected robots.txt files. No indexing or citation is guaranteed. Usage preferences are declarations, not a legal determination of permission.
- This explanation adds no points or penalties. Any score effects belong to the linked checks.
- AIPREF and Content Signals keep their own definitions. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process.
In its category
23rd of 47 in Directories & Aggregators
- 1
Brivoybrivoy.com - 2
IndieLaunchindielaunch.dev - 23
DTCify · this reportdtcify.com
The prompts in the owner view would take DTCify to 94, 4th in its category.
To the prompts →Category average 62. The percentile appears once the catalogue holds a few hundred sites.
Scan details
Every scan is kept. Pro draws the history as a chart →
- Scanned
- 11 Nov 2026
- Rubric
- 0.9.0
- Requests
- 23
- Fetched
- 3 MB
- Took
- 22.8 s
- Homepage
- 1.3 s · direct
- Pages read
- 4
- robots.txt
- allowed
Which pages the scan read
The homepage and up to three pages from the sitemap and homepage links. Structured data, page structure, Markdown negotiation and typed links check each page read and take the median page; other checks read the homepage.
- Homepagealways read
- /categorycollection · linked from the homepage · from the sitemap · read
- /pricingpricing · linked from the homepage · from the sitemap · read
- /aboutabout · linked from the homepage · from the sitemap · read
Do you run dtcify.com? Open the owner view → Removing the listing is free. Remove →