
ResourcesHunt
resourceshunt.comCommunity directory of useful online tools, courses and resources, with voting and saving
- Scanned
- Category
- Directories & Aggregators
- Markdown
- Read this report
What is ResourcesHunt?
ResourcesHunt is a directory of online resources. The homepage and its meta description describe it as a place to discover useful AI tools, data resources, developer tools, design resources, business resources, courses and more. Visitors can browse by category, including AI, Data Analytics, Programming, Design, Business, Education, Finance and Career, and users can submit their own tools, websites, courses or platforms. Listed resources can be voted on, saved and commented on, and the site shows recently added, trending and most saved entries alongside a short news section. The input does not say who operates the site or whether it charges for anything.
Through a bot’s eyes
“ResourcesHunt is a community directory where users submit, vote on and save useful online resources such as AI tools, developer tools, design resources and courses. The input does not say who runs it or what it costs.”
Simulated from the response GoodForBotsBot received on , not a live answer from any AI assistant.
What it can read, and what stays hidden →Show less ↑
What a bot can read
The text covers a range of subjects through a set of resource listings, each with a title and a one-line description. Subjects include AI assistants and agents, databases and data analytics, Git workflows, video editing, design, business insurance, online courses, resume building, mock interviews, career and job portals, and the United Nations jobs portal. Three news items describe an AI dataset for finance, an industrial drawing search tool and a formal verification project. Several listings are described as free, and the text names specific tools, but the homepage does not give prices for most listed resources and does not say who runs the directory. Contact details, documentation and submission guidelines are not present as text beyond the words Submit and Submit a Resource. The JSON-LD block adds a WebSite and an Organization record with the name ResourcesHunt, the same description as the meta tag, and a link to an X account. It contains no offer, pricing or address data.
What stays hidden
A model reading this input cannot find out who operates ResourcesHunt, how submissions are reviewed beyond the word approved, whether submitting or listing a resource costs money, and what the paid or free status is for most of the listed tools, since the descriptions rarely state it. It also cannot tell how votes, saves and comments affect what is shown, or whether the directory has any scope limits beyond the categories named on the page.
Good for Bots report
ResourcesHunt scores 51 of 100: 44 of the 50 base points, 8 of the 50 agent-layer points, no penalties.
robots.txt is present and valid. robots.txt is valid, with 33 user-agent groups.
Sitemap is present and parses. Sitemap declared in robots.txt, listing at least 200 URLs.
Describes itself to machines with schema.org JSON-LD. 3 of 4 pages read pass. The page at /about publishes no structured data at all: no JSON-LD, no microdata, no RDFa.
Content is marked up so a reader can find it. None of the 4 pages read pass fully; 4 partly. The homepage is partly structured: No <h1>, so nothing says what the page is about. +5.1 with its prompt in Pro.
Navigation links expose usable destinations. 8 of 8 assessed homepage navigation links expose usable destinations.
Links and buttons have accessible names. 187 of 187 assessed homepage links and buttons have a nonempty accessible name.
Form fields have names and recognizable semantics. 2 of 2 assessed homepage form fields meet the static naming and field-semantics checks.
Controls expose roles, states and relationships. 189 of 190 assessed homepage controls and role declarations meet the static role, state and relationship checks. +1.3 with its prompt in Pro.
Each page declares one usable canonical URL. All 4 pages read pass. The homepage declares itself as its canonical URL.
States a position on AI crawlers. States a position on 9 AI crawlers, covering 9 crawlers.
Declares AI usage preferences. Declares AI usage preferences via Content-Signal (robots.txt): ai-train, search.
Serves markdown at its own URL. No /llms-full.txt and no markdown versions linked from llms.txt. +12.5 with its prompt.
llms.txt is present and well formed. No /llms.txt on this site. +11.3 with its prompt.
Serves markdown when asked for it. None of the 4 pages read pass. Asking the homepage for markdown still returns text/html. +10 with its prompt.
llms.txt is descriptive, not a bare link list. No usable /llms.txt to judge. +7.5 with its prompt in Pro.
Advertises machine-readable resources with typed links. None of the 4 pages read pass. The homepage's links are all ordinary page furniture; none point an agent anywhere. +1.3 with its prompt in Pro.
Earned
44 of the 50 base points above the line, 8 of the 50 agent-layer points below it.
3 prompts away
Taken back
Earned, then taken back by penalties.
Still open
Behind the checks below, with prompts in Pro.
For the owner of resourceshunt.com
3 prompts, 34 points
They are in the owner view, ready to paste into Claude Code, Cursor or Codex, beside the badge and rescans.
All 36 checks
Evidence for each, in Markdown →Select a check to see what we found and how it is graded.
Readable base
43.6 / 50
3.4 of 3.4 points.
robots.txt is valid, with 33 user-agent groups.
8.5 of 8.5 points.
Sitemap declared in robots.txt, listing at least 200 URLs.
8.5 of 8.5 points.
3 of 4 pages read pass. The page at /about publishes no structured data at all: no JSON-LD, no microdata, no RDFa.
5.1 of 10.2 points.
None of the 4 pages read pass fully; 4 partly. The homepage is partly structured: No <h1>, so nothing says what the page is about.
4.2 of 4.2 points.
187 of 187 assessed homepage links and buttons have a nonempty accessible name.
2.5 of 2.5 points.
2 of 2 assessed homepage form fields meet the static naming and field-semantics checks.
1.3 of 2.5 points.
189 of 190 assessed homepage controls and role declarations meet the static role, state and relationship checks.
1.7 of 1.7 points.
All 4 pages read pass. The homepage declares itself as its canonical URL.
0 of 0 points.
No section links were found on the pages read.
Agent layer
7.5 / 50
0 of 11.3 points.
No /llms.txt on this site.
0 of 12.5 points.
No /llms-full.txt and no markdown versions linked from llms.txt.
0 of 10 points.
None of the 4 pages read pass. Asking the homepage for markdown still returns text/html.
5 of 5 points.
States a position on 9 AI crawlers, covering 9 crawlers.
2.5 of 2.5 points.
Declares AI usage preferences via Content-Signal (robots.txt): ai-train, search.
0 of 1.3 points.
None of the 4 pages read pass. The homepage's links are all ordinary page furniture; none point an agent anywhere.
Penalties
− 0
Penalty: 0 of 15 points.
Our crawler reaches the page without being challenged.
Penalty: 0 of 20 points.
Nothing on the homepage tells a crawler to skip it or to withhold its snippet.
Penalty: 0 of 25 points.
The captured homepage HTML contains 791 content words; completeness is not assessed.
Penalty: 0 of 25 points.
robots.txt allows every known search and user-fetch crawler to reach the homepage.
Penalty: 0 of 10 points.
The homepage is served over HTTPS and returns HTTP 200.
Penalty: 0 of 3 points.
The homepage provides both a non-empty title and meta description.
Penalty: 0 of 3 points.
The homepage is reached in 0 redirects.
Penalty: 0 of 3 points.
The homepage reached a plain crawler in 543 ms.
Agent capabilities
0 of 11 · no points
Each one found adds +1 to the badge.
Adds +1 to the badge when found.
No API catalog published.
Adds +1 to the badge when found.
No /auth.md published.
Adds +1 to the badge when found.
No AI Catalog published, so no MCP server card can be discovered.
Adds +1 to the badge when found.
No A2A Agent Card at /.well-known/agent-card.json, and none listed in an AI Catalog.
Adds +1 to the badge when found.
No usable Agent Skills index was found at either well-known path or in the AI Catalog.
Adds +1 to the badge when found.
No WebMCP declarations were found in the collected HTML or inline scripts. External scripts were not inspected.
Adds +1 to the badge when found.
No Web Bot Auth key directory at /.well-known/http-message-signatures-directory.
Adds +1 to the badge when found.
No HTTP 402 payment challenge on the homepage or robots.txt, and no manifest at /.well-known/x402.
Adds +1 to the badge when found.
No ACP discovery declaration established at /.well-known/acp.json.
Adds +1 to the badge when found.
No UCP discovery declaration established at /.well-known/ucp.
Adds +1 to the badge when found.
No public AMP discovery declaration established. Private or hidden agents may not advertise one to our crawler.
Site profile
- Login
- Not established
- API
- Not established
- Commerce
- Not established
It decides which conditional checks apply. “Not established” means no proof in what we read, not proof of absence.
Access & usage policy
Who can read this page, and for what purpose?
GoodForBotsBot received HTTP 200 via a direct request. No indexing restriction was observed in the supported homepage directives.
Sampled URL: https://resourceshunt.com/
- Measured, our crawler
- HTTP 200
- GoodForBotsBot received HTTP 200 via a direct request.
- Search and user-fetch crawlers refused
- 0 of 20
- robots.txt refuses none of them.
- Training crawlers refused
- 9
- GPTBot, ClaudeBot, MistralAI-Training and 6 more. Refusing training never changes the score.
Crawlers and what robots.txt declares for them
Rules for the sampled URL, read the way RFC 9309 reads them. These are declarations, not access tests.
| Crawler | Purpose | Declared access | Score effect | Rule that applies |
|---|---|---|---|---|
| Our crawler, measured | ||||
| GoodForBotsBotGood for Bots | Site diagnostics | FetchedHTTP 200, direct | Not scored | robots.txt admitted our crawler |
| Search and AI answers | ||||
| OAI-SearchBotOpenAI | AI search | Allowed | None | Not named; User-agent: * applies |
| Claude-SearchBotAnthropic | AI search | Allowed | None | Not named; User-agent: * applies |
| PerplexityBotPerplexity | AI search | Allowed | None | Not named; User-agent: * applies |
| MistralAI-IndexMistral | AI search | Allowed | None | Not named; User-agent: * applies |
| Kimi-SearchBotMoonshot AI | AI search | Allowed | None | Not named; User-agent: * applies |
| Amzn-SearchBotAmazon | AI search | Allowed | None | Not named; User-agent: * applies |
| Meta-WebIndexerMeta | AI search | Allowed | None | Not named; User-agent: * applies |
| ExaSearchBotExa | AI search | Allowed | None | Not named; User-agent: * applies |
| AIWebIndexLyrenth | AI search | Allowed | None | Not named; User-agent: * applies |
| DuckAssistBotDuckDuckGo | AI search | Allowed | None | Not named; User-agent: * applies |
| ShapBotParallel | AI search | Allowed | None | Not named; User-agent: * applies |
| YandexAdditionalYandex | AI search | Allowed | None | Not named; User-agent: * applies |
| GooglebotGoogle | Search | Allowed | Not scored | Not named; User-agent: * applies |
| BingbotMicrosoft | Search | Allowed | Not scored | Not named; User-agent: * applies |
| DiffbotDiffbot | Search | Refused | Not scored | User-agent: diffbot
Disallow: / |
| , all allowed | ||||
| Fetches a person asked for | ||||
| ChatGPT-UserOpenAI | User fetch | Allowed | None | Not named; User-agent: * applies |
| Claude-UserAnthropic | User fetch | Allowed | None | Not named; User-agent: * applies |
| Perplexity-UserPerplexity | User fetch | Allowed | None | Not named; User-agent: * applies |
| MistralAI-UserMistral | User fetch | Allowed | None | Not named; User-agent: * applies |
| Kimi-UserMoonshot AI | User fetch | Allowed | None | Not named; User-agent: * applies |
| Amzn-UserAmazon | User fetch | Allowed | None | Not named; User-agent: * applies |
| Diffbot-UserDiffbot | User fetch | Allowed | None | Not named; User-agent: * applies |
| Meta-ExternalFetcherMeta | User fetch, Agent | Allowed | None | Not named; User-agent: * applies |
| , all allowed | ||||
| Model training, never scored | ||||
| GPTBotOpenAI | AI training | Refused | None: training opt-outs are neutral | User-agent: gptbot
Disallow: / |
| ClaudeBotAnthropic | AI training | Refused | None: training opt-outs are neutral | User-agent: claudebot
Disallow: / |
| MistralAI-TrainingMistral | AI training | Refused | None: training opt-outs are neutral | User-agent: mistralai-training
Disallow: / |
| KimiBotMoonshot AI | AI training | Refused | None: training opt-outs are neutral | User-agent: kimibot
Disallow: / |
| AI2BotAi2 | AI training | Allowed | None | Not named; User-agent: * applies |
| Applebot-ExtendedApple | AI training | Refused | None: training opt-outs are neutral | User-agent: applebot-extended
Disallow: / |
| Webzio-extendedWebz.io | AI training | Allowed | None | Not named; User-agent: * applies |
| Google-ExtendedGoogle | AI training, Grounding | Refused | None: training opt-outs are neutral | User-agent: google-extended
Disallow: / |
| Meta-ExternalAgentMeta | AI training, Product improvement | Refused | None: training opt-outs are neutral | User-agent: meta-externalagent
Disallow: / |
| AmazonbotAmazon | AI training, Product improvement | Refused | None: training opt-outs are neutral | User-agent: amazonbot
Disallow: / |
| CCBotCommon Crawl | Open dataset, AI training | Refused | None: training opt-outs are neutral | User-agent: ccbot
Disallow: / |
| , all allowed | ||||
| Agents, extraction and others | ||||
| FirecrawlAgentFirecrawl | Extraction | Allowed | Not scored | Not named; User-agent: * applies |
| WebzioWebz.io | Extraction | Allowed | Not scored | Not named; User-agent: * applies |
| bytespiderUnspecified | Not established | Refused | Not scored | User-agent: bytespider
Disallow: / |
| omgiliUnspecified | Not established | Refused | Not scored | User-agent: omgili
Disallow: / |
| anthropic-aiUnspecified | Not established | Refused | Not scored | User-agent: anthropic-ai
Disallow: / |
| claude-webUnspecified | Not established | Refused | Not scored | User-agent: claude-web
Disallow: / |
| cohere-aiUnspecified | Not established | Refused | Not scored | User-agent: cohere-ai
Disallow: / |
| googleotherUnspecified | Not established | Refused | Not scored | User-agent: googleother
Disallow: / |
| baiduspiderUnspecified | Not established | Refused | Not scored | User-agent: baiduspider
Disallow: / |
| petalbotUnspecified | Not established | Refused | Not scored | User-agent: petalbot
Disallow: / |
| awariosmartbotUnspecified | Not established | Refused | Not scored | User-agent: awariosmartbot
User-agent: awariorssbot
Disallow: / |
| awariorssbotUnspecified | Not established | Refused | Not scored | User-agent: awariosmartbot
User-agent: awariorssbot
Disallow: / |
| Google-CloudVertexBotGoogle | Extraction | Refused | Not scored | User-agent: google-cloudvertexbot
Disallow: / |
| qualifiedbotUnspecified | Not established | Refused | Not scored | User-agent: qualifiedbot
Disallow: / |
| cotoyogiUnspecified | Not established | Refused | Not scored | User-agent: cotoyogi
Disallow: / |
| icc-crawlerUnspecified | Not established | Refused | Not scored | User-agent: icc-crawler
Disallow: / |
| atlassian-botUnspecified | Not established | Refused | Not scored | User-agent: atlassian-bot
Disallow: / |
| fishbotUnspecified | Not established | Refused | Not scored | User-agent: fishbot
Disallow: / |
| borderxbotUnspecified | Not established | Refused | Not scored | User-agent: borderxbot
Disallow: / |
| navubotUnspecified | Not established | Refused | Not scored | User-agent: navubot
Disallow: / |
| semrushbot-swaUnspecified | Not established | Refused | Not scored | User-agent: semrushbot-swa
Disallow: / |
| wardbotUnspecified | Not established | Refused | Not scored | User-agent: wardbot
Disallow: / |
| magpie-crawlerUnspecified | Not established | Refused | Not scored | User-agent: magpie-crawler
Disallow: / |
| citibotsitecrawlerUnspecified | Not established | Refused | Not scored | User-agent: citibotsitecrawler
Disallow: / |
| , all allowed | ||||
The robots.txt groups behind this table
User-agent: gptbot Disallow: / User-agent: claudebot Disallow: / User-agent: mistralai-training Disallow: / User-agent: kimibot Disallow: / User-agent: applebot-extended Disallow: / User-agent: google-extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: amazonbot Disallow: / User-agent: ccbot Disallow: / User-agent: bytespider Disallow: / User-agent: diffbot Disallow: / User-agent: omgili Disallow: / User-agent: anthropic-ai Disallow: / User-agent: claude-web Disallow: / User-agent: cohere-ai Disallow: / User-agent: googleother Disallow: / User-agent: baiduspider Disallow: / User-agent: petalbot Disallow: / User-agent: awariosmartbot User-agent: awariorssbot Disallow: / User-agent: google-cloudvertexbot Disallow: / User-agent: qualifiedbot Disallow: / User-agent: cotoyogi Disallow: / User-agent: icc-crawler Disallow: / User-agent: atlassian-bot Disallow: / User-agent: fishbot Disallow: / User-agent: borderxbot Disallow: / User-agent: navubot Disallow: / User-agent: semrushbot-swa Disallow: / User-agent: wardbot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: citibotsitecrawler Disallow: / User-agent: * Allow: / Allow: /
https://resourceshunt.com/robots.txt
How to read this table
Each row says what robots.txt asks of that crawler. It does not show whether the crawler obeys, or how a firewall treats it. We measured only our own request.
Refusing search or user-fetch crawlers costs points under AI crawler access. Refusing training crawlers costs nothing.
Indexing directives, Content-Signal and AIPREF preferences are in the tabs below.
Observed access
GoodForBotsBot received HTTP 200 via a direct request.
Sources and scope: observed access
Declared allow · Scan admission
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
The recorded robots admission decision allowed our crawler to proceed.
GoodForBotsBot admission along the homepage request chain
https://resourceshunt.com/
Observed · Direct request
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
Our request received HTTP 200. A status alone does not identify a WAF.
Our recorded direct transport attempt; intermediate attempt URLs are not retained
https://resourceshunt.com
HTTP 200
Observed · Final homepage response
- GoodForBotsBot/1.0 (+https://goodforbots.com/bot)
GoodForBotsBot received HTTP 200 via a direct request.
homepage response
https://resourceshunt.com/
HTTP 200 Transport: direct
Serves the homepage over HTTPS with HTTP 200Serves our crawler without a challenge
Indexing directives
No indexing restriction was observed in the supported homepage directives.
Sources and scope: indexing directives
Not observed · Homepage directives
No indexing restriction was observed in the supported homepage directives.
homepage response
https://resourceshunt.com/
Search snippets
No snippet restriction was observed in the supported homepage directives.
Sources and scope: search snippets
Not observed · Homepage directives
No snippet restriction was observed in the supported homepage directives.
homepage response
https://resourceshunt.com/
Search usage
A preference allowing this use applies to at least one listed identity.
Sources and scope: search usage
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: search; applicable robots group/path and this response's header
https://resourceshunt.com/
Declared allow · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: search; applicable crawler group for https://resourceshunt.com/
https://resourceshunt.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
AI input and use
No applicable preference for this use was established.
Sources and scope: ai input and use
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: ai-use; applicable robots group/path and this response's header
https://resourceshunt.com/
Unstated · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: ai-use; applicable crawler group for https://resourceshunt.com/
https://resourceshunt.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
AI training
A preference against this use applies to at least one listed identity.
Sources and scope: ai training
Unstated · AIPREF Content-Usage
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- gptbot (ai-training)
- claudebot (ai-training)
- mistralai-training (ai-training)
- kimibot (ai-training)
- ai2bot (Unknown)
- applebot-extended (ai-training)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- google-extended (ai-training, grounding)
- meta-externalagent (ai-training, product-improvement)
- amazonbot (ai-training, product-improvement)
- ccbot (open-dataset, ai-training)
- googlebot (search)
- bingbot (search)
- bytespider (Unknown)
- diffbot (search)
- omgili (Unknown)
- anthropic-ai (Unknown)
- claude-web (Unknown)
- cohere-ai (Unknown)
- googleother (Unknown)
- baiduspider (search)
- petalbot (Unknown)
- awariosmartbot (Unknown)
- awariorssbot (Unknown)
- google-cloudvertexbot (extraction)
- qualifiedbot (Unknown)
- cotoyogi (Unknown)
- icc-crawler (Unknown)
- atlassian-bot (Unknown)
- fishbot (Unknown)
- borderxbot (Unknown)
- navubot (Unknown)
- semrushbot-swa (Unknown)
- wardbot (Unknown)
- magpie-crawler (Unknown)
- citibotsitecrawler (Unknown)
No applicable AIPREF preference was established for this purpose.
Purpose: train-ai; applicable robots group/path and this response's header
https://resourceshunt.com/
Declared restriction · Content-Signal
- goodforbotsbot (Site diagnostics)
- * (Default robots group)
- oai-searchbot (ai-search)
- claude-searchbot (ai-search)
- perplexitybot (ai-search)
- mistralai-index (ai-search)
- kimi-searchbot (ai-search)
- amzn-searchbot (ai-search)
- meta-webindexer (ai-search)
- exasearchbot (ai-search)
- aiwebindex (ai-search)
- duckassistbot (ai-search)
- shapbot (ai-search)
- yandexadditional (ai-search)
- yandexadditionalbot (ai-search)
- ai2bot (Unknown)
- webzio-extended (ai-training)
- chatgpt-user (user-fetch)
- claude-user (user-fetch)
- perplexity-user (user-fetch)
- mistralai-user (user-fetch)
- kimi-user (user-fetch)
- amzn-user (user-fetch)
- diffbot-user (user-fetch)
- firecrawlagent (extraction)
- webzio (extraction)
- meta-externalfetcher (user-fetch, agent)
- googlebot (search)
- bingbot (search)
The applicable crawler group declares these Content Signals. They are separate from permission to fetch and from AIPREF.
Purpose: train-ai; applicable crawler group for https://resourceshunt.com/
https://resourceshunt.com/robots.txt
Content-Signal: search=yes,ai-train=no,use=reference
Coverage and interpretation
- Crawler coverage includes the registered identities and up to 50 user-agent entries from robots.txt. Source excerpts and detail groups are bounded; omissions are labelled.
- Observed access describes GoodForBotsBot only. Other crawler entries describe declared rules, not tests of those operators' access.
- Coverage is the sampled homepage response and collected robots.txt files. No indexing or citation is guaranteed. Usage preferences are declarations, not a legal determination of permission.
- This explanation adds no points or penalties. Any score effects belong to the linked checks.
- AIPREF and Content Signals keep their own definitions. AIPREF search can include processing used exclusively for search; training preferences are not a blanket ruling on every search process.
In its category
28th of 47 in Directories & Aggregators
- 1
Brivoybrivoy.com - 2
IndieLaunchindielaunch.dev - 28
ResourcesHunt · this reportresourceshunt.com
The prompts in the owner view would take ResourcesHunt to 85, 7th in its category.
To the prompts →Category average 62. The percentile appears once the catalogue holds a few hundred sites.
Scan details
Every scan is kept. Pro draws the history as a chart →
- Scanned
- 11 Nov 2026
- Rubric
- 0.9.0
- Requests
- 23
- Fetched
- 1.5 MB
- Took
- 18 s
- Homepage
- 543 ms · direct
- Pages read
- 4
- robots.txt
- allowed
Which pages the scan read
The homepage and up to three pages from the sitemap and homepage links. Structured data, page structure, Markdown negotiation and typed links check each page read and take the median page; other checks read the homepage.
- Homepagealways read
- /blog/google-deepmind-alphaproof-code-signal-verificationarticle · linked from the homepage · from the sitemap · read
- /blog/newscollection · linked from the homepage · from the sitemap · read
- /aboutabout · linked from the homepage · from the sitemap · read
Do you run resourceshunt.com? Open the owner view → Removing the listing is free. Remove →