# ╔════════════════════════════════════════════════╗ # ║ ║ # ║ THEPHANTOMHYENA // HYENA CAPITAL ║ # ║ Just a hyena with a goal. ║ # ║ ║ # ║ robots.txt · creator page crawler policy ║ # ║ https://thephantomhyena.com ║ # ║ ║ # ╚════════════════════════════════════════════════╝ # # Canonical host: https://thephantomhyena.com # Human-readable policy: https://thephantomhyena.com/responsible-ai # Sitemap (human view): https://thephantomhyena.com/sitemap # LLM summary: https://thephantomhyena.com/llms.txt # Published, developed and managed by FoulFoxHacks (Sammy The Femboy Puppy), https://akasammythepuppy.me # # --------------------------------------------------------------------------- # POLICY # --------------------------------------------------------------------------- # - Allow ordinary search indexing, image/video/news discovery, social previews, # SEO auditing, ad validation, and user-directed AI search/retrieval. # - Reserve the site's content from dedicated model-training and bulk-dataset # crawlers where those operators provide distinct user-agent controls. # - URLs that should not appear in search stay crawlable and use a page-level # meta robots noindex or an X-Robots-Tag: noindex response header. # Scripts, styles, fonts and decorative images are noindexed that way, not # blocked here: search engines need them to render the pages. # # --------------------------------------------------------------------------- # CONTENT SIGNALS # --------------------------------------------------------------------------- # As a condition of accessing this website, you agree to abide by the following # content signals: # # (a) If a Content-Signal = yes, you may collect content for the corresponding use. # (b) If a Content-Signal = no, you may not collect content for the corresponding use. # (c) If the website operator does not include a Content-Signal for a corresponding # use, the operator neither grants nor restricts permission via Content-Signal # with respect to that use. # # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from this website's contents). Search does # not include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval augmented # generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # use: how AI systems may consume the content (immediate, reference, or full). # # ai-input is intentionally omitted from the active Content-Signal. The site neither # grants nor restricts that use through Content-Signal; access for named AI-search # and user-directed retrieval agents is handled by the groups below. # # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF RIGHTS # UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT AND RELATED # RIGHTS IN THE DIGITAL SINGLE MARKET. # --------------------------------------------------------------------------- # PRIORITY SEARCH, REGIONAL SEARCH, AND AI-ANSWER DISCOVERY # Named groups repeat the Content-Signal and Disallow rules because a specific # user-agent group does not inherit directives from the wildcard group. # --------------------------------------------------------------------------- User-agent: Googlebot User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-News User-agent: Bingbot User-agent: DuckDuckBot User-agent: Applebot User-agent: Slurp User-agent: YandexBot User-agent: Baiduspider User-agent: PetalBot User-agent: Yeti User-agent: MojeekBot User-agent: SeznamBot User-agent: Teoma User-agent: Amzn-SearchBot User-agent: Amzn-User User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: DuckAssistBot User-agent: Gemini-Deep-Research Content-Signal: search=yes,ai-train=no,use=reference Allow: / Disallow: /api/ Disallow: /cart Disallow: /*?q= Disallow: /*?*cartId= # Brave Search has no distinct robots.txt product token. Keeping Googlebot # crawlable keeps the site eligible under Brave's crawler policy. # --------------------------------------------------------------------------- # SOCIAL AND MESSAGING LINK PREVIEWS # --------------------------------------------------------------------------- User-agent: facebookexternalhit User-agent: Facebot User-agent: meta-externalfetcher User-agent: meta-webindexer User-agent: meta-externalads User-agent: Twitterbot User-agent: LinkedInBot User-agent: Discordbot User-agent: Pinterestbot User-agent: Slackbot User-agent: TelegramBot User-agent: WhatsApp User-agent: ViberBot Content-Signal: search=yes,ai-train=no,use=reference Allow: / Disallow: /api/ Disallow: /cart Disallow: /*?q= Disallow: /*?*cartId= # --------------------------------------------------------------------------- # SEO AUDITS, SEARCH TESTING, SHOPPING, AND AD VALIDATION # AdsBot-Google and Mediapartners-Google get explicit groups because some Google # special-case crawlers ignore the wildcard group. # --------------------------------------------------------------------------- User-agent: Google-InspectionTool User-agent: Storebot-Google User-agent: AdsBot-Google User-agent: Mediapartners-Google User-agent: OAI-AdsBot User-agent: AhrefsBot User-agent: AhrefsSiteAudit User-agent: SemrushBot User-agent: SiteAuditBot User-agent: Rogerbot User-agent: MJ12bot User-agent: DotBot User-agent: DataForSeoBot User-agent: Chrome-Lighthouse Content-Signal: search=yes,ai-train=no,use=reference Allow: / Disallow: /api/ Disallow: /cart Disallow: /*?q= Disallow: /*?*cartId= # --------------------------------------------------------------------------- # DEFAULT PUBLIC-WEB ACCESS # This also covers legitimate crawlers not named above. # --------------------------------------------------------------------------- User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Allow: / Disallow: /api/ Disallow: /cart Disallow: /*?q= Disallow: /*?*cartId= # --------------------------------------------------------------------------- # DEDICATED MODEL-TRAINING, EXTENDED-USE, AND BULK-DATASET CRAWLERS # Search-specific and user-directed counterparts stay allowed above. # --------------------------------------------------------------------------- User-agent: Applebot-Extended User-agent: Google-Extended User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: Amazonbot User-agent: meta-externalagent User-agent: FacebookBot User-agent: Bytespider User-agent: CCBot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Diffbot User-agent: Omgilibot User-agent: ImagesiftBot User-agent: PanguBot User-agent: Timpibot User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: AI2Bot-DeepResearchEval User-agent: DigitalOceanGenAICrawler User-agent: img2dataset User-agent: laion-huggingface-processor Disallow: / # --------------------------------------------------------------------------- # SITEMAPS # https://thephantomhyena.com/sitemap.xml is the index. Each translated language has its own # sitemap with hreflang alternates for every version. # --------------------------------------------------------------------------- Sitemap: https://thephantomhyena.com/sitemap.xml Sitemap: https://thephantomhyena.com/page-sitemap.xml Sitemap: https://thephantomhyena.com/post-sitemap.xml Sitemap: https://thephantomhyena.com/product-sitemap.xml Sitemap: https://thephantomhyena.com/video-sitemap.xml Sitemap: https://thephantomhyena.com/es/sitemap.xml Sitemap: https://thephantomhyena.com/pt-br/sitemap.xml Sitemap: https://thephantomhyena.com/fr/sitemap.xml Sitemap: https://thephantomhyena.com/de/sitemap.xml Sitemap: https://thephantomhyena.com/ja/sitemap.xml Sitemap: https://thephantomhyena.com/ko/sitemap.xml